Jun 02 19:01:09.493405 ip-10-0-137-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 19:01:09.493415 ip-10-0-137-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 19:01:09.493421 ip-10-0-137-73 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 19:01:09.493682 ip-10-0-137-73 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 19:01:19.633810 ip-10-0-137-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 19:01:19.633826 ip-10-0-137-73 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9767b121e58244e79bddbdee6f65eb66 -- Jun 02 19:03:48.887342 ip-10-0-137-73 systemd[1]: Starting Kubernetes Kubelet... Jun 02 19:03:49.307394 ip-10-0-137-73 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:49.307394 ip-10-0-137-73 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 19:03:49.307394 ip-10-0-137-73 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:49.307394 ip-10-0-137-73 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 19:03:49.307394 ip-10-0-137-73 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:49.309362 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.309272 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 19:03:49.315643 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315622 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:49.315643 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315640 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:49.315643 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315644 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:49.315643 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315647 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:49.315643 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315650 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315653 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315658 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315661 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315663 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315666 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315669 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315672 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315675 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315679 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315682 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315686 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315688 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315691 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315693 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315695 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315698 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315701 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315703 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315706 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:49.315840 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315709 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315712 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315714 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315717 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315720 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315722 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315725 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315729 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315732 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315735 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315738 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315741 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315743 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315746 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315749 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315752 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315755 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315759 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315761 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:49.316339 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315764 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315767 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315769 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315772 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315775 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315777 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315780 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315782 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315784 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315788 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315790 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315793 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315795 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315797 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315800 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315803 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315805 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315807 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315810 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315812 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:49.316838 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315815 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315817 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315820 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315822 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315825 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315827 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315830 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315834 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315836 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315839 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315842 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315845 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315847 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315850 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315854 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315858 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315860 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315863 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315865 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:49.317336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315868 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315871 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315873 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.315876 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316262 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316268 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316270 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316273 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316276 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316278 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316281 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316284 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316286 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316290 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316294 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316297 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316300 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316303 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316306 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:49.317812 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316309 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316312 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316315 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316317 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316320 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316323 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316326 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316328 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316332 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316335 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316339 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316342 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316345 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316348 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316351 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316353 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316356 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316358 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316361 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:49.318288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316364 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316366 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316369 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316371 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316374 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316376 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316379 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316381 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316384 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316386 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316389 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316391 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316394 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316396 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316400 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316403 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316406 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316409 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316411 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316414 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:49.318757 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316417 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316421 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316423 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316426 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316429 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316431 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316434 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316436 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316439 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316441 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316444 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316446 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316449 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316451 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316453 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316456 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316458 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316461 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316463 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316466 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:49.319262 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316468 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316471 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316474 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316476 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316479 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316481 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316484 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316487 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316489 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316492 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316494 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.316497 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316571 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316578 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316588 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316593 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316597 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316601 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316605 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316610 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316613 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 19:03:49.319748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316616 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316620 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316623 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316626 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316629 2573 flags.go:64] FLAG: --cgroup-root="" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316632 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316635 2573 flags.go:64] FLAG: --client-ca-file="" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316638 2573 flags.go:64] FLAG: --cloud-config="" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316641 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316644 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316652 2573 flags.go:64] FLAG: --cluster-domain="" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316655 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316659 2573 flags.go:64] FLAG: --config-dir="" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316661 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316665 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316668 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316672 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316675 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316678 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316682 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316685 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316688 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316691 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316694 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316698 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 19:03:49.320295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316701 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316704 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316707 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316711 2573 flags.go:64] FLAG: --enable-server="true" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316714 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316718 2573 flags.go:64] FLAG: --event-burst="100" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316721 2573 flags.go:64] FLAG: --event-qps="50" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316724 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316727 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316730 2573 flags.go:64] FLAG: --eviction-hard="" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316734 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316737 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316739 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316743 2573 flags.go:64] FLAG: --eviction-soft="" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316746 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316748 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316751 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316756 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316759 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316762 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316765 2573 flags.go:64] FLAG: --feature-gates="" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316769 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316772 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316775 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316779 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316782 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 02 19:03:49.320899 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316785 2573 flags.go:64] FLAG: --help="false" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316788 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316791 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316794 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316798 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316801 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316805 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316807 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316810 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316813 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316817 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316820 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316823 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316826 2573 flags.go:64] FLAG: --kube-reserved="" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316829 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316832 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316835 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316838 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316841 2573 flags.go:64] FLAG: --lock-file="" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316843 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316846 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316849 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316855 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 19:03:49.321545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316859 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316862 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316865 2573 flags.go:64] FLAG: --logging-format="text" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316868 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316872 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316875 2573 flags.go:64] FLAG: --manifest-url="" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316877 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316882 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316885 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316889 2573 flags.go:64] FLAG: --max-pods="110" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316891 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316894 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316897 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316900 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316903 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316906 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316909 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316916 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316919 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316922 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316926 2573 flags.go:64] FLAG: --pod-cidr="" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316929 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316934 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316936 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 19:03:49.322205 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316940 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316942 2573 flags.go:64] FLAG: --port="10250" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316945 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316948 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9ba63f9f0b147f5" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316951 2573 flags.go:64] FLAG: --qos-reserved="" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316954 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316957 2573 flags.go:64] FLAG: --register-node="true" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316960 2573 flags.go:64] FLAG: --register-schedulable="true" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316963 2573 flags.go:64] FLAG: --register-with-taints="" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316968 2573 flags.go:64] FLAG: --registry-burst="10" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316972 2573 flags.go:64] FLAG: --registry-qps="5" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316975 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316978 2573 flags.go:64] FLAG: --reserved-memory="" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316981 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316984 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316988 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316991 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316994 2573 flags.go:64] FLAG: --runonce="false" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316996 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.316999 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317002 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317005 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317008 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317011 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317014 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317017 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 19:03:49.322799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317020 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317022 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317025 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317042 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317045 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317048 2573 flags.go:64] FLAG: --system-cgroups="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317050 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317056 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317058 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317061 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317065 2573 flags.go:64] FLAG: --tls-min-version="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317068 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317071 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317074 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317076 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317080 2573 flags.go:64] FLAG: --v="2" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317086 2573 flags.go:64] FLAG: --version="false" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317090 2573 flags.go:64] FLAG: --vmodule="" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317094 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.317097 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317185 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317189 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317192 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317195 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:49.323565 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317198 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317201 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317203 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317206 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317209 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317211 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317214 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317216 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317219 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317222 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317224 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317227 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317229 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317232 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317235 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317238 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317240 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317243 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317245 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317248 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:49.324194 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317250 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317253 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317255 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317259 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317263 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317265 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317268 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317271 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317273 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317276 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317278 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317281 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317284 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317287 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317290 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317293 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317296 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317298 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317301 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317303 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:49.324707 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317306 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317309 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317311 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317314 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317316 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317319 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317322 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317324 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317327 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317329 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317332 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317335 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317337 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317340 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317343 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317346 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317350 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317353 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317356 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317358 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:49.325205 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317361 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317363 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317366 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317403 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317406 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317408 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317411 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317414 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317417 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317419 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317422 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317425 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317428 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317430 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317433 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317443 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317447 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317450 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317454 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:49.325715 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317458 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317462 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.317465 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.318315 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.325144 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.325159 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325209 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325215 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325218 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325222 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325225 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325228 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325231 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325234 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325236 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325239 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:49.326190 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325242 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325245 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325247 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325251 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325255 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325258 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325261 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325265 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325268 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325270 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325273 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325276 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325279 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325282 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325285 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325289 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325292 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325295 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325298 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325300 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:49.326587 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325303 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325307 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325310 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325312 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325315 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325318 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325321 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325323 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325326 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325328 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325331 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325334 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325336 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325339 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325342 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325344 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325348 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325351 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325355 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:49.327174 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325358 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325361 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325363 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325366 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325368 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325371 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325373 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325376 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325379 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325382 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325385 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325387 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325390 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325393 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325396 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325398 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325401 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325404 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325406 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325409 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:49.327633 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325411 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325414 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325417 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325419 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325422 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325425 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325427 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325430 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325432 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325435 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325445 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325448 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325450 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325453 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325456 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325459 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:49.328146 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325461 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.325466 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325567 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325571 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325573 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325576 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325580 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325583 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325586 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325588 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325591 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325594 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325597 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325600 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325602 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325605 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:49.328534 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325608 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325610 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325613 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325615 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325618 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325620 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325623 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325626 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325628 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325631 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325634 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325636 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325639 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325641 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325644 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325646 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325650 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325653 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325657 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:49.328923 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325660 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325663 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325666 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325669 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325672 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325675 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325678 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325681 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325684 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325687 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325690 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325693 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325696 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325699 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325701 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325704 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325706 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325709 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325711 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325714 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:49.329404 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325716 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325719 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325722 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325724 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325727 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325730 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325732 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325735 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325737 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325740 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325742 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325744 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325747 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325749 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325752 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325754 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325757 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325760 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325762 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325765 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:49.329909 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325768 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325770 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325773 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325776 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325778 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325781 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325783 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325786 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325788 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325790 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325793 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325796 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:49.325798 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.325803 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.325893 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 19:03:49.330426 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.327847 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 19:03:49.330795 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.328810 2573 server.go:1019] "Starting client certificate rotation" Jun 02 19:03:49.330795 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.328907 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:49.330795 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.328941 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:49.353831 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.353815 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:49.356430 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.356406 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:49.368690 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.368671 2573 log.go:25] "Validated CRI v1 runtime API" Jun 02 19:03:49.374461 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.374444 2573 log.go:25] "Validated CRI v1 image API" Jun 02 19:03:49.376227 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.376207 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 19:03:49.380703 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.380684 2573 fs.go:135] Filesystem UUIDs: map[59ddead9-6c02-4d24-8a51-e30f4e297deb:/dev/nvme0n1p3 78b1e5c9-ed81-4946-9896-2da934716ed8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 02 19:03:49.380777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.380704 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 19:03:49.385324 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.385204 2573 manager.go:217] Machine: {Timestamp:2026-06-02 19:03:49.384671457 +0000 UTC m=+0.384533008 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099926 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bba395aaa8482232c3c85f56338d4 SystemUUID:ec2bba39-5aaa-8482-232c-3c85f56338d4 BootID:9767b121-e582-44e7-9bdd-bdee6f65eb66 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7c:66:22:1a:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7c:66:22:1a:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:86:24:49:fe:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 19:03:49.386704 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.386691 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 19:03:49.386784 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.386771 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 19:03:49.388012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.387996 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:49.388611 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.388585 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 19:03:49.388739 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.388614 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 19:03:49.388781 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.388748 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 19:03:49.388781 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.388755 2573 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 19:03:49.388781 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.388762 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:49.389696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.389685 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:49.391106 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.391096 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:49.391361 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.391351 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 19:03:49.393765 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.393752 2573 kubelet.go:491] "Attempting to sync node with API server" Jun 02 19:03:49.393765 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.393765 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 19:03:49.393931 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.393777 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 19:03:49.393931 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.393786 2573 kubelet.go:397] "Adding apiserver pod source" Jun 02 19:03:49.393931 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.393795 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 19:03:49.395022 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.395010 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:49.395078 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.395042 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:49.399620 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.399600 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 19:03:49.401479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.401463 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 19:03:49.403427 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403405 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403434 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403446 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403454 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403468 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403479 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403489 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 19:03:49.403509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403498 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 19:03:49.403814 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403515 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 19:03:49.403814 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403525 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 19:03:49.403814 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403544 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 19:03:49.403814 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.403554 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 19:03:49.404475 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.404454 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 19:03:49.404531 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.404485 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 19:03:49.405973 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.405948 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 19:03:49.406527 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.406506 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 19:03:49.407464 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.407442 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 19:03:49.408182 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.408165 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 19:03:49.408250 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.408229 2573 server.go:1295] "Started kubelet" Jun 02 19:03:49.408339 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.408290 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 19:03:49.408445 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.408320 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 19:03:49.408445 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.408384 2573 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 19:03:49.409012 ip-10-0-137-73 systemd[1]: Started Kubernetes Kubelet. Jun 02 19:03:49.410147 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.410136 2573 server.go:317] "Adding debug handlers to kubelet server" Jun 02 19:03:49.411955 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.411938 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 19:03:49.415071 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.415054 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-22jh9" Jun 02 19:03:49.415415 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.415395 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 19:03:49.415666 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.415648 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:49.416137 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.416114 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 19:03:49.416242 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.416224 2573 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 19:03:49.416300 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.416243 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 19:03:49.416416 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.416386 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 19:03:49.416505 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.416431 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 02 19:03:49.416505 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.416443 2573 reconciler.go:26] "Reconciler: start to sync state" Jun 02 19:03:49.416673 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.415540 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-73.ec2.internal.18b558f33c60e92c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-73.ec2.internal,UID:ip-10-0-137-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-73.ec2.internal,},FirstTimestamp:2026-06-02 19:03:49.408180524 +0000 UTC m=+0.408042076,LastTimestamp:2026-06-02 19:03:49.408180524 +0000 UTC m=+0.408042076,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-73.ec2.internal,}" Jun 02 19:03:49.416873 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.416849 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.418166 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418150 2573 factory.go:55] Registering systemd factory Jun 02 19:03:49.418345 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418324 2573 factory.go:223] Registration of the systemd container factory successfully Jun 02 19:03:49.418613 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418577 2573 factory.go:153] Registering CRI-O factory Jun 02 19:03:49.418613 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418608 2573 factory.go:223] Registration of the crio container factory successfully Jun 02 19:03:49.418728 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418660 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 19:03:49.418728 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418679 2573 factory.go:103] Registering Raw factory Jun 02 19:03:49.418728 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.418694 2573 manager.go:1196] Started watching for new ooms in manager Jun 02 19:03:49.419168 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.419153 2573 manager.go:319] Starting recovery of all containers Jun 02 19:03:49.423886 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.423856 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 19:03:49.423968 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.423919 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 19:03:49.425104 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.424932 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-22jh9" Jun 02 19:03:49.430244 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.430222 2573 manager.go:324] Recovery completed Jun 02 19:03:49.434544 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.434532 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:49.436454 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.436438 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:49.436512 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.436467 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:49.436512 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.436482 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:49.436951 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.436937 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 19:03:49.437044 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.436952 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 19:03:49.437044 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.436971 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:49.437828 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.437769 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-73.ec2.internal.18b558f33e10502c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-73.ec2.internal,UID:ip-10-0-137-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-73.ec2.internal,},FirstTimestamp:2026-06-02 19:03:49.436452908 +0000 UTC m=+0.436314459,LastTimestamp:2026-06-02 19:03:49.436452908 +0000 UTC m=+0.436314459,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-73.ec2.internal,}" Jun 02 19:03:49.439268 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.439254 2573 policy_none.go:49] "None policy: Start" Jun 02 19:03:49.439332 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.439273 2573 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 19:03:49.439332 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.439286 2573 state_mem.go:35] "Initializing new in-memory state store" Jun 02 19:03:49.474617 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474603 2573 manager.go:341] "Starting Device Plugin manager" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.474634 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474644 2573 server.go:85] "Starting device plugin registration server" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474819 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474834 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474888 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474959 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.474967 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.475491 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 19:03:49.481830 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.475522 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.544302 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.544269 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 19:03:49.545509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.545491 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 19:03:49.545618 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.545516 2573 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 19:03:49.545618 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.545536 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 19:03:49.545618 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.545546 2573 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 19:03:49.545618 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.545593 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 19:03:49.548063 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.548025 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:49.575254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.575204 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:49.575982 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.575963 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:49.576081 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.575993 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:49.576081 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.576007 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:49.576081 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.576048 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.584436 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.584423 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.584490 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.584442 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-73.ec2.internal\": node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.599374 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.599351 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.646249 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.646227 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal"] Jun 02 19:03:49.646326 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.646290 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:49.647390 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.647371 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:49.647491 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.647400 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:49.647491 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.647413 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:49.648649 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.648633 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:49.648791 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.648777 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.648838 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.648809 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:49.649553 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.649516 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:49.649553 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.649542 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:49.649553 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.649557 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:49.649727 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.649664 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:49.649774 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.649727 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:49.649774 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.649752 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:49.651050 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.651008 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.651143 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.651055 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:49.651949 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.651933 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:49.652058 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.651966 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:49.652058 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.651981 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:49.675649 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.675627 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-73.ec2.internal\" not found" node="ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.680105 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.680087 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-73.ec2.internal\" not found" node="ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.699781 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.699759 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.718165 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.718139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58b99eb0ae6d20e6e97c403d6979ad7a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal\" (UID: \"58b99eb0ae6d20e6e97c403d6979ad7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.718251 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.718166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58b99eb0ae6d20e6e97c403d6979ad7a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal\" (UID: \"58b99eb0ae6d20e6e97c403d6979ad7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.718251 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.718188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec4997182c29a400e7055ab03e8070cb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-73.ec2.internal\" (UID: \"ec4997182c29a400e7055ab03e8070cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.800060 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.800020 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.818293 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.818272 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58b99eb0ae6d20e6e97c403d6979ad7a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal\" (UID: \"58b99eb0ae6d20e6e97c403d6979ad7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.818391 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.818304 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58b99eb0ae6d20e6e97c403d6979ad7a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal\" (UID: \"58b99eb0ae6d20e6e97c403d6979ad7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.818391 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.818339 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec4997182c29a400e7055ab03e8070cb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-73.ec2.internal\" (UID: \"ec4997182c29a400e7055ab03e8070cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.818391 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.818377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58b99eb0ae6d20e6e97c403d6979ad7a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal\" (UID: \"58b99eb0ae6d20e6e97c403d6979ad7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.818504 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.818379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58b99eb0ae6d20e6e97c403d6979ad7a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal\" (UID: \"58b99eb0ae6d20e6e97c403d6979ad7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.818504 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.818379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec4997182c29a400e7055ab03e8070cb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-73.ec2.internal\" (UID: \"ec4997182c29a400e7055ab03e8070cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.900748 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:49.900674 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:49.978180 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.978143 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:49.983675 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:49.983657 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" Jun 02 19:03:50.001816 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.001791 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.102374 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.102323 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.202867 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.202786 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.303310 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.303279 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.328736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.328710 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 19:03:50.329280 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.328859 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:03:50.360084 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.360063 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:50.403650 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.403620 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.415853 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.415830 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:50.427336 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.427307 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:58:49 +0000 UTC" deadline="2028-01-07 01:11:52.187759194 +0000 UTC" Jun 02 19:03:50.427336 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.427331 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13998h8m1.760430685s" Jun 02 19:03:50.430303 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.430286 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:50.447667 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:50.447633 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4997182c29a400e7055ab03e8070cb.slice/crio-2e1dafe10c4219a74c6cf4c7e453cfbb3df8799e0d3e0ec474ad7b44d00f24ec WatchSource:0}: Error finding container 2e1dafe10c4219a74c6cf4c7e453cfbb3df8799e0d3e0ec474ad7b44d00f24ec: Status 404 returned error can't find the container with id 2e1dafe10c4219a74c6cf4c7e453cfbb3df8799e0d3e0ec474ad7b44d00f24ec Jun 02 19:03:50.447850 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:50.447837 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b99eb0ae6d20e6e97c403d6979ad7a.slice/crio-cb6db52a56675f64886c40649a3a399872c16ac7d7229bf912edb25471c5f523 WatchSource:0}: Error finding container cb6db52a56675f64886c40649a3a399872c16ac7d7229bf912edb25471c5f523: Status 404 returned error can't find the container with id cb6db52a56675f64886c40649a3a399872c16ac7d7229bf912edb25471c5f523 Jun 02 19:03:50.451915 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.451901 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:03:50.472619 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.472602 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xtp9w" Jun 02 19:03:50.480661 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.480646 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xtp9w" Jun 02 19:03:50.504090 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.504066 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.548221 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.548174 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" event={"ID":"ec4997182c29a400e7055ab03e8070cb","Type":"ContainerStarted","Data":"2e1dafe10c4219a74c6cf4c7e453cfbb3df8799e0d3e0ec474ad7b44d00f24ec"} Jun 02 19:03:50.549073 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.549046 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" event={"ID":"58b99eb0ae6d20e6e97c403d6979ad7a","Type":"ContainerStarted","Data":"cb6db52a56675f64886c40649a3a399872c16ac7d7229bf912edb25471c5f523"} Jun 02 19:03:50.604178 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.604147 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.704665 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:50.704636 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-73.ec2.internal\" not found" Jun 02 19:03:50.709191 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.709140 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:50.717120 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.717093 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" Jun 02 19:03:50.731519 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.731497 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:50.732386 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.732375 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" Jun 02 19:03:50.741238 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.741223 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:50.954257 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:50.954227 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:51.309898 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.309864 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:51.394412 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.394383 2573 apiserver.go:52] "Watching apiserver" Jun 02 19:03:51.404717 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.404688 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 19:03:51.405064 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.405037 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-s7kb5","openshift-network-operator/iptables-alerter-8rhz2","openshift-ovn-kubernetes/ovnkube-node-7fcbq","kube-system/global-pull-secret-syncer-tvgqr","kube-system/konnectivity-agent-zd5pn","kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t","openshift-dns/node-resolver-gbrrp","openshift-multus/network-metrics-daemon-nm8gp","openshift-network-diagnostics/network-check-target-nj6md","openshift-cluster-node-tuning-operator/tuned-8w9g7","openshift-image-registry/node-ca-v2h7m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-xwkw6"] Jun 02 19:03:51.407412 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.407388 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:51.407520 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.407488 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:03:51.407591 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.407540 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.408679 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.408633 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.409582 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.409564 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.409938 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.409831 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.410047 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.409948 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.410306 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.410287 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gx4jp\"" Jun 02 19:03:51.410898 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.410876 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.410898 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.410890 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tsxxb\"" Jun 02 19:03:51.411084 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.411069 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 19:03:51.411256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.411239 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 19:03:51.411470 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.411452 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.412237 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.412216 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.412902 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.412881 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 19:03:51.412902 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.412899 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 19:03:51.413057 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.413020 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.413208 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.413190 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rmtdt\"" Jun 02 19:03:51.413278 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.413228 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 19:03:51.413278 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.413233 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.414995 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.413598 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 19:03:51.414995 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.413843 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 19:03:51.414995 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.414221 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.414995 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.414582 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:51.414995 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.414661 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:03:51.415278 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.415117 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 19:03:51.415278 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.415222 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lw2pg\"" Jun 02 19:03:51.415703 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.415685 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x2nh6\"" Jun 02 19:03:51.415703 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.415694 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 19:03:51.415804 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.415715 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.416016 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.415888 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.416746 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.416451 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.419060 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.419020 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.419195 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.419072 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.419259 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.419023 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.419259 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.419240 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 19:03:51.419519 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.419501 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rn5j8\"" Jun 02 19:03:51.420395 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.420372 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.421577 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.421557 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.421665 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.421630 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d5km9\"" Jun 02 19:03:51.421665 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.421647 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.421770 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.421683 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.422061 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.422011 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 19:03:51.422568 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.422549 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 19:03:51.422660 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.422604 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vd2ql\"" Jun 02 19:03:51.422856 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.422840 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.422932 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.422898 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:03:51.424024 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.424000 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 19:03:51.424142 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.424049 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cksjb\"" Jun 02 19:03:51.424364 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.424320 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 19:03:51.424428 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.424413 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 19:03:51.427325 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovnkube-script-lib\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427403 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427341 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfn5\" (UniqueName: \"kubernetes.io/projected/e67768a2-71bc-44ab-ab45-158931289d05-kube-api-access-ggfn5\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.427403 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-env-overrides\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427403 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01635513-e06f-40f4-8aa3-2a9a6c23fff4-host\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.427547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-hosts-file\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.427547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427442 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.427547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-run\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.427547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysctl-conf\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.427547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427511 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fp6z\" (UniqueName: \"kubernetes.io/projected/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-kube-api-access-9fp6z\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-systemd-units\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovnkube-config\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovn-node-metrics-cert\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-systemd\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427655 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-cni-bin\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysctl-d\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-var-lib-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2rr\" (UniqueName: \"kubernetes.io/projected/abe39f38-b20f-4545-85e5-cc00b8ec93e5-kube-api-access-gk2rr\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.427777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e67768a2-71bc-44ab-ab45-158931289d05-host-slash\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-tmp-dir\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-modprobe-d\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-ovn\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-tuned\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-node-log\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.427987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-log-socket\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428002 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e67768a2-71bc-44ab-ab45-158931289d05-iptables-alerter-script\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428016 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-os-release\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-cni-netd\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428091 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-system-cni-dir\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.428160 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-sys\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-systemd\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dxv\" (UniqueName: \"kubernetes.io/projected/01635513-e06f-40f4-8aa3-2a9a6c23fff4-kube-api-access-v4dxv\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b4faecd-10a7-4109-9614-87361cb79dcc-konnectivity-ca\") pod \"konnectivity-agent-zd5pn\" (UID: \"5b4faecd-10a7-4109-9614-87361cb79dcc\") " pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysconfig\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf68l\" (UniqueName: \"kubernetes.io/projected/78c1a075-2206-4dcb-b82f-1d95027f29c7-kube-api-access-cf68l\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01635513-e06f-40f4-8aa3-2a9a6c23fff4-serviceca\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b4faecd-10a7-4109-9614-87361cb79dcc-agent-certs\") pod \"konnectivity-agent-zd5pn\" (UID: \"5b4faecd-10a7-4109-9614-87361cb79dcc\") " pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62qxz\" (UniqueName: \"kubernetes.io/projected/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-kube-api-access-62qxz\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-lib-modules\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428448 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-host\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-kubelet\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cnibin\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrfs2\" (UniqueName: \"kubernetes.io/projected/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-kube-api-access-jrfs2\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c1a075-2206-4dcb-b82f-1d95027f29c7-tmp\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.428826 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-run-netns\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.429368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-etc-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.429368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-kubernetes\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.429368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-slash\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.429368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.429368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:51.429368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.428761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-var-lib-kubelet\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.482238 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.482210 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:50 +0000 UTC" deadline="2028-01-07 19:12:36.420922535 +0000 UTC" Jun 02 19:03:51.482238 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.482237 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14016h8m44.938688611s" Jun 02 19:03:51.516981 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.516955 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 19:03:51.529417 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529391 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01635513-e06f-40f4-8aa3-2a9a6c23fff4-serviceca\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.529545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b4faecd-10a7-4109-9614-87361cb79dcc-agent-certs\") pod \"konnectivity-agent-zd5pn\" (UID: \"5b4faecd-10a7-4109-9614-87361cb79dcc\") " pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.529545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529465 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62qxz\" (UniqueName: \"kubernetes.io/projected/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-kube-api-access-62qxz\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:51.529545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529488 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-lib-modules\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.529545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529538 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-host\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529562 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-kubelet\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529584 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-host\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-kubelet\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529693 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cnibin\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.529718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-lib-modules\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529728 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrfs2\" (UniqueName: \"kubernetes.io/projected/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-kube-api-access-jrfs2\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529753 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c1a075-2206-4dcb-b82f-1d95027f29c7-tmp\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529779 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-run-netns\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cnibin\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529803 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-etc-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529810 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529828 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-kubernetes\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529836 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-etc-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-run-netns\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529853 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-slash\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-kubernetes\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529893 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01635513-e06f-40f4-8aa3-2a9a6c23fff4-serviceca\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529905 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-slash\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.529939 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:51.530012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530011 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-var-lib-kubelet\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530051 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovnkube-script-lib\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530076 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfn5\" (UniqueName: \"kubernetes.io/projected/e67768a2-71bc-44ab-ab45-158931289d05-kube-api-access-ggfn5\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-var-lib-kubelet\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6kt9\" (UniqueName: \"kubernetes.io/projected/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-kube-api-access-s6kt9\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.530101 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-socket-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-device-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530182 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-env-overrides\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530210 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01635513-e06f-40f4-8aa3-2a9a6c23fff4-host\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.530243 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:52.030209316 +0000 UTC m=+3.030070875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01635513-e06f-40f4-8aa3-2a9a6c23fff4-host\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-cni-bin\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-registration-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-dbus\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530362 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.530771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530399 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-hosts-file\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530425 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530451 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-run\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-kubelet\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530506 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysctl-conf\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530534 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-socket-dir-parent\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-etc-kubernetes\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530613 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fp6z\" (UniqueName: \"kubernetes.io/projected/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-kube-api-access-9fp6z\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovnkube-script-lib\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-env-overrides\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-systemd-units\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530678 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-systemd-units\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-run\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530815 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovnkube-config\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530880 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovn-node-metrics-cert\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.531563 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysctl-conf\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-cnibin\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wbp\" (UniqueName: \"kubernetes.io/projected/b3256579-e539-4a6d-8045-476f462c7984-kube-api-access-v5wbp\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530967 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-systemd\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-hosts-file\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.530992 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-cni-bin\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-system-cni-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-hostroot\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-sys-fs\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531142 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysctl-d\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531168 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-var-lib-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531194 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2rr\" (UniqueName: \"kubernetes.io/projected/abe39f38-b20f-4545-85e5-cc00b8ec93e5-kube-api-access-gk2rr\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531223 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e67768a2-71bc-44ab-ab45-158931289d05-host-slash\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-netns\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531323 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531349 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-tmp-dir\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.532347 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531378 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531388 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e67768a2-71bc-44ab-ab45-158931289d05-host-slash\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531407 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-modprobe-d\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531431 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-ovn\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovnkube-config\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-systemd\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531457 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-ovn\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531522 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-cni-bin\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-cni-binary-copy\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531596 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysctl-d\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531623 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-var-lib-openvswitch\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531647 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-tuned\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531668 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-node-log\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531726 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-log-socket\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531750 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e67768a2-71bc-44ab-ab45-158931289d05-iptables-alerter-script\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-daemon-config\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-kubelet-config\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531826 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-os-release\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531847 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-cni-netd\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-cni-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-multus-certs\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531982 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-system-cni-dir\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.531975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532012 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-sys\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532060 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-systemd\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532091 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dxv\" (UniqueName: \"kubernetes.io/projected/01635513-e06f-40f4-8aa3-2a9a6c23fff4-kube-api-access-v4dxv\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-modprobe-d\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-k8s-cni-cncf-io\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532153 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b4faecd-10a7-4109-9614-87361cb79dcc-konnectivity-ca\") pod \"konnectivity-agent-zd5pn\" (UID: \"5b4faecd-10a7-4109-9614-87361cb79dcc\") " pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-tmp-dir\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.533909 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-node-log\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-cni-multus\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysconfig\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532476 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf68l\" (UniqueName: \"kubernetes.io/projected/78c1a075-2206-4dcb-b82f-1d95027f29c7-kube-api-access-cf68l\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-os-release\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-conf-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b4faecd-10a7-4109-9614-87361cb79dcc-konnectivity-ca\") pod \"konnectivity-agent-zd5pn\" (UID: \"5b4faecd-10a7-4109-9614-87361cb79dcc\") " pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-sysconfig\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-log-socket\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532852 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-os-release\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-run-systemd\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.532977 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-system-cni-dir\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.533093 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e67768a2-71bc-44ab-ab45-158931289d05-iptables-alerter-script\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.533159 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78c1a075-2206-4dcb-b82f-1d95027f29c7-sys\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.533176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c1a075-2206-4dcb-b82f-1d95027f29c7-tmp\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.533168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/abe39f38-b20f-4545-85e5-cc00b8ec93e5-host-cni-netd\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.534509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.533332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b4faecd-10a7-4109-9614-87361cb79dcc-agent-certs\") pod \"konnectivity-agent-zd5pn\" (UID: \"5b4faecd-10a7-4109-9614-87361cb79dcc\") " pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.535207 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.533589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/abe39f38-b20f-4545-85e5-cc00b8ec93e5-ovn-node-metrics-cert\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.535252 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.535217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78c1a075-2206-4dcb-b82f-1d95027f29c7-etc-tuned\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.541735 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.541702 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:51.541735 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.541726 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:51.541735 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.541740 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:51.541948 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.541811 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:52.041792263 +0000 UTC m=+3.041653807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:51.542893 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.542872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2rr\" (UniqueName: \"kubernetes.io/projected/abe39f38-b20f-4545-85e5-cc00b8ec93e5-kube-api-access-gk2rr\") pod \"ovnkube-node-7fcbq\" (UID: \"abe39f38-b20f-4545-85e5-cc00b8ec93e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.543223 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.543201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrfs2\" (UniqueName: \"kubernetes.io/projected/2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2-kube-api-access-jrfs2\") pod \"multus-additional-cni-plugins-xwkw6\" (UID: \"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2\") " pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.543395 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.543362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfn5\" (UniqueName: \"kubernetes.io/projected/e67768a2-71bc-44ab-ab45-158931289d05-kube-api-access-ggfn5\") pod \"iptables-alerter-8rhz2\" (UID: \"e67768a2-71bc-44ab-ab45-158931289d05\") " pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.543968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.543950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fp6z\" (UniqueName: \"kubernetes.io/projected/e979a935-06cf-4c6d-8ce9-a1fa2501ced1-kube-api-access-9fp6z\") pod \"node-resolver-gbrrp\" (UID: \"e979a935-06cf-4c6d-8ce9-a1fa2501ced1\") " pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.544876 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.544829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62qxz\" (UniqueName: \"kubernetes.io/projected/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-kube-api-access-62qxz\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:51.545745 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.545706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf68l\" (UniqueName: \"kubernetes.io/projected/78c1a075-2206-4dcb-b82f-1d95027f29c7-kube-api-access-cf68l\") pod \"tuned-8w9g7\" (UID: \"78c1a075-2206-4dcb-b82f-1d95027f29c7\") " pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.546200 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.546183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dxv\" (UniqueName: \"kubernetes.io/projected/01635513-e06f-40f4-8aa3-2a9a6c23fff4-kube-api-access-v4dxv\") pod \"node-ca-v2h7m\" (UID: \"01635513-e06f-40f4-8aa3-2a9a6c23fff4\") " pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.633547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633467 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-os-release\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633497 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-conf-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633547 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633545 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6kt9\" (UniqueName: \"kubernetes.io/projected/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-kube-api-access-s6kt9\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633562 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-socket-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-os-release\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-conf-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633660 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-device-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-socket-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633701 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-cni-bin\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-device-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633720 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-registration-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633737 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-dbus\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633758 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633784 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-kubelet\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-registration-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633812 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-socket-dir-parent\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633837 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-etc-kubernetes\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.633824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-cni-bin\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633863 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-dbus\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633871 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-kubelet\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633865 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-cnibin\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-etc-kubernetes\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633900 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-socket-dir-parent\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.633924 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633934 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wbp\" (UniqueName: \"kubernetes.io/projected/b3256579-e539-4a6d-8045-476f462c7984-kube-api-access-v5wbp\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633958 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-system-cni-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.633972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-cnibin\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:51.633991 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:03:52.133969191 +0000 UTC m=+3.133830733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634013 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-hostroot\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-system-cni-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-hostroot\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634060 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-sys-fs\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634092 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-netns\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634134 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-cni-binary-copy\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634146 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-sys-fs\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.634546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-netns\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634164 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-daemon-config\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634191 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-kubelet-config\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634218 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-cni-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634244 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-multus-certs\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-kubelet-config\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634268 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634295 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-k8s-cni-cncf-io\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-cni-dir\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-multus-certs\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634321 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-cni-multus\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-run-k8s-cni-cncf-io\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3256579-e539-4a6d-8045-476f462c7984-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-host-var-lib-cni-multus\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.634744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-cni-binary-copy\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.635211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.635015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-multus-daemon-config\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.642230 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.642209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6kt9\" (UniqueName: \"kubernetes.io/projected/536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269-kube-api-access-s6kt9\") pod \"multus-s7kb5\" (UID: \"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269\") " pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.642443 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.642422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wbp\" (UniqueName: \"kubernetes.io/projected/b3256579-e539-4a6d-8045-476f462c7984-kube-api-access-v5wbp\") pod \"aws-ebs-csi-driver-node-gqp8t\" (UID: \"b3256579-e539-4a6d-8045-476f462c7984\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:51.722419 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.722383 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" Jun 02 19:03:51.727417 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.727391 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:03:51.735089 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.735068 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" Jun 02 19:03:51.741862 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.741841 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:03:51.747561 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.747540 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gbrrp" Jun 02 19:03:51.754054 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.754025 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2h7m" Jun 02 19:03:51.760525 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.760505 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rhz2" Jun 02 19:03:51.766987 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.766967 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7kb5" Jun 02 19:03:51.772517 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:51.772503 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" Jun 02 19:03:52.038257 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.038168 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:52.038420 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.038323 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:52.038420 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.038396 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:53.03837483 +0000 UTC m=+4.038236369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:52.119400 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.119367 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c1a075_2206_4dcb_b82f_1d95027f29c7.slice/crio-7b06537dd320749aeb59d7af239d65d0558a15c974f2c7fa8018d42cb0a5185a WatchSource:0}: Error finding container 7b06537dd320749aeb59d7af239d65d0558a15c974f2c7fa8018d42cb0a5185a: Status 404 returned error can't find the container with id 7b06537dd320749aeb59d7af239d65d0558a15c974f2c7fa8018d42cb0a5185a Jun 02 19:03:52.120831 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.120806 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01635513_e06f_40f4_8aa3_2a9a6c23fff4.slice/crio-477a0e5735026d1305c6378f82409bb9fbb53a5b305263f4640f916f628a1e2b WatchSource:0}: Error finding container 477a0e5735026d1305c6378f82409bb9fbb53a5b305263f4640f916f628a1e2b: Status 404 returned error can't find the container with id 477a0e5735026d1305c6378f82409bb9fbb53a5b305263f4640f916f628a1e2b Jun 02 19:03:52.121780 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.121664 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode979a935_06cf_4c6d_8ce9_a1fa2501ced1.slice/crio-6d8e695bf84ae6edbf6be5af89ae0932b67855a8f419c8edcde1528551f7de44 WatchSource:0}: Error finding container 6d8e695bf84ae6edbf6be5af89ae0932b67855a8f419c8edcde1528551f7de44: Status 404 returned error can't find the container with id 6d8e695bf84ae6edbf6be5af89ae0932b67855a8f419c8edcde1528551f7de44 Jun 02 19:03:52.124915 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.124896 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4faecd_10a7_4109_9614_87361cb79dcc.slice/crio-933eb94617dceddb12c027fabae0ef259a620f4e4ff5227d1f5a9f31ecb051f6 WatchSource:0}: Error finding container 933eb94617dceddb12c027fabae0ef259a620f4e4ff5227d1f5a9f31ecb051f6: Status 404 returned error can't find the container with id 933eb94617dceddb12c027fabae0ef259a620f4e4ff5227d1f5a9f31ecb051f6 Jun 02 19:03:52.126615 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.126595 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2711a2b7_08aa_4f2c_89ad_1a44aae1e9d2.slice/crio-d4b1c26e5121099912b8ae1f2661370f0e2c5b03e42b0fb2bc2271d4597ec768 WatchSource:0}: Error finding container d4b1c26e5121099912b8ae1f2661370f0e2c5b03e42b0fb2bc2271d4597ec768: Status 404 returned error can't find the container with id d4b1c26e5121099912b8ae1f2661370f0e2c5b03e42b0fb2bc2271d4597ec768 Jun 02 19:03:52.127415 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.127383 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe39f38_b20f_4545_85e5_cc00b8ec93e5.slice/crio-6de87f68ffd34d11663c6dcdcdc1340b328797359086aa222325375421ec350d WatchSource:0}: Error finding container 6de87f68ffd34d11663c6dcdcdc1340b328797359086aa222325375421ec350d: Status 404 returned error can't find the container with id 6de87f68ffd34d11663c6dcdcdc1340b328797359086aa222325375421ec350d Jun 02 19:03:52.128280 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.128248 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536b0d77_bc3b_4ce3_9dc4_fa3c3ce96269.slice/crio-45e505cdbef7f1f07e08d97c7ae274bb396f6f8bf1c24eea0401e82b05827a3b WatchSource:0}: Error finding container 45e505cdbef7f1f07e08d97c7ae274bb396f6f8bf1c24eea0401e82b05827a3b: Status 404 returned error can't find the container with id 45e505cdbef7f1f07e08d97c7ae274bb396f6f8bf1c24eea0401e82b05827a3b Jun 02 19:03:52.131094 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.130955 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3256579_e539_4a6d_8045_476f462c7984.slice/crio-a82491fcf26cfdf3a56a4b1d32b9f816ad47ee91b829cfc80b920c90f4067960 WatchSource:0}: Error finding container a82491fcf26cfdf3a56a4b1d32b9f816ad47ee91b829cfc80b920c90f4067960: Status 404 returned error can't find the container with id a82491fcf26cfdf3a56a4b1d32b9f816ad47ee91b829cfc80b920c90f4067960 Jun 02 19:03:52.131743 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:03:52.131725 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67768a2_71bc_44ab_ab45_158931289d05.slice/crio-516eb3b6868847e0de7f062b2c749af177dc17a918b259efbb4b85505e82eeb9 WatchSource:0}: Error finding container 516eb3b6868847e0de7f062b2c749af177dc17a918b259efbb4b85505e82eeb9: Status 404 returned error can't find the container with id 516eb3b6868847e0de7f062b2c749af177dc17a918b259efbb4b85505e82eeb9 Jun 02 19:03:52.138573 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.138505 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:52.138573 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.138560 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:52.138690 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.138657 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:52.138690 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.138667 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:52.138828 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.138697 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:52.138828 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.138708 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:03:53.138689315 +0000 UTC m=+4.138550857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:52.138828 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.138709 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:52.138828 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.138747 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:53.13874035 +0000 UTC m=+4.138601888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:52.483381 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.483338 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:50 +0000 UTC" deadline="2027-12-11 05:33:15.115221877 +0000 UTC" Jun 02 19:03:52.483381 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.483373 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13354h29m22.631852578s" Jun 02 19:03:52.546523 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.546495 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:52.546658 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:52.546615 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:03:52.557056 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.556830 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" event={"ID":"ec4997182c29a400e7055ab03e8070cb","Type":"ContainerStarted","Data":"e781cb128d65c2f157d1092e6f532755d18944708eb742813f2dd0aa1f1d76dd"} Jun 02 19:03:52.561629 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.561088 2573 generic.go:358] "Generic (PLEG): container finished" podID="58b99eb0ae6d20e6e97c403d6979ad7a" containerID="8a25205a79a12baad1ef42ec1dcedacb5a340b41331392f59a4829876922ca25" exitCode=0 Jun 02 19:03:52.561629 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.561157 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" event={"ID":"58b99eb0ae6d20e6e97c403d6979ad7a","Type":"ContainerDied","Data":"8a25205a79a12baad1ef42ec1dcedacb5a340b41331392f59a4829876922ca25"} Jun 02 19:03:52.564207 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.564157 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rhz2" event={"ID":"e67768a2-71bc-44ab-ab45-158931289d05","Type":"ContainerStarted","Data":"516eb3b6868847e0de7f062b2c749af177dc17a918b259efbb4b85505e82eeb9"} Jun 02 19:03:52.566049 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.566008 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"6de87f68ffd34d11663c6dcdcdc1340b328797359086aa222325375421ec350d"} Jun 02 19:03:52.567702 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.567678 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerStarted","Data":"d4b1c26e5121099912b8ae1f2661370f0e2c5b03e42b0fb2bc2271d4597ec768"} Jun 02 19:03:52.569238 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.569215 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gbrrp" event={"ID":"e979a935-06cf-4c6d-8ce9-a1fa2501ced1","Type":"ContainerStarted","Data":"6d8e695bf84ae6edbf6be5af89ae0932b67855a8f419c8edcde1528551f7de44"} Jun 02 19:03:52.570559 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.570536 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" event={"ID":"78c1a075-2206-4dcb-b82f-1d95027f29c7","Type":"ContainerStarted","Data":"7b06537dd320749aeb59d7af239d65d0558a15c974f2c7fa8018d42cb0a5185a"} Jun 02 19:03:52.571848 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.571791 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-73.ec2.internal" podStartSLOduration=2.571777671 podStartE2EDuration="2.571777671s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:52.571534117 +0000 UTC m=+3.571395681" watchObservedRunningTime="2026-06-02 19:03:52.571777671 +0000 UTC m=+3.571639232" Jun 02 19:03:52.572363 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.572327 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" event={"ID":"b3256579-e539-4a6d-8045-476f462c7984","Type":"ContainerStarted","Data":"a82491fcf26cfdf3a56a4b1d32b9f816ad47ee91b829cfc80b920c90f4067960"} Jun 02 19:03:52.574157 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.574135 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7kb5" event={"ID":"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269","Type":"ContainerStarted","Data":"45e505cdbef7f1f07e08d97c7ae274bb396f6f8bf1c24eea0401e82b05827a3b"} Jun 02 19:03:52.575312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.575291 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zd5pn" event={"ID":"5b4faecd-10a7-4109-9614-87361cb79dcc","Type":"ContainerStarted","Data":"933eb94617dceddb12c027fabae0ef259a620f4e4ff5227d1f5a9f31ecb051f6"} Jun 02 19:03:52.582231 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:52.582207 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2h7m" event={"ID":"01635513-e06f-40f4-8aa3-2a9a6c23fff4","Type":"ContainerStarted","Data":"477a0e5735026d1305c6378f82409bb9fbb53a5b305263f4640f916f628a1e2b"} Jun 02 19:03:53.045769 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:53.045730 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:53.045945 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.045928 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:53.046008 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.045996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.045977831 +0000 UTC m=+6.045839383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:53.146409 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:53.146273 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:53.146409 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:53.146331 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:53.146628 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.146473 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:53.146628 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.146489 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:53.146628 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.146501 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:53.146628 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.146556 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.146537952 +0000 UTC m=+6.146399512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:53.146628 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.146626 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:53.146885 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.146660 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.146649517 +0000 UTC m=+6.146511057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:53.547855 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:53.547824 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:53.548330 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.547929 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:03:53.548330 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:53.548152 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:53.548330 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:53.548238 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:03:53.600974 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:53.600919 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" event={"ID":"58b99eb0ae6d20e6e97c403d6979ad7a","Type":"ContainerStarted","Data":"b8b247938a960dc9b206931cb34063ba5f76be0961f9ba92ac6f7f174150d335"} Jun 02 19:03:54.546760 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:54.546721 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:54.546946 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:54.546860 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:03:55.061859 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:55.061819 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:55.062341 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.061988 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:55.062341 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.062065 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:59.062047353 +0000 UTC m=+10.061908915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:55.162287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:55.162250 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:55.162517 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:55.162315 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:55.162517 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.162489 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:55.162517 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.162510 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:55.162691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.162523 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:55.162691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.162609 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:59.162563285 +0000 UTC m=+10.162424841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:55.163087 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.163061 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:55.163184 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.163118 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:03:59.163103521 +0000 UTC m=+10.162965059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:55.547280 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:55.547204 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:55.547438 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.547335 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:03:55.547679 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:55.547204 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:55.547801 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:55.547779 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:03:56.545752 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:56.545717 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:56.546236 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:56.545831 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:03:57.546145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:57.546107 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:57.546569 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:57.546116 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:57.546569 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:57.546266 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:03:57.546569 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:57.546315 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:03:58.546188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:58.546153 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:58.546575 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:58.546282 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:03:59.099220 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:59.099181 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:59.099401 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.099384 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:59.099459 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.099451 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:07.099432869 +0000 UTC m=+18.099294413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:59.200162 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:59.200120 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:59.200333 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:59.200191 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:03:59.200333 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.200284 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:59.200437 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.200356 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:04:07.200334971 +0000 UTC m=+18.200196510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:03:59.200437 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.200371 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:59.200437 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.200391 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:59.200437 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.200403 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:59.200616 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.200451 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:07.200436578 +0000 UTC m=+18.200298133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:59.549416 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:59.549347 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:03:59.549807 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:03:59.549347 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:03:59.549807 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.549477 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:03:59.549807 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:03:59.549521 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:00.546524 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:00.546488 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:00.546683 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:00.546621 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:01.546874 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:01.546341 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:01.546874 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:01.546468 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:01.546874 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:01.546794 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:01.547409 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:01.546892 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:02.546275 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:02.546227 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:02.546454 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:02.546343 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:03.546765 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:03.546729 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:03.547249 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:03.546854 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:03.547249 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:03.546887 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:03.547249 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:03.546961 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:04.546048 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:04.546008 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:04.546221 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:04.546142 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:05.546370 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:05.546330 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:05.546856 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:05.546388 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:05.546856 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:05.546481 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:05.546856 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:05.546622 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:06.546254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:06.546222 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:06.546438 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:06.546343 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:07.161873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:07.161828 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:07.162065 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.161982 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:07.162121 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.162069 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:23.16204902 +0000 UTC m=+34.161910563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:07.262476 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:07.262436 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:07.262643 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:07.262504 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:07.262643 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.262619 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:04:07.262723 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.262661 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:04:07.262723 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.262676 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:04:07.262723 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.262683 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:04:23.26266747 +0000 UTC m=+34.262529015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:04:07.262723 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.262688 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:07.262874 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.262736 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:23.262721519 +0000 UTC m=+34.262583062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:07.546654 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:07.546576 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:07.547098 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:07.546573 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:07.547098 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.546711 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:07.547098 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:07.546783 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:08.546303 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:08.546272 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:08.546548 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:08.546432 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:09.547115 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:09.547080 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:09.547544 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:09.547187 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:09.547544 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:09.547261 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:09.547544 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:09.547341 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:10.546014 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.545821 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:10.546142 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:10.546104 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:10.631988 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.631969 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:04:10.632543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.632291 2573 generic.go:358] "Generic (PLEG): container finished" podID="abe39f38-b20f-4545-85e5-cc00b8ec93e5" containerID="aa3c3ce53d4538498fe256bce00b323c9dbe577061a18baa8984d041f4dd7160" exitCode=1 Jun 02 19:04:10.632543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.632353 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"6f727fe00424904699cbb2b53d7db449f490171fd88d33a3aa0b723276acd817"} Jun 02 19:04:10.632543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.632377 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"b97f26272b42fbf276bfa85a466d635417d70bab203f97edaa5c1eaa83435e94"} Jun 02 19:04:10.632543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.632388 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerDied","Data":"aa3c3ce53d4538498fe256bce00b323c9dbe577061a18baa8984d041f4dd7160"} Jun 02 19:04:10.632543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.632400 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"ea8c18cb7a557529c3e65890b5fd2c5e2b4b936eea7dcefe4b308189ad137665"} Jun 02 19:04:10.633648 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.633622 2573 generic.go:358] "Generic (PLEG): container finished" podID="2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2" containerID="cd7ddbc9643b14e561ca8701ee8f53fd933dba321f770654161c12167fc5ebe5" exitCode=0 Jun 02 19:04:10.633738 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.633703 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerDied","Data":"cd7ddbc9643b14e561ca8701ee8f53fd933dba321f770654161c12167fc5ebe5"} Jun 02 19:04:10.635154 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.635043 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gbrrp" event={"ID":"e979a935-06cf-4c6d-8ce9-a1fa2501ced1","Type":"ContainerStarted","Data":"cd6a775643e1fb87e18da601f87079488eb4c4d90cdeba397e1187146866a86d"} Jun 02 19:04:10.636487 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.636331 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" event={"ID":"78c1a075-2206-4dcb-b82f-1d95027f29c7","Type":"ContainerStarted","Data":"d74888697a744d0ef5341693307dc106e1350862ebda68261c3a2befb5c372c5"} Jun 02 19:04:10.637567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.637537 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" event={"ID":"b3256579-e539-4a6d-8045-476f462c7984","Type":"ContainerStarted","Data":"5a0f5a37332b7689ddd325c37e4c313db53596c40f4adafa259ca1dc349dcf2a"} Jun 02 19:04:10.639175 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.639146 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7kb5" event={"ID":"536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269","Type":"ContainerStarted","Data":"fb24ffa0d98a759625f22f7a03a127e39b571c607ec0d24c3bd229d26e2c6266"} Jun 02 19:04:10.640486 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.640467 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zd5pn" event={"ID":"5b4faecd-10a7-4109-9614-87361cb79dcc","Type":"ContainerStarted","Data":"23d052c9e958a444c1d37d97d08e8c6a1e044a2a3ef05f2c115491e03f941d82"} Jun 02 19:04:10.641674 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.641651 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2h7m" event={"ID":"01635513-e06f-40f4-8aa3-2a9a6c23fff4","Type":"ContainerStarted","Data":"6dab5f864b1118c2938483718d6927b2bdde852264001dd62b1d2bed6bb212cb"} Jun 02 19:04:10.661864 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.661826 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-73.ec2.internal" podStartSLOduration=20.661812986 podStartE2EDuration="20.661812986s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:53.622421476 +0000 UTC m=+4.622283037" watchObservedRunningTime="2026-06-02 19:04:10.661812986 +0000 UTC m=+21.661674548" Jun 02 19:04:10.681700 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.681668 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-s7kb5" podStartSLOduration=3.7708118859999997 podStartE2EDuration="21.681658703s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.13139459 +0000 UTC m=+3.131256129" lastFinishedPulling="2026-06-02 19:04:10.042241408 +0000 UTC m=+21.042102946" observedRunningTime="2026-06-02 19:04:10.681368852 +0000 UTC m=+21.681230409" watchObservedRunningTime="2026-06-02 19:04:10.681658703 +0000 UTC m=+21.681520264" Jun 02 19:04:10.699374 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.699338 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8w9g7" podStartSLOduration=3.815240361 podStartE2EDuration="21.699326583s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.121462295 +0000 UTC m=+3.121323848" lastFinishedPulling="2026-06-02 19:04:10.005548524 +0000 UTC m=+21.005410070" observedRunningTime="2026-06-02 19:04:10.699013031 +0000 UTC m=+21.698874602" watchObservedRunningTime="2026-06-02 19:04:10.699326583 +0000 UTC m=+21.699188147" Jun 02 19:04:10.716613 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.716586 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gbrrp" podStartSLOduration=3.8349849860000003 podStartE2EDuration="21.716576787s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.123812624 +0000 UTC m=+3.123674162" lastFinishedPulling="2026-06-02 19:04:10.005404409 +0000 UTC m=+21.005265963" observedRunningTime="2026-06-02 19:04:10.716443222 +0000 UTC m=+21.716304783" watchObservedRunningTime="2026-06-02 19:04:10.716576787 +0000 UTC m=+21.716438346" Jun 02 19:04:10.731621 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.731583 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zd5pn" podStartSLOduration=3.853860623 podStartE2EDuration="21.731570153s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.127683869 +0000 UTC m=+3.127545416" lastFinishedPulling="2026-06-02 19:04:10.005393393 +0000 UTC m=+21.005254946" observedRunningTime="2026-06-02 19:04:10.731551565 +0000 UTC m=+21.731413128" watchObservedRunningTime="2026-06-02 19:04:10.731570153 +0000 UTC m=+21.731431716" Jun 02 19:04:10.748411 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:10.748335 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v2h7m" podStartSLOduration=8.538606354 podStartE2EDuration="21.748324809s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.123813685 +0000 UTC m=+3.123675228" lastFinishedPulling="2026-06-02 19:04:05.333532128 +0000 UTC m=+16.333393683" observedRunningTime="2026-06-02 19:04:10.747848677 +0000 UTC m=+21.747710241" watchObservedRunningTime="2026-06-02 19:04:10.748324809 +0000 UTC m=+21.748186368" Jun 02 19:04:11.546816 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.546793 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:11.547006 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:11.546972 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:11.547104 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.547046 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:11.547185 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:11.547159 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:11.645275 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.645244 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rhz2" event={"ID":"e67768a2-71bc-44ab-ab45-158931289d05","Type":"ContainerStarted","Data":"90fba4d84b8c1716e792ed58cb358de10ee7d3c23dd86c56d937fe99997c695b"} Jun 02 19:04:11.647796 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.647779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:04:11.648219 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.648186 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"75a89f6617127f9012e5ac323a1125c40615dd5857d4e37698a73d724b1a41f9"} Jun 02 19:04:11.648330 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.648229 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"f31afa2ee5472e36e2ee9a9367eed978e4e4ce129b6a29b7ae3311f93401272b"} Jun 02 19:04:11.662345 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.662306 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8rhz2" podStartSLOduration=4.814028335 podStartE2EDuration="22.662291248s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.13486079 +0000 UTC m=+3.134722331" lastFinishedPulling="2026-06-02 19:04:09.983123699 +0000 UTC m=+20.982985244" observedRunningTime="2026-06-02 19:04:11.661659555 +0000 UTC m=+22.661521118" watchObservedRunningTime="2026-06-02 19:04:11.662291248 +0000 UTC m=+22.662152807" Jun 02 19:04:11.664647 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:11.664626 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 19:04:12.484485 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:12.484378 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T19:04:11.664642445Z","UUID":"c4e3d883-668b-4eca-8efe-8a352340c844","Handler":null,"Name":"","Endpoint":""} Jun 02 19:04:12.488102 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:12.488075 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 19:04:12.488245 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:12.488110 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 19:04:12.546548 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:12.546522 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:12.546695 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:12.546621 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:12.654147 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:12.654106 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" event={"ID":"b3256579-e539-4a6d-8045-476f462c7984","Type":"ContainerStarted","Data":"80c3481ed0700ea04513acd726d7e59eb6c622fe031c0c4234877e6132bc6622"} Jun 02 19:04:13.546319 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:13.546136 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:13.546461 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:13.546144 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:13.546461 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:13.546402 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:13.546585 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:13.546513 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:13.657497 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:13.657462 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" event={"ID":"b3256579-e539-4a6d-8045-476f462c7984","Type":"ContainerStarted","Data":"9996443ce2b00e8a318937f548fc14316c1468dcedb4f76e93383a3323c12783"} Jun 02 19:04:13.660797 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:13.660769 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:04:13.661377 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:13.661339 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"3a76d22e14c5876afb9060edc45cf15adc2587cf8db70b36237fb4fbf699da0c"} Jun 02 19:04:13.675074 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:13.675008 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqp8t" podStartSLOduration=3.822870064 podStartE2EDuration="24.674993709s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.135205255 +0000 UTC m=+3.135066793" lastFinishedPulling="2026-06-02 19:04:12.987328893 +0000 UTC m=+23.987190438" observedRunningTime="2026-06-02 19:04:13.674441105 +0000 UTC m=+24.674302666" watchObservedRunningTime="2026-06-02 19:04:13.674993709 +0000 UTC m=+24.674855270" Jun 02 19:04:14.546609 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:14.546570 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:14.546802 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:14.546677 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:15.345856 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:15.345822 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:04:15.346650 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:15.346618 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:04:15.545729 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:15.545696 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:15.545892 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:15.545755 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:15.545892 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:15.545860 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:15.546015 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:15.545966 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:15.665467 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:15.665429 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:04:15.666074 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:15.666058 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zd5pn" Jun 02 19:04:16.546403 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.546202 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:16.547020 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:16.546466 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:16.668982 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.668959 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:04:16.669304 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.669273 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"dbca2dd391c339578c0ea2c597d40f7e4d14b531d2e96495c4144832bb449ff9"} Jun 02 19:04:16.669589 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.669563 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:04:16.669589 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.669591 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:04:16.669789 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.669773 2573 scope.go:117] "RemoveContainer" containerID="aa3c3ce53d4538498fe256bce00b323c9dbe577061a18baa8984d041f4dd7160" Jun 02 19:04:16.671174 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.671149 2573 generic.go:358] "Generic (PLEG): container finished" podID="2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2" containerID="c1885f47c64624d46a43f65889b0b884cc5ce50ca6b647285c57b0a637a78cef" exitCode=0 Jun 02 19:04:16.671257 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.671238 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerDied","Data":"c1885f47c64624d46a43f65889b0b884cc5ce50ca6b647285c57b0a637a78cef"} Jun 02 19:04:16.685925 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.685900 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:04:16.686013 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:16.685999 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:04:17.546114 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.546086 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:17.546227 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.546136 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:17.546227 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:17.546212 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:17.546370 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:17.546345 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:17.676077 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.676056 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:04:17.676448 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.676375 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" event={"ID":"abe39f38-b20f-4545-85e5-cc00b8ec93e5","Type":"ContainerStarted","Data":"2909909ceb0bfc27d0533346c7e4e58154bfbbc0cd0213f008754bd7c627180c"} Jun 02 19:04:17.676559 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.676544 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 19:04:17.678380 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.678344 2573 generic.go:358] "Generic (PLEG): container finished" podID="2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2" containerID="314cabdc79b4cf50644405fdf59814635c2274c02c6effe86fbf6e3604a101e0" exitCode=0 Jun 02 19:04:17.678380 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.678374 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerDied","Data":"314cabdc79b4cf50644405fdf59814635c2274c02c6effe86fbf6e3604a101e0"} Jun 02 19:04:17.709699 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.709654 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" podStartSLOduration=10.767697546 podStartE2EDuration="28.709637024s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.129511182 +0000 UTC m=+3.129372730" lastFinishedPulling="2026-06-02 19:04:10.07145066 +0000 UTC m=+21.071312208" observedRunningTime="2026-06-02 19:04:17.709009209 +0000 UTC m=+28.708870768" watchObservedRunningTime="2026-06-02 19:04:17.709637024 +0000 UTC m=+28.709498587" Jun 02 19:04:17.962956 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.962927 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvgqr"] Jun 02 19:04:17.963113 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.963065 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:17.963215 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:17.963183 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:17.966623 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.966588 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nj6md"] Jun 02 19:04:17.966716 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.966698 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:17.966807 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:17.966786 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:17.967213 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.967194 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nm8gp"] Jun 02 19:04:17.967309 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:17.967295 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:17.967410 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:17.967389 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:18.681984 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:18.681907 2573 generic.go:358] "Generic (PLEG): container finished" podID="2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2" containerID="06be75b0b65f920961af08824237bfff7bc214cd4bf94467bc2f84d5957e2d93" exitCode=0 Jun 02 19:04:18.682319 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:18.682002 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerDied","Data":"06be75b0b65f920961af08824237bfff7bc214cd4bf94467bc2f84d5957e2d93"} Jun 02 19:04:18.682319 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:18.682226 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 19:04:19.547410 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:19.547189 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:19.547685 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:19.547645 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:19.548062 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:19.547913 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:19.548062 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:19.547924 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:19.548062 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:19.548006 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:19.548256 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:19.548112 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:21.258841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:21.258813 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:04:21.259221 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:21.259057 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 19:04:21.271735 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:21.271712 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fcbq" Jun 02 19:04:21.545971 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:21.545894 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:21.546143 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:21.545894 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:21.546143 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:21.545993 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nj6md" podUID="9ff66cf9-0efd-4cbd-8872-941684db30a0" Jun 02 19:04:21.546143 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:21.546101 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:04:21.546143 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:21.545894 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:21.546361 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:21.546184 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvgqr" podUID="749d6ff0-d2c8-4cc2-ad63-085ec3c73edf" Jun 02 19:04:22.805697 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.805665 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-73.ec2.internal" event="NodeReady" Jun 02 19:04:22.806358 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.805790 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 19:04:22.852323 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.852292 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dh4qz"] Jun 02 19:04:22.876973 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.876895 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-24gxr"] Jun 02 19:04:22.876973 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.876943 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:22.880124 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.880077 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 19:04:22.880258 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.880147 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 19:04:22.880258 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.880239 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdn92\"" Jun 02 19:04:22.888287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.888268 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dh4qz"] Jun 02 19:04:22.888287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.888290 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24gxr"] Jun 02 19:04:22.888415 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.888383 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:22.890963 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.890944 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 19:04:22.891089 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.890983 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljpzl\"" Jun 02 19:04:22.891266 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.891248 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 19:04:22.891343 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.891277 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 19:04:22.991635 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.991602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72pc\" (UniqueName: \"kubernetes.io/projected/58d3825d-d018-4530-a7b0-f1cb0222ccb3-kube-api-access-d72pc\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:22.991912 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.991662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58d3825d-d018-4530-a7b0-f1cb0222ccb3-config-volume\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:22.991912 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.991691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d3825d-d018-4530-a7b0-f1cb0222ccb3-tmp-dir\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:22.991912 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.991772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:22.991912 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.991814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:22.991912 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:22.991840 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-447s8\" (UniqueName: \"kubernetes.io/projected/83878d10-1c10-4444-8f73-1ebee8f4321d-kube-api-access-447s8\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:23.092976 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.092941 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58d3825d-d018-4530-a7b0-f1cb0222ccb3-config-volume\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.093148 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.092993 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d3825d-d018-4530-a7b0-f1cb0222ccb3-tmp-dir\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.093148 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.093015 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.093148 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.093058 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:23.093148 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.093087 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-447s8\" (UniqueName: \"kubernetes.io/projected/83878d10-1c10-4444-8f73-1ebee8f4321d-kube-api-access-447s8\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:23.093359 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.093157 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:23.093359 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.093241 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:23.593220128 +0000 UTC m=+34.593081673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:23.093359 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.093268 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d72pc\" (UniqueName: \"kubernetes.io/projected/58d3825d-d018-4530-a7b0-f1cb0222ccb3-kube-api-access-d72pc\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.093359 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.093295 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:23.093572 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.093365 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:23.593348634 +0000 UTC m=+34.593210187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:23.093632 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.093569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58d3825d-d018-4530-a7b0-f1cb0222ccb3-config-volume\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.093735 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.093707 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58d3825d-d018-4530-a7b0-f1cb0222ccb3-tmp-dir\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.104467 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.104422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72pc\" (UniqueName: \"kubernetes.io/projected/58d3825d-d018-4530-a7b0-f1cb0222ccb3-kube-api-access-d72pc\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.104605 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.104578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-447s8\" (UniqueName: \"kubernetes.io/projected/83878d10-1c10-4444-8f73-1ebee8f4321d-kube-api-access-447s8\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:23.193887 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.193802 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:23.194050 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.193973 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:23.194106 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.194071 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:55.194053139 +0000 UTC m=+66.193914677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:04:23.294978 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.294950 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:23.295150 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.295079 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:23.295200 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.295143 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:04:23.295200 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.295168 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:04:23.295200 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.295182 2573 projected.go:194] Error preparing data for projected volume kube-api-access-qswrd for pod openshift-network-diagnostics/network-check-target-nj6md: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:23.295200 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.295186 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 19:04:23.295364 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.295259 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret podName:749d6ff0-d2c8-4cc2-ad63-085ec3c73edf nodeName:}" failed. No retries permitted until 2026-06-02 19:04:55.295221461 +0000 UTC m=+66.295082999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret") pod "global-pull-secret-syncer-tvgqr" (UID: "749d6ff0-d2c8-4cc2-ad63-085ec3c73edf") : object "kube-system"/"original-pull-secret" not registered Jun 02 19:04:23.295364 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.295279 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd podName:9ff66cf9-0efd-4cbd-8872-941684db30a0 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:55.295267531 +0000 UTC m=+66.295129070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qswrd" (UniqueName: "kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd") pod "network-check-target-nj6md" (UID: "9ff66cf9-0efd-4cbd-8872-941684db30a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:04:23.546711 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.546676 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:23.546906 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.546676 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:23.546906 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.546694 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:23.551415 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.551393 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:23.551415 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.551402 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kj59\"" Jun 02 19:04:23.551592 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.551416 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 19:04:23.551592 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.551457 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:04:23.551592 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.551410 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djr2n\"" Jun 02 19:04:23.551592 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.551409 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:04:23.598507 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.598473 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:23.598625 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:23.598517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:23.598686 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.598625 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:23.598686 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.598660 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:23.598785 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.598691 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:24.598672198 +0000 UTC m=+35.598533754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:23.598785 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:23.598708 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:24.598699664 +0000 UTC m=+35.598561204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:24.608188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:24.608152 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:24.608188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:24.608197 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:24.608931 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:24.608331 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:24.608931 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:24.608386 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:24.608931 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:24.608411 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:26.608391032 +0000 UTC m=+37.608252578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:24.608931 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:24.608438 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:26.608424501 +0000 UTC m=+37.608286040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:26.623124 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:26.622940 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:26.623124 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:26.623127 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:26.623517 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:26.623098 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:26.623517 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:26.623210 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:26.623517 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:26.623238 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:30.623223562 +0000 UTC m=+41.623085100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:26.623517 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:26.623253 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:30.623246414 +0000 UTC m=+41.623107952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:26.699720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:26.699692 2573 generic.go:358] "Generic (PLEG): container finished" podID="2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2" containerID="9354b3c7deed0a7502cb601463a8a83c2ebfad37e342dbe9d3a9a96a039f7334" exitCode=0 Jun 02 19:04:26.699865 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:26.699746 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerDied","Data":"9354b3c7deed0a7502cb601463a8a83c2ebfad37e342dbe9d3a9a96a039f7334"} Jun 02 19:04:27.703852 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:27.703823 2573 generic.go:358] "Generic (PLEG): container finished" podID="2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2" containerID="23b438181958ce626d76ee635a5f973075d036dfd80e307e126100ab09462ec8" exitCode=0 Jun 02 19:04:27.704267 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:27.703861 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerDied","Data":"23b438181958ce626d76ee635a5f973075d036dfd80e307e126100ab09462ec8"} Jun 02 19:04:28.708804 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:28.708766 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" event={"ID":"2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2","Type":"ContainerStarted","Data":"25c05f184a7d1d17f9ad83da46c3f1d4fa80408c8a9d2834c0e27a581699f684"} Jun 02 19:04:28.744471 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:28.744417 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xwkw6" podStartSLOduration=6.13431064 podStartE2EDuration="39.744400235s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:03:52.12885437 +0000 UTC m=+3.128715910" lastFinishedPulling="2026-06-02 19:04:25.738943964 +0000 UTC m=+36.738805505" observedRunningTime="2026-06-02 19:04:28.742202228 +0000 UTC m=+39.742063788" watchObservedRunningTime="2026-06-02 19:04:28.744400235 +0000 UTC m=+39.744261797" Jun 02 19:04:30.648707 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:30.648666 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:30.648707 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:30.648703 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:30.649107 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:30.648794 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:30.649107 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:30.648799 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:30.649107 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:30.648855 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:38.648838047 +0000 UTC m=+49.648699587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:30.649107 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:30.648869 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:38.648862674 +0000 UTC m=+49.648724211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:38.702362 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:38.702320 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:38.702867 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:38.702371 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:38.702867 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:38.702491 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:38.702867 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:38.702497 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:38.702867 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:38.702554 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:54.702540296 +0000 UTC m=+65.702401834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:38.702867 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:38.702581 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:54.702559452 +0000 UTC m=+65.702421007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:41.665454 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.665412 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx"] Jun 02 19:04:41.698803 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.698774 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx"] Jun 02 19:04:41.698935 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.698899 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.701794 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.701769 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 19:04:41.702071 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.702051 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 19:04:41.702161 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.702051 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 19:04:41.702941 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.702927 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 19:04:41.728559 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.728537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d0ee8b-9254-4748-889e-acc1b6b42ec4-tmp\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.728652 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.728567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/21d0ee8b-9254-4748-889e-acc1b6b42ec4-klusterlet-config\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.728652 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.728601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbsvq\" (UniqueName: \"kubernetes.io/projected/21d0ee8b-9254-4748-889e-acc1b6b42ec4-kube-api-access-fbsvq\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.829229 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.829197 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d0ee8b-9254-4748-889e-acc1b6b42ec4-tmp\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.829370 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.829233 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/21d0ee8b-9254-4748-889e-acc1b6b42ec4-klusterlet-config\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.829370 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.829271 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbsvq\" (UniqueName: \"kubernetes.io/projected/21d0ee8b-9254-4748-889e-acc1b6b42ec4-kube-api-access-fbsvq\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.829555 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.829535 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d0ee8b-9254-4748-889e-acc1b6b42ec4-tmp\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.832423 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.832406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/21d0ee8b-9254-4748-889e-acc1b6b42ec4-klusterlet-config\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:41.838011 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:41.837982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbsvq\" (UniqueName: \"kubernetes.io/projected/21d0ee8b-9254-4748-889e-acc1b6b42ec4-kube-api-access-fbsvq\") pod \"klusterlet-addon-workmgr-759f47d8f4-zgtqx\" (UID: \"21d0ee8b-9254-4748-889e-acc1b6b42ec4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:42.008802 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:42.008775 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:42.161831 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:42.161800 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx"] Jun 02 19:04:42.164652 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:04:42.164621 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d0ee8b_9254_4748_889e_acc1b6b42ec4.slice/crio-09259486c7e4be38bc6968b3b9359c7c6b466dddb0cd26d4510356bd633f78cd WatchSource:0}: Error finding container 09259486c7e4be38bc6968b3b9359c7c6b466dddb0cd26d4510356bd633f78cd: Status 404 returned error can't find the container with id 09259486c7e4be38bc6968b3b9359c7c6b466dddb0cd26d4510356bd633f78cd Jun 02 19:04:42.734452 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:42.734420 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" event={"ID":"21d0ee8b-9254-4748-889e-acc1b6b42ec4","Type":"ContainerStarted","Data":"09259486c7e4be38bc6968b3b9359c7c6b466dddb0cd26d4510356bd633f78cd"} Jun 02 19:04:46.743983 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:46.743943 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" event={"ID":"21d0ee8b-9254-4748-889e-acc1b6b42ec4","Type":"ContainerStarted","Data":"00b9b8bab2a38efcbbde86d56c8a8d1b44ea04d41df9251b5c03277df2dab8d1"} Jun 02 19:04:46.744361 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:46.744208 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:46.745798 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:46.745776 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" Jun 02 19:04:46.762684 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:46.762647 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759f47d8f4-zgtqx" podStartSLOduration=2.244087164 podStartE2EDuration="5.762636835s" podCreationTimestamp="2026-06-02 19:04:41 +0000 UTC" firstStartedPulling="2026-06-02 19:04:42.16632373 +0000 UTC m=+53.166185271" lastFinishedPulling="2026-06-02 19:04:45.684873391 +0000 UTC m=+56.684734942" observedRunningTime="2026-06-02 19:04:46.761366008 +0000 UTC m=+57.761227571" watchObservedRunningTime="2026-06-02 19:04:46.762636835 +0000 UTC m=+57.762498394" Jun 02 19:04:54.718582 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:54.718541 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:04:54.718582 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:54.718582 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:04:54.719000 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:54.718678 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:54.719000 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:54.718684 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:54.719000 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:54.718747 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:05:26.718731289 +0000 UTC m=+97.718592832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:04:54.719000 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:54.718812 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:26.718796483 +0000 UTC m=+97.718658025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:04:55.222842 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.222794 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:04:55.226169 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.226152 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:55.233602 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:55.233585 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:04:55.233644 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:04:55.233638 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:59.233622795 +0000 UTC m=+130.233484333 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : secret "metrics-daemon-secret" not found Jun 02 19:04:55.323743 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.323713 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:55.323868 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.323757 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:55.326938 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.326921 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:04:55.327206 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.327189 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 19:04:55.336444 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.336426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/749d6ff0-d2c8-4cc2-ad63-085ec3c73edf-original-pull-secret\") pod \"global-pull-secret-syncer-tvgqr\" (UID: \"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf\") " pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:55.336782 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.336764 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:04:55.346873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.346844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswrd\" (UniqueName: \"kubernetes.io/projected/9ff66cf9-0efd-4cbd-8872-941684db30a0-kube-api-access-qswrd\") pod \"network-check-target-nj6md\" (UID: \"9ff66cf9-0efd-4cbd-8872-941684db30a0\") " pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:55.362350 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.362332 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djr2n\"" Jun 02 19:04:55.366468 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.366455 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvgqr" Jun 02 19:04:55.370052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.370022 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:04:55.507352 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.507318 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvgqr"] Jun 02 19:04:55.510251 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:04:55.510223 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749d6ff0_d2c8_4cc2_ad63_085ec3c73edf.slice/crio-e5c11735142c493e24f2e0b6bd8b219346279199ae2f05ef7142f7b030775b4d WatchSource:0}: Error finding container e5c11735142c493e24f2e0b6bd8b219346279199ae2f05ef7142f7b030775b4d: Status 404 returned error can't find the container with id e5c11735142c493e24f2e0b6bd8b219346279199ae2f05ef7142f7b030775b4d Jun 02 19:04:55.523333 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.523311 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nj6md"] Jun 02 19:04:55.526465 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:04:55.526444 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff66cf9_0efd_4cbd_8872_941684db30a0.slice/crio-0708cb5e8aff1f71d77368433789dc80c03ed84026834198bb1747502ca3fb68 WatchSource:0}: Error finding container 0708cb5e8aff1f71d77368433789dc80c03ed84026834198bb1747502ca3fb68: Status 404 returned error can't find the container with id 0708cb5e8aff1f71d77368433789dc80c03ed84026834198bb1747502ca3fb68 Jun 02 19:04:55.761905 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.761865 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nj6md" event={"ID":"9ff66cf9-0efd-4cbd-8872-941684db30a0","Type":"ContainerStarted","Data":"0708cb5e8aff1f71d77368433789dc80c03ed84026834198bb1747502ca3fb68"} Jun 02 19:04:55.762796 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:04:55.762770 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvgqr" event={"ID":"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf","Type":"ContainerStarted","Data":"e5c11735142c493e24f2e0b6bd8b219346279199ae2f05ef7142f7b030775b4d"} Jun 02 19:05:00.773509 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:00.773472 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvgqr" event={"ID":"749d6ff0-d2c8-4cc2-ad63-085ec3c73edf","Type":"ContainerStarted","Data":"1057bc3441721b016898f8f3a17100608a00007efa745c3c8309576d0d5dce7a"} Jun 02 19:05:00.774701 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:00.774673 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nj6md" event={"ID":"9ff66cf9-0efd-4cbd-8872-941684db30a0","Type":"ContainerStarted","Data":"4121db93d174f4d0b1bf2ecd82f511978973c3f0bef1b483ecc9dd6b2cf330c0"} Jun 02 19:05:00.774841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:00.774828 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:05:00.789266 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:00.789230 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tvgqr" podStartSLOduration=65.924605815 podStartE2EDuration="1m10.789218162s" podCreationTimestamp="2026-06-02 19:03:50 +0000 UTC" firstStartedPulling="2026-06-02 19:04:55.511887678 +0000 UTC m=+66.511749216" lastFinishedPulling="2026-06-02 19:05:00.376500022 +0000 UTC m=+71.376361563" observedRunningTime="2026-06-02 19:05:00.788511987 +0000 UTC m=+71.788373547" watchObservedRunningTime="2026-06-02 19:05:00.789218162 +0000 UTC m=+71.789079722" Jun 02 19:05:00.805226 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:00.805163 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nj6md" podStartSLOduration=66.96037026 podStartE2EDuration="1m11.805150613s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:04:55.528080353 +0000 UTC m=+66.527941895" lastFinishedPulling="2026-06-02 19:05:00.37286071 +0000 UTC m=+71.372722248" observedRunningTime="2026-06-02 19:05:00.804141668 +0000 UTC m=+71.804003227" watchObservedRunningTime="2026-06-02 19:05:00.805150613 +0000 UTC m=+71.805012172" Jun 02 19:05:26.758156 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:26.758125 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:05:26.758156 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:26.758160 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:05:26.758691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:26.758272 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:05:26.758691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:26.758276 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:05:26.758691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:26.758337 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert podName:83878d10-1c10-4444-8f73-1ebee8f4321d nodeName:}" failed. No retries permitted until 2026-06-02 19:06:30.758319787 +0000 UTC m=+161.758181325 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert") pod "ingress-canary-24gxr" (UID: "83878d10-1c10-4444-8f73-1ebee8f4321d") : secret "canary-serving-cert" not found Jun 02 19:05:26.758691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:26.758351 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls podName:58d3825d-d018-4530-a7b0-f1cb0222ccb3 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:30.75834485 +0000 UTC m=+161.758206388 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls") pod "dns-default-dh4qz" (UID: "58d3825d-d018-4530-a7b0-f1cb0222ccb3") : secret "dns-default-metrics-tls" not found Jun 02 19:05:31.779444 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:31.779409 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nj6md" Jun 02 19:05:49.816466 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.816434 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2"] Jun 02 19:05:49.818122 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.818106 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:49.820939 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.820914 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 19:05:49.821069 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.820981 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lsp9m\"" Jun 02 19:05:49.823802 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.823781 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 19:05:49.823802 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.823789 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 19:05:49.823945 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.823932 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 19:05:49.830744 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.830723 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2"] Jun 02 19:05:49.918785 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.918752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:49.918785 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.918791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8lpr\" (UniqueName: \"kubernetes.io/projected/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-kube-api-access-h8lpr\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:49.918989 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:49.918886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.019773 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.019737 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.019928 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.019784 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.019928 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.019807 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8lpr\" (UniqueName: \"kubernetes.io/projected/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-kube-api-access-h8lpr\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.019928 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.019897 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:50.020046 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.019977 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls podName:1ec4a432-c106-48c8-b39d-da7bfb8be7c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:50.519959907 +0000 UTC m=+121.519821465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-trjx2" (UID: "1ec4a432-c106-48c8-b39d-da7bfb8be7c4") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:50.020520 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.020501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.022065 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.022043 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4"] Jun 02 19:05:50.023751 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.023736 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm"] Jun 02 19:05:50.023883 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.023868 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.025669 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.025648 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" Jun 02 19:05:50.026121 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.026102 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6866864d6b-l6rqr"] Jun 02 19:05:50.026789 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.026769 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 19:05:50.026789 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.026782 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 19:05:50.026892 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.026783 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jd267\"" Jun 02 19:05:50.027310 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.027295 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:05:50.027569 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.027556 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.027772 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.027755 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 19:05:50.028737 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.028719 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 19:05:50.031589 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.031566 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:05:50.031872 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.031855 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cqvbq\"" Jun 02 19:05:50.032798 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.032773 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 19:05:50.032952 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.032776 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfb7c\"" Jun 02 19:05:50.032952 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.032815 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 19:05:50.032952 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.032861 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 19:05:50.032952 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.032914 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm"] Jun 02 19:05:50.037924 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.037708 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 19:05:50.044705 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.044332 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4"] Jun 02 19:05:50.045573 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.045556 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6866864d6b-l6rqr"] Jun 02 19:05:50.047898 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.047881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8lpr\" (UniqueName: \"kubernetes.io/projected/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-kube-api-access-h8lpr\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.121078 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.120998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-certificates\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121078 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-installation-pull-secrets\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-serving-cert\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.121211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cds65\" (UniqueName: \"kubernetes.io/projected/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-kube-api-access-cds65\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.121211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121176 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121211 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-trusted-ca\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121332 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-image-registry-private-configuration\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121332 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-config\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.121332 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-ca-trust-extracted\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121332 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121324 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9tb\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-kube-api-access-nk9tb\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121450 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-bound-sa-token\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.121450 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.121357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5js\" (UniqueName: \"kubernetes.io/projected/fcac5c52-ac18-43fd-a380-6f5ac5adc56f-kube-api-access-mg5js\") pod \"volume-data-source-validator-7598fd5bd-ghmcm\" (UID: \"fcac5c52-ac18-43fd-a380-6f5ac5adc56f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" Jun 02 19:05:50.222187 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222155 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-certificates\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222192 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-installation-pull-secrets\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222217 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-serving-cert\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.222312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222240 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cds65\" (UniqueName: \"kubernetes.io/projected/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-kube-api-access-cds65\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.222312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222257 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222282 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-trusted-ca\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222300 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-image-registry-private-configuration\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222324 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-config\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222357 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-ca-trust-extracted\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222383 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9tb\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-kube-api-access-nk9tb\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.222397 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222408 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-bound-sa-token\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.222418 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6866864d6b-l6rqr: secret "image-registry-tls" not found Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222434 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5js\" (UniqueName: \"kubernetes.io/projected/fcac5c52-ac18-43fd-a380-6f5ac5adc56f-kube-api-access-mg5js\") pod \"volume-data-source-validator-7598fd5bd-ghmcm\" (UID: \"fcac5c52-ac18-43fd-a380-6f5ac5adc56f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" Jun 02 19:05:50.222607 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.222490 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls podName:343ba68a-f7e3-44a1-8b6a-4a1016ff2246 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:50.722468536 +0000 UTC m=+121.722330090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls") pod "image-registry-6866864d6b-l6rqr" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246") : secret "image-registry-tls" not found Jun 02 19:05:50.222971 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.222838 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-certificates\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.223216 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.223198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-config\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.223459 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.223443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-ca-trust-extracted\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.223562 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.223540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-trusted-ca\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.224804 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.224781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-installation-pull-secrets\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.225044 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.225010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-serving-cert\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.225183 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.225165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-image-registry-private-configuration\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.231507 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.231484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-bound-sa-token\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.231604 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.231514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cds65\" (UniqueName: \"kubernetes.io/projected/ceaec6f4-e325-4a29-b2df-e77c9b2d0c36-kube-api-access-cds65\") pod \"service-ca-operator-69877444c-9wsn4\" (UID: \"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.231650 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.231606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9tb\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-kube-api-access-nk9tb\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.232079 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.232058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5js\" (UniqueName: \"kubernetes.io/projected/fcac5c52-ac18-43fd-a380-6f5ac5adc56f-kube-api-access-mg5js\") pod \"volume-data-source-validator-7598fd5bd-ghmcm\" (UID: \"fcac5c52-ac18-43fd-a380-6f5ac5adc56f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" Jun 02 19:05:50.335105 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.335086 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" Jun 02 19:05:50.341846 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.341742 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" Jun 02 19:05:50.458162 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.458139 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4"] Jun 02 19:05:50.460368 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:05:50.460346 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceaec6f4_e325_4a29_b2df_e77c9b2d0c36.slice/crio-0672ac542c4d9c11512da42b1823be141ef15c5407e63d5598baadd723327843 WatchSource:0}: Error finding container 0672ac542c4d9c11512da42b1823be141ef15c5407e63d5598baadd723327843: Status 404 returned error can't find the container with id 0672ac542c4d9c11512da42b1823be141ef15c5407e63d5598baadd723327843 Jun 02 19:05:50.477241 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.477218 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm"] Jun 02 19:05:50.479959 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:05:50.479935 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcac5c52_ac18_43fd_a380_6f5ac5adc56f.slice/crio-5258785b1cf154ec529835887c3006e675c6cb05e5ed0494ad1d5b638d9385a2 WatchSource:0}: Error finding container 5258785b1cf154ec529835887c3006e675c6cb05e5ed0494ad1d5b638d9385a2: Status 404 returned error can't find the container with id 5258785b1cf154ec529835887c3006e675c6cb05e5ed0494ad1d5b638d9385a2 Jun 02 19:05:50.524651 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.524628 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:50.524802 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.524783 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:50.524864 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.524855 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls podName:1ec4a432-c106-48c8-b39d-da7bfb8be7c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:51.524834835 +0000 UTC m=+122.524696376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-trjx2" (UID: "1ec4a432-c106-48c8-b39d-da7bfb8be7c4") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:50.726128 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.726044 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:50.726258 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.726161 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:05:50.726258 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.726173 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6866864d6b-l6rqr: secret "image-registry-tls" not found Jun 02 19:05:50.726258 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:50.726246 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls podName:343ba68a-f7e3-44a1-8b6a-4a1016ff2246 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:51.726231469 +0000 UTC m=+122.726093007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls") pod "image-registry-6866864d6b-l6rqr" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246") : secret "image-registry-tls" not found Jun 02 19:05:50.868743 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.868708 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" event={"ID":"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36","Type":"ContainerStarted","Data":"0672ac542c4d9c11512da42b1823be141ef15c5407e63d5598baadd723327843"} Jun 02 19:05:50.869584 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:50.869562 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" event={"ID":"fcac5c52-ac18-43fd-a380-6f5ac5adc56f","Type":"ContainerStarted","Data":"5258785b1cf154ec529835887c3006e675c6cb05e5ed0494ad1d5b638d9385a2"} Jun 02 19:05:51.533281 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:51.533243 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:51.533490 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:51.533405 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:51.533490 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:51.533475 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls podName:1ec4a432-c106-48c8-b39d-da7bfb8be7c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:53.533457382 +0000 UTC m=+124.533318921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-trjx2" (UID: "1ec4a432-c106-48c8-b39d-da7bfb8be7c4") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:51.735528 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:51.735495 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:51.735691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:51.735661 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:05:51.735691 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:51.735681 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6866864d6b-l6rqr: secret "image-registry-tls" not found Jun 02 19:05:51.735812 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:51.735749 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls podName:343ba68a-f7e3-44a1-8b6a-4a1016ff2246 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:53.735727742 +0000 UTC m=+124.735589289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls") pod "image-registry-6866864d6b-l6rqr" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246") : secret "image-registry-tls" not found Jun 02 19:05:53.550210 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:53.550177 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:53.550568 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:53.550289 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:53.550568 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:53.550338 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls podName:1ec4a432-c106-48c8-b39d-da7bfb8be7c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:57.550325155 +0000 UTC m=+128.550186694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-trjx2" (UID: "1ec4a432-c106-48c8-b39d-da7bfb8be7c4") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:53.751653 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:53.751619 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:53.751839 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:53.751733 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:05:53.751839 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:53.751745 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6866864d6b-l6rqr: secret "image-registry-tls" not found Jun 02 19:05:53.751839 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:53.751799 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls podName:343ba68a-f7e3-44a1-8b6a-4a1016ff2246 nodeName:}" failed. No retries permitted until 2026-06-02 19:05:57.751782077 +0000 UTC m=+128.751643631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls") pod "image-registry-6866864d6b-l6rqr" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246") : secret "image-registry-tls" not found Jun 02 19:05:53.878744 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:53.878663 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" event={"ID":"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36","Type":"ContainerStarted","Data":"960a87bf6c1fdabc1cb82abe961bc08b716427059e34c1140d3db12b9b869d03"} Jun 02 19:05:53.880068 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:53.880025 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" event={"ID":"fcac5c52-ac18-43fd-a380-6f5ac5adc56f","Type":"ContainerStarted","Data":"16bf06d0c042ea2b6237fdd366187a4a724ca91f709b5909644f199907b620dc"} Jun 02 19:05:53.894475 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:53.894432 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" podStartSLOduration=1.518592709 podStartE2EDuration="3.894421783s" podCreationTimestamp="2026-06-02 19:05:50 +0000 UTC" firstStartedPulling="2026-06-02 19:05:50.462175909 +0000 UTC m=+121.462037450" lastFinishedPulling="2026-06-02 19:05:52.838004982 +0000 UTC m=+123.837866524" observedRunningTime="2026-06-02 19:05:53.894013959 +0000 UTC m=+124.893875519" watchObservedRunningTime="2026-06-02 19:05:53.894421783 +0000 UTC m=+124.894283344" Jun 02 19:05:53.908650 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:53.908610 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-ghmcm" podStartSLOduration=1.55612429 podStartE2EDuration="3.90860121s" podCreationTimestamp="2026-06-02 19:05:50 +0000 UTC" firstStartedPulling="2026-06-02 19:05:50.481537233 +0000 UTC m=+121.481398770" lastFinishedPulling="2026-06-02 19:05:52.834014151 +0000 UTC m=+123.833875690" observedRunningTime="2026-06-02 19:05:53.907685432 +0000 UTC m=+124.907546991" watchObservedRunningTime="2026-06-02 19:05:53.90860121 +0000 UTC m=+124.908462771" Jun 02 19:05:56.737643 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.737608 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-plz9p"] Jun 02 19:05:56.739560 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.739540 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.742271 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.742253 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 19:05:56.743329 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.743311 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 19:05:56.743408 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.743341 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tplc2\"" Jun 02 19:05:56.743408 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.743355 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 19:05:56.743408 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.743368 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 19:05:56.749596 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.749575 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-plz9p"] Jun 02 19:05:56.776015 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.775993 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcq6p\" (UniqueName: \"kubernetes.io/projected/9f2541ad-5265-4197-8a01-bacc30289693-kube-api-access-mcq6p\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.776158 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.776120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9f2541ad-5265-4197-8a01-bacc30289693-signing-key\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.776200 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.776183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9f2541ad-5265-4197-8a01-bacc30289693-signing-cabundle\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.877336 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.877304 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9f2541ad-5265-4197-8a01-bacc30289693-signing-key\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.877336 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.877342 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9f2541ad-5265-4197-8a01-bacc30289693-signing-cabundle\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.877555 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.877534 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcq6p\" (UniqueName: \"kubernetes.io/projected/9f2541ad-5265-4197-8a01-bacc30289693-kube-api-access-mcq6p\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.877924 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.877907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9f2541ad-5265-4197-8a01-bacc30289693-signing-cabundle\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.879696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.879674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9f2541ad-5265-4197-8a01-bacc30289693-signing-key\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:56.885726 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:56.885698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcq6p\" (UniqueName: \"kubernetes.io/projected/9f2541ad-5265-4197-8a01-bacc30289693-kube-api-access-mcq6p\") pod \"service-ca-685df94d57-plz9p\" (UID: \"9f2541ad-5265-4197-8a01-bacc30289693\") " pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:57.048552 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.048466 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-plz9p" Jun 02 19:05:57.162772 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.162674 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-plz9p"] Jun 02 19:05:57.165316 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:05:57.165283 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2541ad_5265_4197_8a01_bacc30289693.slice/crio-ae27709f925d6c9ecd0eaaca2932f3b6b6c03b115b0112ff163305be199ed702 WatchSource:0}: Error finding container ae27709f925d6c9ecd0eaaca2932f3b6b6c03b115b0112ff163305be199ed702: Status 404 returned error can't find the container with id ae27709f925d6c9ecd0eaaca2932f3b6b6c03b115b0112ff163305be199ed702 Jun 02 19:05:57.373376 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.373297 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gbrrp_e979a935-06cf-4c6d-8ce9-a1fa2501ced1/dns-node-resolver/0.log" Jun 02 19:05:57.582751 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.582711 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:05:57.582922 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:57.582848 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:57.582922 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:57.582911 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls podName:1ec4a432-c106-48c8-b39d-da7bfb8be7c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:05.582895683 +0000 UTC m=+136.582757236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-trjx2" (UID: "1ec4a432-c106-48c8-b39d-da7bfb8be7c4") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:05:57.784436 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.784405 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:05:57.784818 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:57.784566 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:05:57.784818 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:57.784588 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6866864d6b-l6rqr: secret "image-registry-tls" not found Jun 02 19:05:57.784818 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:57.784651 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls podName:343ba68a-f7e3-44a1-8b6a-4a1016ff2246 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:05.784632962 +0000 UTC m=+136.784494503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls") pod "image-registry-6866864d6b-l6rqr" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246") : secret "image-registry-tls" not found Jun 02 19:05:57.891182 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.891146 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-plz9p" event={"ID":"9f2541ad-5265-4197-8a01-bacc30289693","Type":"ContainerStarted","Data":"8338a8b08ec699980ba38d76906eb6daf5a0394701306d360e5fa0c0a63786aa"} Jun 02 19:05:57.891330 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.891185 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-plz9p" event={"ID":"9f2541ad-5265-4197-8a01-bacc30289693","Type":"ContainerStarted","Data":"ae27709f925d6c9ecd0eaaca2932f3b6b6c03b115b0112ff163305be199ed702"} Jun 02 19:05:57.912522 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:57.912478 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-plz9p" podStartSLOduration=1.912464357 podStartE2EDuration="1.912464357s" podCreationTimestamp="2026-06-02 19:05:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:05:57.911332854 +0000 UTC m=+128.911194415" watchObservedRunningTime="2026-06-02 19:05:57.912464357 +0000 UTC m=+128.912325916" Jun 02 19:05:58.774039 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:58.773998 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2h7m_01635513-e06f-40f4-8aa3-2a9a6c23fff4/node-ca/0.log" Jun 02 19:05:59.295707 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:05:59.295673 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:05:59.296104 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:59.295816 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 19:05:59.296104 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:05:59.295881 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs podName:59a4d9a4-a1ed-4261-bc1b-db9e96135ff0 nodeName:}" failed. No retries permitted until 2026-06-02 19:08:01.295865329 +0000 UTC m=+252.295726870 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs") pod "network-metrics-daemon-nm8gp" (UID: "59a4d9a4-a1ed-4261-bc1b-db9e96135ff0") : secret "metrics-daemon-secret" not found Jun 02 19:06:05.642395 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:05.642354 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:06:05.642850 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:05.642496 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:06:05.642850 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:05.642562 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls podName:1ec4a432-c106-48c8-b39d-da7bfb8be7c4 nodeName:}" failed. No retries permitted until 2026-06-02 19:06:21.642548073 +0000 UTC m=+152.642409614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-trjx2" (UID: "1ec4a432-c106-48c8-b39d-da7bfb8be7c4") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:06:05.844413 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:05.844375 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:05.846831 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:05.846798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"image-registry-6866864d6b-l6rqr\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:05.947817 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:05.947749 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:06.073241 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:06.073218 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6866864d6b-l6rqr"] Jun 02 19:06:06.075922 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:06.075892 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343ba68a_f7e3_44a1_8b6a_4a1016ff2246.slice/crio-b1288791c65b4586816dc67bf41263e67ee4fd1082efedf3b09d74c643997b60 WatchSource:0}: Error finding container b1288791c65b4586816dc67bf41263e67ee4fd1082efedf3b09d74c643997b60: Status 404 returned error can't find the container with id b1288791c65b4586816dc67bf41263e67ee4fd1082efedf3b09d74c643997b60 Jun 02 19:06:06.913289 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:06.913255 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" event={"ID":"343ba68a-f7e3-44a1-8b6a-4a1016ff2246","Type":"ContainerStarted","Data":"7bcc512fbdaf4b01aeb179e2627826b36d18daf28ea611efee58d41f3dad65d9"} Jun 02 19:06:06.913289 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:06.913289 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" event={"ID":"343ba68a-f7e3-44a1-8b6a-4a1016ff2246","Type":"ContainerStarted","Data":"b1288791c65b4586816dc67bf41263e67ee4fd1082efedf3b09d74c643997b60"} Jun 02 19:06:06.913685 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:06.913413 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:06.937717 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:06.937666 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" podStartSLOduration=16.937649562 podStartE2EDuration="16.937649562s" podCreationTimestamp="2026-06-02 19:05:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:06:06.936154359 +0000 UTC m=+137.936015920" watchObservedRunningTime="2026-06-02 19:06:06.937649562 +0000 UTC m=+137.937511123" Jun 02 19:06:16.657804 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.657762 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb"] Jun 02 19:06:16.660832 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.660811 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.663882 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.663834 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6866864d6b-l6rqr"] Jun 02 19:06:16.664980 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.664961 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8drzw\"" Jun 02 19:06:16.665137 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.665123 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 19:06:16.667213 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.667158 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 19:06:16.675069 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.675025 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xhm9b"] Jun 02 19:06:16.676728 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.676709 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb"] Jun 02 19:06:16.676868 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.676854 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.680384 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.680367 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 19:06:16.681297 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.680717 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsdwt\"" Jun 02 19:06:16.681297 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.680784 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 19:06:16.681297 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.680724 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 19:06:16.681546 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.681322 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 19:06:16.695506 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.695481 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xhm9b"] Jun 02 19:06:16.712073 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.712052 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-595fffd55b-hjrxk"] Jun 02 19:06:16.713810 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.713787 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.723189 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0be76db0-4f00-4b89-8abb-a5ecb443d90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.723271 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44d5d271-b24c-430c-9bef-8d549be00274-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-m92pb\" (UID: \"44d5d271-b24c-430c-9bef-8d549be00274\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.723271 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be76db0-4f00-4b89-8abb-a5ecb443d90c-data-volume\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.723345 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0be76db0-4f00-4b89-8abb-a5ecb443d90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.723345 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0be76db0-4f00-4b89-8abb-a5ecb443d90c-crio-socket\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.723345 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22zw\" (UniqueName: \"kubernetes.io/projected/0be76db0-4f00-4b89-8abb-a5ecb443d90c-kube-api-access-k22zw\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.723436 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.723356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44d5d271-b24c-430c-9bef-8d549be00274-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-m92pb\" (UID: \"44d5d271-b24c-430c-9bef-8d549be00274\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.728602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.728582 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595fffd55b-hjrxk"] Jun 02 19:06:16.824275 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824241 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0be76db0-4f00-4b89-8abb-a5ecb443d90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.824440 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824285 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0be76db0-4f00-4b89-8abb-a5ecb443d90c-crio-socket\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.824440 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824310 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k22zw\" (UniqueName: \"kubernetes.io/projected/0be76db0-4f00-4b89-8abb-a5ecb443d90c-kube-api-access-k22zw\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.824440 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824346 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44d5d271-b24c-430c-9bef-8d549be00274-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-m92pb\" (UID: \"44d5d271-b24c-430c-9bef-8d549be00274\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.824440 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824372 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0be76db0-4f00-4b89-8abb-a5ecb443d90c-crio-socket\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.824440 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/880d398f-80b9-431a-82f0-83e751c48f4a-image-registry-private-configuration\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.824440 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbhzd\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-kube-api-access-fbhzd\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/880d398f-80b9-431a-82f0-83e751c48f4a-trusted-ca\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-bound-sa-token\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824535 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0be76db0-4f00-4b89-8abb-a5ecb443d90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824564 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44d5d271-b24c-430c-9bef-8d549be00274-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-m92pb\" (UID: \"44d5d271-b24c-430c-9bef-8d549be00274\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824593 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be76db0-4f00-4b89-8abb-a5ecb443d90c-data-volume\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/880d398f-80b9-431a-82f0-83e751c48f4a-installation-pull-secrets\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.824736 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/880d398f-80b9-431a-82f0-83e751c48f4a-ca-trust-extracted\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.825120 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/880d398f-80b9-431a-82f0-83e751c48f4a-registry-certificates\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.825120 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-registry-tls\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.825120 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0be76db0-4f00-4b89-8abb-a5ecb443d90c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.825120 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.824872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be76db0-4f00-4b89-8abb-a5ecb443d90c-data-volume\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.825326 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.825223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44d5d271-b24c-430c-9bef-8d549be00274-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-m92pb\" (UID: \"44d5d271-b24c-430c-9bef-8d549be00274\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.826844 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.826814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0be76db0-4f00-4b89-8abb-a5ecb443d90c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.826947 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.826900 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44d5d271-b24c-430c-9bef-8d549be00274-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-m92pb\" (UID: \"44d5d271-b24c-430c-9bef-8d549be00274\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.833040 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.833001 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22zw\" (UniqueName: \"kubernetes.io/projected/0be76db0-4f00-4b89-8abb-a5ecb443d90c-kube-api-access-k22zw\") pod \"insights-runtime-extractor-xhm9b\" (UID: \"0be76db0-4f00-4b89-8abb-a5ecb443d90c\") " pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:16.925412 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925352 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-registry-tls\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925420 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/880d398f-80b9-431a-82f0-83e751c48f4a-image-registry-private-configuration\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925444 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbhzd\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-kube-api-access-fbhzd\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925468 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/880d398f-80b9-431a-82f0-83e751c48f4a-trusted-ca\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925491 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-bound-sa-token\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925517 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/880d398f-80b9-431a-82f0-83e751c48f4a-installation-pull-secrets\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925785 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925561 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/880d398f-80b9-431a-82f0-83e751c48f4a-ca-trust-extracted\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.925785 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.925588 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/880d398f-80b9-431a-82f0-83e751c48f4a-registry-certificates\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.926151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.926126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/880d398f-80b9-431a-82f0-83e751c48f4a-ca-trust-extracted\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.926398 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.926379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/880d398f-80b9-431a-82f0-83e751c48f4a-registry-certificates\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.926841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.926813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/880d398f-80b9-431a-82f0-83e751c48f4a-trusted-ca\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.927827 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.927800 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/880d398f-80b9-431a-82f0-83e751c48f4a-image-registry-private-configuration\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.927924 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.927850 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/880d398f-80b9-431a-82f0-83e751c48f4a-installation-pull-secrets\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.927963 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.927942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-registry-tls\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.934797 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.934771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbhzd\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-kube-api-access-fbhzd\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.934911 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.934892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/880d398f-80b9-431a-82f0-83e751c48f4a-bound-sa-token\") pod \"image-registry-595fffd55b-hjrxk\" (UID: \"880d398f-80b9-431a-82f0-83e751c48f4a\") " pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:16.969591 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.969570 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" Jun 02 19:06:16.988543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:16.988514 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xhm9b" Jun 02 19:06:17.021490 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.021450 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:17.108645 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.108607 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb"] Jun 02 19:06:17.112782 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:17.112739 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d5d271_b24c_430c_9bef_8d549be00274.slice/crio-732475005d496d01248a2be7331c341774ec472ef641e66d7d5ad2c6384552e7 WatchSource:0}: Error finding container 732475005d496d01248a2be7331c341774ec472ef641e66d7d5ad2c6384552e7: Status 404 returned error can't find the container with id 732475005d496d01248a2be7331c341774ec472ef641e66d7d5ad2c6384552e7 Jun 02 19:06:17.129637 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.129613 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xhm9b"] Jun 02 19:06:17.131669 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:17.131648 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be76db0_4f00_4b89_8abb_a5ecb443d90c.slice/crio-87bd7a85e0daba0ae6d519dd0a91e0b950443216a757df89fce84adbd74ed2ff WatchSource:0}: Error finding container 87bd7a85e0daba0ae6d519dd0a91e0b950443216a757df89fce84adbd74ed2ff: Status 404 returned error can't find the container with id 87bd7a85e0daba0ae6d519dd0a91e0b950443216a757df89fce84adbd74ed2ff Jun 02 19:06:17.177925 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.177895 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595fffd55b-hjrxk"] Jun 02 19:06:17.181187 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:17.181165 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880d398f_80b9_431a_82f0_83e751c48f4a.slice/crio-0d1d243a5a746e3969ce1c3f4ce091db7c42d61696fc14f27275561ad36e8085 WatchSource:0}: Error finding container 0d1d243a5a746e3969ce1c3f4ce091db7c42d61696fc14f27275561ad36e8085: Status 404 returned error can't find the container with id 0d1d243a5a746e3969ce1c3f4ce091db7c42d61696fc14f27275561ad36e8085 Jun 02 19:06:17.941932 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.941868 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" event={"ID":"880d398f-80b9-431a-82f0-83e751c48f4a","Type":"ContainerStarted","Data":"4c768e98fcd37af1552fa5b19b9742a231e07153254e6278976c749cc9c60b7e"} Jun 02 19:06:17.941932 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.941910 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" event={"ID":"880d398f-80b9-431a-82f0-83e751c48f4a","Type":"ContainerStarted","Data":"0d1d243a5a746e3969ce1c3f4ce091db7c42d61696fc14f27275561ad36e8085"} Jun 02 19:06:17.942361 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.942011 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:17.943092 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.943063 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" event={"ID":"44d5d271-b24c-430c-9bef-8d549be00274","Type":"ContainerStarted","Data":"732475005d496d01248a2be7331c341774ec472ef641e66d7d5ad2c6384552e7"} Jun 02 19:06:17.944581 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.944548 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhm9b" event={"ID":"0be76db0-4f00-4b89-8abb-a5ecb443d90c","Type":"ContainerStarted","Data":"77771a0dbb6c6b5c32328186e290400dbbd8c479f3fe40e7be301a7ec772e639"} Jun 02 19:06:17.944689 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.944579 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhm9b" event={"ID":"0be76db0-4f00-4b89-8abb-a5ecb443d90c","Type":"ContainerStarted","Data":"87bd7a85e0daba0ae6d519dd0a91e0b950443216a757df89fce84adbd74ed2ff"} Jun 02 19:06:17.964443 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:17.964397 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" podStartSLOduration=1.964384195 podStartE2EDuration="1.964384195s" podCreationTimestamp="2026-06-02 19:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:06:17.962223606 +0000 UTC m=+148.962085165" watchObservedRunningTime="2026-06-02 19:06:17.964384195 +0000 UTC m=+148.964245754" Jun 02 19:06:18.949019 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:18.948978 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" event={"ID":"44d5d271-b24c-430c-9bef-8d549be00274","Type":"ContainerStarted","Data":"04078a966717c916e127f2a76e7ee9e1c83f828cdc4dd4d7a5aa5a6d82b70a54"} Jun 02 19:06:18.950692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:18.950662 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhm9b" event={"ID":"0be76db0-4f00-4b89-8abb-a5ecb443d90c","Type":"ContainerStarted","Data":"6911d4058fab84b74e46386c35c327fbe2684cc40a36e41ce537829097175375"} Jun 02 19:06:18.963979 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:18.963929 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-m92pb" podStartSLOduration=1.719199068 podStartE2EDuration="2.9639178s" podCreationTimestamp="2026-06-02 19:06:16 +0000 UTC" firstStartedPulling="2026-06-02 19:06:17.115445754 +0000 UTC m=+148.115307295" lastFinishedPulling="2026-06-02 19:06:18.360164486 +0000 UTC m=+149.360026027" observedRunningTime="2026-06-02 19:06:18.963609162 +0000 UTC m=+149.963470722" watchObservedRunningTime="2026-06-02 19:06:18.9639178 +0000 UTC m=+149.963779359" Jun 02 19:06:19.954841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:19.954754 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xhm9b" event={"ID":"0be76db0-4f00-4b89-8abb-a5ecb443d90c","Type":"ContainerStarted","Data":"097a30b3cd5eb0ac210b0ef6526251b71a3629af68803c776e41729614f1cdbd"} Jun 02 19:06:19.973224 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:19.973184 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xhm9b" podStartSLOduration=1.60382324 podStartE2EDuration="3.973172071s" podCreationTimestamp="2026-06-02 19:06:16 +0000 UTC" firstStartedPulling="2026-06-02 19:06:17.182579265 +0000 UTC m=+148.182440820" lastFinishedPulling="2026-06-02 19:06:19.55192811 +0000 UTC m=+150.551789651" observedRunningTime="2026-06-02 19:06:19.973063392 +0000 UTC m=+150.972924953" watchObservedRunningTime="2026-06-02 19:06:19.973172071 +0000 UTC m=+150.973033647" Jun 02 19:06:21.665766 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:21.665723 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:06:21.668114 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:21.668094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ec4a432-c106-48c8-b39d-da7bfb8be7c4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-trjx2\" (UID: \"1ec4a432-c106-48c8-b39d-da7bfb8be7c4\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:06:21.927652 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:21.927557 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" Jun 02 19:06:22.060490 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:22.060457 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2"] Jun 02 19:06:22.063045 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:22.063005 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec4a432_c106_48c8_b39d_da7bfb8be7c4.slice/crio-ecbb20824e0bbc894e4c99d7aaef798e1d5663fe28b06a27338993582cf18b70 WatchSource:0}: Error finding container ecbb20824e0bbc894e4c99d7aaef798e1d5663fe28b06a27338993582cf18b70: Status 404 returned error can't find the container with id ecbb20824e0bbc894e4c99d7aaef798e1d5663fe28b06a27338993582cf18b70 Jun 02 19:06:22.964137 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:22.964102 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" event={"ID":"1ec4a432-c106-48c8-b39d-da7bfb8be7c4","Type":"ContainerStarted","Data":"ecbb20824e0bbc894e4c99d7aaef798e1d5663fe28b06a27338993582cf18b70"} Jun 02 19:06:24.971231 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:24.971153 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" event={"ID":"1ec4a432-c106-48c8-b39d-da7bfb8be7c4","Type":"ContainerStarted","Data":"7555b85b12ffb7414becf0336191ee8498014be1924184a95211a0abe06b9cde"} Jun 02 19:06:24.991184 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:24.991138 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-trjx2" podStartSLOduration=33.558332487 podStartE2EDuration="35.99112496s" podCreationTimestamp="2026-06-02 19:05:49 +0000 UTC" firstStartedPulling="2026-06-02 19:06:22.064967459 +0000 UTC m=+153.064828997" lastFinishedPulling="2026-06-02 19:06:24.497759928 +0000 UTC m=+155.497621470" observedRunningTime="2026-06-02 19:06:24.990761914 +0000 UTC m=+155.990623475" watchObservedRunningTime="2026-06-02 19:06:24.99112496 +0000 UTC m=+155.990986519" Jun 02 19:06:25.888629 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:25.888585 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dh4qz" podUID="58d3825d-d018-4530-a7b0-f1cb0222ccb3" Jun 02 19:06:25.898814 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:25.898781 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-24gxr" podUID="83878d10-1c10-4444-8f73-1ebee8f4321d" Jun 02 19:06:25.974017 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:25.973987 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dh4qz" Jun 02 19:06:26.573433 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:26.573390 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nm8gp" podUID="59a4d9a4-a1ed-4261-bc1b-db9e96135ff0" Jun 02 19:06:26.669491 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:26.669460 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:30.839726 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:30.839680 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:06:30.840172 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:30.839776 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:06:30.842310 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:30.842276 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58d3825d-d018-4530-a7b0-f1cb0222ccb3-metrics-tls\") pod \"dns-default-dh4qz\" (UID: \"58d3825d-d018-4530-a7b0-f1cb0222ccb3\") " pod="openshift-dns/dns-default-dh4qz" Jun 02 19:06:30.842432 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:30.842329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83878d10-1c10-4444-8f73-1ebee8f4321d-cert\") pod \"ingress-canary-24gxr\" (UID: \"83878d10-1c10-4444-8f73-1ebee8f4321d\") " pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:06:31.078304 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:31.078269 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdn92\"" Jun 02 19:06:31.085684 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:31.085662 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dh4qz" Jun 02 19:06:31.200881 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:31.200859 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dh4qz"] Jun 02 19:06:31.202850 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:31.202813 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d3825d_d018_4530_a7b0_f1cb0222ccb3.slice/crio-f775764f399531b182c8765538abb0570ceea22b3bff37de7c9d496d78e5709c WatchSource:0}: Error finding container f775764f399531b182c8765538abb0570ceea22b3bff37de7c9d496d78e5709c: Status 404 returned error can't find the container with id f775764f399531b182c8765538abb0570ceea22b3bff37de7c9d496d78e5709c Jun 02 19:06:31.990258 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:31.990212 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dh4qz" event={"ID":"58d3825d-d018-4530-a7b0-f1cb0222ccb3","Type":"ContainerStarted","Data":"f775764f399531b182c8765538abb0570ceea22b3bff37de7c9d496d78e5709c"} Jun 02 19:06:32.994371 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:32.994335 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dh4qz" event={"ID":"58d3825d-d018-4530-a7b0-f1cb0222ccb3","Type":"ContainerStarted","Data":"8211dd9bf6116f58960e5aa471f4337c7ca8dd92e925e02c8cf0a5ec3177eaba"} Jun 02 19:06:32.994371 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:32.994373 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dh4qz" event={"ID":"58d3825d-d018-4530-a7b0-f1cb0222ccb3","Type":"ContainerStarted","Data":"c52d6bd82460e1a2db72f4b11105f89a57dc648a1eef90a6e3b956d536164d64"} Jun 02 19:06:32.994886 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:32.994457 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dh4qz" Jun 02 19:06:33.010887 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.010843 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-dh4qz" podStartSLOduration=129.657239658 podStartE2EDuration="2m11.010828626s" podCreationTimestamp="2026-06-02 19:04:22 +0000 UTC" firstStartedPulling="2026-06-02 19:06:31.204821266 +0000 UTC m=+162.204682804" lastFinishedPulling="2026-06-02 19:06:32.55841023 +0000 UTC m=+163.558271772" observedRunningTime="2026-06-02 19:06:33.010002012 +0000 UTC m=+164.009863571" watchObservedRunningTime="2026-06-02 19:06:33.010828626 +0000 UTC m=+164.010690183" Jun 02 19:06:33.376311 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.376224 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-45ggn"] Jun 02 19:06:33.384529 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.379548 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.384529 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.382777 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 19:06:33.384529 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.383149 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l4cm4\"" Jun 02 19:06:33.384529 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.383787 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 19:06:33.386200 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.386149 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 19:06:33.390603 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.390546 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-45ggn"] Jun 02 19:06:33.412590 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.412562 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pvnjg"] Jun 02 19:06:33.414471 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.414453 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.416797 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.416777 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dnvg8\"" Jun 02 19:06:33.417113 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.417092 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 19:06:33.417218 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.417101 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 19:06:33.417281 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.417232 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 19:06:33.461881 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.461858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.461990 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.461922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.461990 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.461975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5zxc\" (UniqueName: \"kubernetes.io/projected/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-kube-api-access-z5zxc\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.462115 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.462005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.562592 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.562724 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562611 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.562724 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-root\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.562724 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-sys\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.562724 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562715 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.562942 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-metrics-client-ca\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.562942 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-tls\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.562942 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-wtmp\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.562942 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562925 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5zxc\" (UniqueName: \"kubernetes.io/projected/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-kube-api-access-z5zxc\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.563174 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.562959 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.563174 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.563003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-textfile\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.563174 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.563058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsdf\" (UniqueName: \"kubernetes.io/projected/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-kube-api-access-hdsdf\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.563174 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.563099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.563451 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.563431 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.565599 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.565576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.565707 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.565678 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.576552 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.576527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5zxc\" (UniqueName: \"kubernetes.io/projected/3bc4af2c-e49a-46f5-8ea9-6881a64d6693-kube-api-access-z5zxc\") pod \"openshift-state-metrics-85658796db-45ggn\" (UID: \"3bc4af2c-e49a-46f5-8ea9-6881a64d6693\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.663918 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.663836 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-tls\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.663918 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.663869 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-wtmp\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.663918 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.663893 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-textfile\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.663925 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsdf\" (UniqueName: \"kubernetes.io/projected/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-kube-api-access-hdsdf\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.663964 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:33.663985 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.663997 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664041 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-root\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-wtmp\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:06:33.664092 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-tls podName:0bc27827-aa32-4d46-9dc7-2dcb47b415ea nodeName:}" failed. No retries permitted until 2026-06-02 19:06:34.164070973 +0000 UTC m=+165.163932513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-tls") pod "node-exporter-pvnjg" (UID: "0bc27827-aa32-4d46-9dc7-2dcb47b415ea") : secret "node-exporter-tls" not found Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-root\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664262 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664225 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-sys\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-textfile\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664271 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-metrics-client-ca\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-sys\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.664921 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.664817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-metrics-client-ca\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.666616 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.666595 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.673113 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.673083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsdf\" (UniqueName: \"kubernetes.io/projected/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-kube-api-access-hdsdf\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:33.698787 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.698766 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" Jun 02 19:06:33.793786 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.793756 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-vnpvr"] Jun 02 19:06:33.796837 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.796817 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:33.800841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.800255 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-94jnd\"" Jun 02 19:06:33.800841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.800514 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 19:06:33.800841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.800557 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 19:06:33.806266 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.806230 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-vnpvr"] Jun 02 19:06:33.838311 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.838287 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-45ggn"] Jun 02 19:06:33.841046 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:33.841005 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc4af2c_e49a_46f5_8ea9_6881a64d6693.slice/crio-ca0d80a65c56afb66a68ef226d855fabbb4c7b72d8bf7863f1179f56c82e467f WatchSource:0}: Error finding container ca0d80a65c56afb66a68ef226d855fabbb4c7b72d8bf7863f1179f56c82e467f: Status 404 returned error can't find the container with id ca0d80a65c56afb66a68ef226d855fabbb4c7b72d8bf7863f1179f56c82e467f Jun 02 19:06:33.967436 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.967406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqbr7\" (UniqueName: \"kubernetes.io/projected/0f294d6c-bf80-4b59-96a4-477204b0d4e6-kube-api-access-kqbr7\") pod \"downloads-c65b8dc4b-vnpvr\" (UID: \"0f294d6c-bf80-4b59-96a4-477204b0d4e6\") " pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:33.998240 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.998213 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" event={"ID":"3bc4af2c-e49a-46f5-8ea9-6881a64d6693","Type":"ContainerStarted","Data":"1a93cd7c8ece342fb9c215a38e0acaa501163e3efc9a1d9e720519c53dafd0f9"} Jun 02 19:06:33.998610 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.998249 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" event={"ID":"3bc4af2c-e49a-46f5-8ea9-6881a64d6693","Type":"ContainerStarted","Data":"ad523eb7be25068bd2b917a530f5d9ecb919adf85ffcca165163bd1b080e2892"} Jun 02 19:06:33.998610 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:33.998265 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" event={"ID":"3bc4af2c-e49a-46f5-8ea9-6881a64d6693","Type":"ContainerStarted","Data":"ca0d80a65c56afb66a68ef226d855fabbb4c7b72d8bf7863f1179f56c82e467f"} Jun 02 19:06:34.068350 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.068318 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqbr7\" (UniqueName: \"kubernetes.io/projected/0f294d6c-bf80-4b59-96a4-477204b0d4e6-kube-api-access-kqbr7\") pod \"downloads-c65b8dc4b-vnpvr\" (UID: \"0f294d6c-bf80-4b59-96a4-477204b0d4e6\") " pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:34.081863 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.081842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqbr7\" (UniqueName: \"kubernetes.io/projected/0f294d6c-bf80-4b59-96a4-477204b0d4e6-kube-api-access-kqbr7\") pod \"downloads-c65b8dc4b-vnpvr\" (UID: \"0f294d6c-bf80-4b59-96a4-477204b0d4e6\") " pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:34.110686 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.110661 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:34.169640 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.169602 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-tls\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:34.171716 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.171692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bc27827-aa32-4d46-9dc7-2dcb47b415ea-node-exporter-tls\") pod \"node-exporter-pvnjg\" (UID: \"0bc27827-aa32-4d46-9dc7-2dcb47b415ea\") " pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:34.229619 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.229596 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-vnpvr"] Jun 02 19:06:34.231905 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:34.231879 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f294d6c_bf80_4b59_96a4_477204b0d4e6.slice/crio-ed3575c43db5f67a8ddc6faa89b216c959b00aeab97edb93da9f7761004af10f WatchSource:0}: Error finding container ed3575c43db5f67a8ddc6faa89b216c959b00aeab97edb93da9f7761004af10f: Status 404 returned error can't find the container with id ed3575c43db5f67a8ddc6faa89b216c959b00aeab97edb93da9f7761004af10f Jun 02 19:06:34.324920 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:34.324806 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvnjg" Jun 02 19:06:34.340015 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:34.339986 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc27827_aa32_4d46_9dc7_2dcb47b415ea.slice/crio-97fcc4d0c732e12b497203979c02ae087a88a96cca1f55d21e2af875809ee2ef WatchSource:0}: Error finding container 97fcc4d0c732e12b497203979c02ae087a88a96cca1f55d21e2af875809ee2ef: Status 404 returned error can't find the container with id 97fcc4d0c732e12b497203979c02ae087a88a96cca1f55d21e2af875809ee2ef Jun 02 19:06:35.004095 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:35.004056 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvnjg" event={"ID":"0bc27827-aa32-4d46-9dc7-2dcb47b415ea","Type":"ContainerStarted","Data":"97fcc4d0c732e12b497203979c02ae087a88a96cca1f55d21e2af875809ee2ef"} Jun 02 19:06:35.005540 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:35.005511 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-vnpvr" event={"ID":"0f294d6c-bf80-4b59-96a4-477204b0d4e6","Type":"ContainerStarted","Data":"ed3575c43db5f67a8ddc6faa89b216c959b00aeab97edb93da9f7761004af10f"} Jun 02 19:06:36.010044 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:36.010002 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" event={"ID":"3bc4af2c-e49a-46f5-8ea9-6881a64d6693","Type":"ContainerStarted","Data":"6dc271382892e11ab5459d7cdaaa2546c556f0439b32ecb6cc84531b1acf302a"} Jun 02 19:06:36.011407 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:36.011383 2573 generic.go:358] "Generic (PLEG): container finished" podID="0bc27827-aa32-4d46-9dc7-2dcb47b415ea" containerID="abbda6181d36ab1bd1f73f126ef2cf14ee5d8ee5cc01752fbcd62598a1e3a64b" exitCode=0 Jun 02 19:06:36.011513 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:36.011445 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvnjg" event={"ID":"0bc27827-aa32-4d46-9dc7-2dcb47b415ea","Type":"ContainerDied","Data":"abbda6181d36ab1bd1f73f126ef2cf14ee5d8ee5cc01752fbcd62598a1e3a64b"} Jun 02 19:06:36.029300 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:36.029261 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-45ggn" podStartSLOduration=1.9255686239999998 podStartE2EDuration="3.02924901s" podCreationTimestamp="2026-06-02 19:06:33 +0000 UTC" firstStartedPulling="2026-06-02 19:06:33.955669511 +0000 UTC m=+164.955531052" lastFinishedPulling="2026-06-02 19:06:35.059349888 +0000 UTC m=+166.059211438" observedRunningTime="2026-06-02 19:06:36.027656336 +0000 UTC m=+167.027517896" watchObservedRunningTime="2026-06-02 19:06:36.02924901 +0000 UTC m=+167.029110569" Jun 02 19:06:37.017875 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:37.017772 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvnjg" event={"ID":"0bc27827-aa32-4d46-9dc7-2dcb47b415ea","Type":"ContainerStarted","Data":"915d1367edf79aad0646df2c0b66c04063e409cba73be5f71ed94c4174a7ac85"} Jun 02 19:06:37.017875 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:37.017825 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvnjg" event={"ID":"0bc27827-aa32-4d46-9dc7-2dcb47b415ea","Type":"ContainerStarted","Data":"70eff1157437d6bd7548de8fd4bc0a388d3b586823a36a6c0eb5547226ad5b1d"} Jun 02 19:06:37.048771 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:37.048722 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pvnjg" podStartSLOduration=2.840104495 podStartE2EDuration="4.048708527s" podCreationTimestamp="2026-06-02 19:06:33 +0000 UTC" firstStartedPulling="2026-06-02 19:06:34.342213959 +0000 UTC m=+165.342075497" lastFinishedPulling="2026-06-02 19:06:35.550817987 +0000 UTC m=+166.550679529" observedRunningTime="2026-06-02 19:06:37.047731531 +0000 UTC m=+168.047593090" watchObservedRunningTime="2026-06-02 19:06:37.048708527 +0000 UTC m=+168.048570087" Jun 02 19:06:37.546378 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:37.546346 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:06:38.546312 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.546274 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:06:38.548988 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.548965 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljpzl\"" Jun 02 19:06:38.557116 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.557094 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24gxr" Jun 02 19:06:38.594839 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.594796 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-58cc9d4867-8gdn8"] Jun 02 19:06:38.599434 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.599409 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.602194 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.602167 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 19:06:38.602320 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.602268 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hh2vt\"" Jun 02 19:06:38.602320 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.602275 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 19:06:38.602421 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.602393 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 19:06:38.602472 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.602428 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 19:06:38.602627 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.602603 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 19:06:38.609258 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.609223 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 19:06:38.609990 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.609944 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58cc9d4867-8gdn8"] Jun 02 19:06:38.703392 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.703348 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24gxr"] Jun 02 19:06:38.705875 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:38.705832 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83878d10_1c10_4444_8f73_1ebee8f4321d.slice/crio-84d81b5c62307e6ca2f387d36a055be407e29591f7fdc94a022c16e73ae773d5 WatchSource:0}: Error finding container 84d81b5c62307e6ca2f387d36a055be407e29591f7fdc94a022c16e73ae773d5: Status 404 returned error can't find the container with id 84d81b5c62307e6ca2f387d36a055be407e29591f7fdc94a022c16e73ae773d5 Jun 02 19:06:38.712096 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntjx\" (UniqueName: \"kubernetes.io/projected/d3648b52-1a51-4653-96c3-ac465e2cc34d-kube-api-access-8ntjx\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712239 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-secret-telemeter-client\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712239 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712239 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-serving-certs-ca-bundle\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712318 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-federate-client-tls\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-telemeter-client-tls\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.712611 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.712504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-metrics-client-ca\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813461 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813384 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-telemeter-client-tls\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813461 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813440 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813704 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813470 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-metrics-client-ca\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813704 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813495 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntjx\" (UniqueName: \"kubernetes.io/projected/d3648b52-1a51-4653-96c3-ac465e2cc34d-kube-api-access-8ntjx\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813704 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813539 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-secret-telemeter-client\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813704 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813567 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.813982 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.813951 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-serving-certs-ca-bundle\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.814076 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.814009 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-federate-client-tls\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.814507 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.814422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-metrics-client-ca\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.814507 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.814475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.814699 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.814672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3648b52-1a51-4653-96c3-ac465e2cc34d-serving-certs-ca-bundle\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.816392 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.816345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.816564 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.816516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-secret-telemeter-client\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.816737 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.816712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-telemeter-client-tls\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.816911 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.816892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3648b52-1a51-4653-96c3-ac465e2cc34d-federate-client-tls\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.822438 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.822409 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntjx\" (UniqueName: \"kubernetes.io/projected/d3648b52-1a51-4653-96c3-ac465e2cc34d-kube-api-access-8ntjx\") pod \"telemeter-client-58cc9d4867-8gdn8\" (UID: \"d3648b52-1a51-4653-96c3-ac465e2cc34d\") " pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.917291 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.917262 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" Jun 02 19:06:38.955308 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:38.955210 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-595fffd55b-hjrxk" Jun 02 19:06:39.025923 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.025884 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24gxr" event={"ID":"83878d10-1c10-4444-8f73-1ebee8f4321d","Type":"ContainerStarted","Data":"84d81b5c62307e6ca2f387d36a055be407e29591f7fdc94a022c16e73ae773d5"} Jun 02 19:06:39.068168 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.068144 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58cc9d4867-8gdn8"] Jun 02 19:06:39.071130 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:39.071098 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3648b52_1a51_4653_96c3_ac465e2cc34d.slice/crio-1093191c92e2d37e4333b5cc230db5e16ddb880f355b894d1cbc4051c271a3a4 WatchSource:0}: Error finding container 1093191c92e2d37e4333b5cc230db5e16ddb880f355b894d1cbc4051c271a3a4: Status 404 returned error can't find the container with id 1093191c92e2d37e4333b5cc230db5e16ddb880f355b894d1cbc4051c271a3a4 Jun 02 19:06:39.147102 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.146856 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f5f759bc-75p6c"] Jun 02 19:06:39.150443 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.150417 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.154658 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.154430 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 19:06:39.154658 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.154478 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m5dlq\"" Jun 02 19:06:39.154658 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.154495 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 19:06:39.154658 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.154433 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 19:06:39.155879 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.155709 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 19:06:39.155879 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.155794 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 19:06:39.166692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.166672 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f5f759bc-75p6c"] Jun 02 19:06:39.319696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.319612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-serving-cert\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.319696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.319689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-console-config\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.319927 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.319727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-oauth-config\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.319927 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.319756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-service-ca\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.319927 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.319900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-oauth-serving-cert\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.320109 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.319955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc5b4\" (UniqueName: \"kubernetes.io/projected/0c8e6481-392d-4345-9b93-e402e66b28e8-kube-api-access-lc5b4\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.421306 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.421266 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-serving-cert\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.421479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.421335 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-console-config\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.421479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.421366 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-oauth-config\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.421479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.421390 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-service-ca\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.421479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.421432 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-oauth-serving-cert\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.421893 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.421789 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc5b4\" (UniqueName: \"kubernetes.io/projected/0c8e6481-392d-4345-9b93-e402e66b28e8-kube-api-access-lc5b4\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.422230 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.422179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-service-ca\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.422820 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.422777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-console-config\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.423560 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.423510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-oauth-serving-cert\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.424382 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.424358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-oauth-config\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.424718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.424649 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-serving-cert\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.437575 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.437550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc5b4\" (UniqueName: \"kubernetes.io/projected/0c8e6481-392d-4345-9b93-e402e66b28e8-kube-api-access-lc5b4\") pod \"console-74f5f759bc-75p6c\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.463297 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.463228 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:39.626616 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.626571 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f5f759bc-75p6c"] Jun 02 19:06:39.626955 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:39.626920 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8e6481_392d_4345_9b93_e402e66b28e8.slice/crio-ab9766020f8f6d47289c3d6eddc388a03d87abf596b8d82f83e93b58b3c723e5 WatchSource:0}: Error finding container ab9766020f8f6d47289c3d6eddc388a03d87abf596b8d82f83e93b58b3c723e5: Status 404 returned error can't find the container with id ab9766020f8f6d47289c3d6eddc388a03d87abf596b8d82f83e93b58b3c723e5 Jun 02 19:06:39.646936 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.646912 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:06:39.652281 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.652259 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.654994 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.654973 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 19:06:39.655303 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655279 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 19:06:39.655420 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655401 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 19:06:39.655530 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655514 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655746 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655780 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655783 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655844 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655863 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655886 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 19:06:39.656052 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.655749 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fb2hrdduhavdq\"" Jun 02 19:06:39.656425 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.656122 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jwdfr\"" Jun 02 19:06:39.656425 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.656125 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 19:06:39.656425 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.656248 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 19:06:39.658493 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.658475 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 19:06:39.667611 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.667588 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:06:39.824654 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.824845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.824845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.824845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.824845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.824845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-config\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.824976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825103 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825576 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825576 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825576 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrqnx\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-kube-api-access-rrqnx\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.825576 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.825269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926584 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926503 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926584 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926568 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926792 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926604 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926792 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926637 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926792 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926685 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926792 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926714 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.926792 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926742 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-config\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926797 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926823 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926850 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926874 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926899 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926928 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926952 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.926980 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.927014 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927488 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.927066 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.927488 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.927091 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrqnx\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-kube-api-access-rrqnx\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.928754 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.928401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.928754 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.928642 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.931997 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.931446 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.931997 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.931911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.932229 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.932210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.933525 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.933977 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934048 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934598 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934982 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934746 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.934982 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.934885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.935273 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.935222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-config\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.936619 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.936597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.937115 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.937094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.937795 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.937775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrqnx\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-kube-api-access-rrqnx\") pod \"prometheus-k8s-0\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:39.965957 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:39.965932 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:06:40.030766 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:40.030729 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f5f759bc-75p6c" event={"ID":"0c8e6481-392d-4345-9b93-e402e66b28e8","Type":"ContainerStarted","Data":"ab9766020f8f6d47289c3d6eddc388a03d87abf596b8d82f83e93b58b3c723e5"} Jun 02 19:06:40.031954 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:40.031927 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" event={"ID":"d3648b52-1a51-4653-96c3-ac465e2cc34d","Type":"ContainerStarted","Data":"1093191c92e2d37e4333b5cc230db5e16ddb880f355b894d1cbc4051c271a3a4"} Jun 02 19:06:40.576304 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:40.576279 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:06:40.578075 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:06:40.578047 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb321aa2f_54d8_4975_a904_9a90d18dff4f.slice/crio-3fac5004a9881d57c483ca6d7c9320adf06038b25170183ca0e4a9b817c37fce WatchSource:0}: Error finding container 3fac5004a9881d57c483ca6d7c9320adf06038b25170183ca0e4a9b817c37fce: Status 404 returned error can't find the container with id 3fac5004a9881d57c483ca6d7c9320adf06038b25170183ca0e4a9b817c37fce Jun 02 19:06:41.038669 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:41.038636 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24gxr" event={"ID":"83878d10-1c10-4444-8f73-1ebee8f4321d","Type":"ContainerStarted","Data":"2efa20894abca8ba578aa4f3fd97a0026280abc602c67b89e9de77cd7c104f5d"} Jun 02 19:06:41.040193 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:41.040162 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"3fac5004a9881d57c483ca6d7c9320adf06038b25170183ca0e4a9b817c37fce"} Jun 02 19:06:41.055426 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:41.055376 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-24gxr" podStartSLOduration=137.284134223 podStartE2EDuration="2m19.055361722s" podCreationTimestamp="2026-06-02 19:04:22 +0000 UTC" firstStartedPulling="2026-06-02 19:06:38.708320535 +0000 UTC m=+169.708182086" lastFinishedPulling="2026-06-02 19:06:40.479548033 +0000 UTC m=+171.479409585" observedRunningTime="2026-06-02 19:06:41.054628309 +0000 UTC m=+172.054489868" watchObservedRunningTime="2026-06-02 19:06:41.055361722 +0000 UTC m=+172.055223284" Jun 02 19:06:41.688247 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:41.688009 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" podUID="343ba68a-f7e3-44a1-8b6a-4a1016ff2246" containerName="registry" containerID="cri-o://7bcc512fbdaf4b01aeb179e2627826b36d18daf28ea611efee58d41f3dad65d9" gracePeriod=30 Jun 02 19:06:42.045773 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:42.045737 2573 generic.go:358] "Generic (PLEG): container finished" podID="343ba68a-f7e3-44a1-8b6a-4a1016ff2246" containerID="7bcc512fbdaf4b01aeb179e2627826b36d18daf28ea611efee58d41f3dad65d9" exitCode=0 Jun 02 19:06:42.046246 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:42.045962 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" event={"ID":"343ba68a-f7e3-44a1-8b6a-4a1016ff2246","Type":"ContainerDied","Data":"7bcc512fbdaf4b01aeb179e2627826b36d18daf28ea611efee58d41f3dad65d9"} Jun 02 19:06:43.001056 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.000987 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dh4qz" Jun 02 19:06:43.569890 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.569871 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:43.658750 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658691 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-certificates\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.658750 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658741 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.658874 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658802 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-ca-trust-extracted\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.658874 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658845 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-image-registry-private-configuration\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.658965 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658886 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-bound-sa-token\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.658965 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658939 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9tb\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-kube-api-access-nk9tb\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.659113 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.658984 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-installation-pull-secrets\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.659113 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.659008 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-trusted-ca\") pod \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\" (UID: \"343ba68a-f7e3-44a1-8b6a-4a1016ff2246\") " Jun 02 19:06:43.659625 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.659218 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:06:43.659625 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.659376 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-certificates\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.659625 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.659608 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:06:43.661729 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.661699 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-kube-api-access-nk9tb" (OuterVolumeSpecName: "kube-api-access-nk9tb") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "kube-api-access-nk9tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:06:43.662185 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.661848 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:06:43.662278 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.662239 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:06:43.662624 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.662584 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:06:43.663471 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.663439 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:06:43.669447 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.669424 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "343ba68a-f7e3-44a1-8b6a-4a1016ff2246" (UID: "343ba68a-f7e3-44a1-8b6a-4a1016ff2246"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:06:43.760287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760254 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-installation-pull-secrets\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.760287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760281 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-trusted-ca\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.760287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760292 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-registry-tls\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.760468 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760300 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-ca-trust-extracted\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.760468 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760310 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-image-registry-private-configuration\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.760468 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760319 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-bound-sa-token\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:43.760468 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:43.760327 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9tb\" (UniqueName: \"kubernetes.io/projected/343ba68a-f7e3-44a1-8b6a-4a1016ff2246-kube-api-access-nk9tb\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:06:44.053536 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.053445 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" event={"ID":"d3648b52-1a51-4653-96c3-ac465e2cc34d","Type":"ContainerStarted","Data":"a17fecb68f7c00a12162a2f624699e7557c2a8405bcd04c09ef7f5bc8e425718"} Jun 02 19:06:44.053536 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.053486 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" event={"ID":"d3648b52-1a51-4653-96c3-ac465e2cc34d","Type":"ContainerStarted","Data":"8ab64fe9cc584f7dd2d4ff4c9a589486a09b938014b6abdfbb65d54b66d83a0c"} Jun 02 19:06:44.053536 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.053506 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" event={"ID":"d3648b52-1a51-4653-96c3-ac465e2cc34d","Type":"ContainerStarted","Data":"ab2cbc0ef4dfa2d7da308168b40df9face91b2f9a3ff28f865f91ee4fbf141dc"} Jun 02 19:06:44.054779 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.054753 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="83ddb68f7e95036c6c49de58c1bffbe57c39d404850591ce227db18294d471b2" exitCode=0 Jun 02 19:06:44.054891 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.054835 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"83ddb68f7e95036c6c49de58c1bffbe57c39d404850591ce227db18294d471b2"} Jun 02 19:06:44.055940 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.055921 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" Jun 02 19:06:44.056049 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.055925 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6866864d6b-l6rqr" event={"ID":"343ba68a-f7e3-44a1-8b6a-4a1016ff2246","Type":"ContainerDied","Data":"b1288791c65b4586816dc67bf41263e67ee4fd1082efedf3b09d74c643997b60"} Jun 02 19:06:44.056127 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.056061 2573 scope.go:117] "RemoveContainer" containerID="7bcc512fbdaf4b01aeb179e2627826b36d18daf28ea611efee58d41f3dad65d9" Jun 02 19:06:44.057306 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.057280 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f5f759bc-75p6c" event={"ID":"0c8e6481-392d-4345-9b93-e402e66b28e8","Type":"ContainerStarted","Data":"0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa"} Jun 02 19:06:44.076136 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.076097 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-58cc9d4867-8gdn8" podStartSLOduration=1.593125717 podStartE2EDuration="6.076085755s" podCreationTimestamp="2026-06-02 19:06:38 +0000 UTC" firstStartedPulling="2026-06-02 19:06:39.073122264 +0000 UTC m=+170.072983805" lastFinishedPulling="2026-06-02 19:06:43.556082305 +0000 UTC m=+174.555943843" observedRunningTime="2026-06-02 19:06:44.073731671 +0000 UTC m=+175.073593232" watchObservedRunningTime="2026-06-02 19:06:44.076085755 +0000 UTC m=+175.075947314" Jun 02 19:06:44.090213 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.090168 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74f5f759bc-75p6c" podStartSLOduration=1.120984852 podStartE2EDuration="5.090155888s" podCreationTimestamp="2026-06-02 19:06:39 +0000 UTC" firstStartedPulling="2026-06-02 19:06:39.629104289 +0000 UTC m=+170.628965830" lastFinishedPulling="2026-06-02 19:06:43.598275312 +0000 UTC m=+174.598136866" observedRunningTime="2026-06-02 19:06:44.089172486 +0000 UTC m=+175.089034070" watchObservedRunningTime="2026-06-02 19:06:44.090155888 +0000 UTC m=+175.090017447" Jun 02 19:06:44.132327 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.132297 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6866864d6b-l6rqr"] Jun 02 19:06:44.136361 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:44.136341 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6866864d6b-l6rqr"] Jun 02 19:06:45.550590 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:45.550552 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="343ba68a-f7e3-44a1-8b6a-4a1016ff2246" path="/var/lib/kubelet/pods/343ba68a-f7e3-44a1-8b6a-4a1016ff2246/volumes" Jun 02 19:06:49.463537 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:49.463508 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:49.463921 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:49.463543 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:49.469126 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:49.469105 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:50.081551 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:50.081516 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:06:54.091390 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.091348 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"7bf248cb74f8303d33c54fb962cabdc06932b0c942d8802d71c89daa1a81f405"} Jun 02 19:06:54.091798 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.091403 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"67b7f57ad3b8c2508c6fbf4140da28cfa361c6a60e3448974fe25d5ad44dd563"} Jun 02 19:06:54.092918 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.092888 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-vnpvr" event={"ID":"0f294d6c-bf80-4b59-96a4-477204b0d4e6","Type":"ContainerStarted","Data":"5c00a5cc1480414fb44a12a2a05391d95276c2d87282bca4430918cc308bfbf4"} Jun 02 19:06:54.093197 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.093154 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:54.094466 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.094444 2573 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-vnpvr container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body= Jun 02 19:06:54.094569 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.094490 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-vnpvr" podUID="0f294d6c-bf80-4b59-96a4-477204b0d4e6" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" Jun 02 19:06:54.110766 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.110724 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-vnpvr" podStartSLOduration=1.340545044 podStartE2EDuration="21.110711988s" podCreationTimestamp="2026-06-02 19:06:33 +0000 UTC" firstStartedPulling="2026-06-02 19:06:34.233714748 +0000 UTC m=+165.233576286" lastFinishedPulling="2026-06-02 19:06:54.003881688 +0000 UTC m=+185.003743230" observedRunningTime="2026-06-02 19:06:54.110408954 +0000 UTC m=+185.110270516" watchObservedRunningTime="2026-06-02 19:06:54.110711988 +0000 UTC m=+185.110573547" Jun 02 19:06:54.111279 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.111257 2573 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-vnpvr container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body= Jun 02 19:06:54.111350 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:54.111304 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-c65b8dc4b-vnpvr" podUID="0f294d6c-bf80-4b59-96a4-477204b0d4e6" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" Jun 02 19:06:55.115540 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:55.115504 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-vnpvr" Jun 02 19:06:57.110414 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:57.110362 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"658cf0cd32922757d2a8ea06e73756649aaa740f9f617316a1d3a0d6c4c95e78"} Jun 02 19:06:57.110414 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:57.110408 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"e63e7de2beaa05df3edaf160d01bc9882af413e9464a19e63c790bae14f12657"} Jun 02 19:06:57.110805 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:57.110423 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"1d04fa81db5f76b561cb12cfa77bbf868b804581eb23f403693fd93909e9dd57"} Jun 02 19:06:57.110805 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:57.110435 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerStarted","Data":"73851ffd5af6325304e827efabc45b4dcd77a27412bff9600b885adf0cff3a6b"} Jun 02 19:06:58.146822 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:58.146757 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.149071345 podStartE2EDuration="19.146739127s" podCreationTimestamp="2026-06-02 19:06:39 +0000 UTC" firstStartedPulling="2026-06-02 19:06:40.580304575 +0000 UTC m=+171.580166114" lastFinishedPulling="2026-06-02 19:06:56.577972358 +0000 UTC m=+187.577833896" observedRunningTime="2026-06-02 19:06:58.144517752 +0000 UTC m=+189.144379313" watchObservedRunningTime="2026-06-02 19:06:58.146739127 +0000 UTC m=+189.146600688" Jun 02 19:06:58.780597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:58.780559 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f5f759bc-75p6c"] Jun 02 19:06:59.966376 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:06:59.966339 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:07:04.132847 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:04.132768 2573 generic.go:358] "Generic (PLEG): container finished" podID="ceaec6f4-e325-4a29-b2df-e77c9b2d0c36" containerID="960a87bf6c1fdabc1cb82abe961bc08b716427059e34c1140d3db12b9b869d03" exitCode=0 Jun 02 19:07:04.132847 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:04.132818 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" event={"ID":"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36","Type":"ContainerDied","Data":"960a87bf6c1fdabc1cb82abe961bc08b716427059e34c1140d3db12b9b869d03"} Jun 02 19:07:04.133328 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:04.133157 2573 scope.go:117] "RemoveContainer" containerID="960a87bf6c1fdabc1cb82abe961bc08b716427059e34c1140d3db12b9b869d03" Jun 02 19:07:05.137646 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:05.137609 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9wsn4" event={"ID":"ceaec6f4-e325-4a29-b2df-e77c9b2d0c36","Type":"ContainerStarted","Data":"5a2a4144102088c714e045b08a39bfac4d32667475d678e9941c148f08f9df51"} Jun 02 19:07:23.805069 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:23.804987 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74f5f759bc-75p6c" podUID="0c8e6481-392d-4345-9b93-e402e66b28e8" containerName="console" containerID="cri-o://0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa" gracePeriod=15 Jun 02 19:07:24.065675 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.065623 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74f5f759bc-75p6c_0c8e6481-392d-4345-9b93-e402e66b28e8/console/0.log" Jun 02 19:07:24.065773 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.065684 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:07:24.190554 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.190532 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74f5f759bc-75p6c_0c8e6481-392d-4345-9b93-e402e66b28e8/console/0.log" Jun 02 19:07:24.190696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.190568 2573 generic.go:358] "Generic (PLEG): container finished" podID="0c8e6481-392d-4345-9b93-e402e66b28e8" containerID="0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa" exitCode=2 Jun 02 19:07:24.190696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.190622 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f5f759bc-75p6c" event={"ID":"0c8e6481-392d-4345-9b93-e402e66b28e8","Type":"ContainerDied","Data":"0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa"} Jun 02 19:07:24.190696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.190630 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f5f759bc-75p6c" Jun 02 19:07:24.190696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.190645 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f5f759bc-75p6c" event={"ID":"0c8e6481-392d-4345-9b93-e402e66b28e8","Type":"ContainerDied","Data":"ab9766020f8f6d47289c3d6eddc388a03d87abf596b8d82f83e93b58b3c723e5"} Jun 02 19:07:24.190696 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.190661 2573 scope.go:117] "RemoveContainer" containerID="0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa" Jun 02 19:07:24.198233 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.198215 2573 scope.go:117] "RemoveContainer" containerID="0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa" Jun 02 19:07:24.198475 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:07:24.198454 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa\": container with ID starting with 0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa not found: ID does not exist" containerID="0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa" Jun 02 19:07:24.198541 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.198483 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa"} err="failed to get container status \"0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa\": rpc error: code = NotFound desc = could not find container \"0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa\": container with ID starting with 0feda2f10be59bf8bab6815051142804b0d80935837634d129b26faa06f3c1fa not found: ID does not exist" Jun 02 19:07:24.222213 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222194 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-serving-cert\") pod \"0c8e6481-392d-4345-9b93-e402e66b28e8\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " Jun 02 19:07:24.222286 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222228 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-oauth-config\") pod \"0c8e6481-392d-4345-9b93-e402e66b28e8\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " Jun 02 19:07:24.222286 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222255 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-oauth-serving-cert\") pod \"0c8e6481-392d-4345-9b93-e402e66b28e8\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " Jun 02 19:07:24.222350 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222282 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc5b4\" (UniqueName: \"kubernetes.io/projected/0c8e6481-392d-4345-9b93-e402e66b28e8-kube-api-access-lc5b4\") pod \"0c8e6481-392d-4345-9b93-e402e66b28e8\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " Jun 02 19:07:24.222350 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222310 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-console-config\") pod \"0c8e6481-392d-4345-9b93-e402e66b28e8\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " Jun 02 19:07:24.222443 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222351 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-service-ca\") pod \"0c8e6481-392d-4345-9b93-e402e66b28e8\" (UID: \"0c8e6481-392d-4345-9b93-e402e66b28e8\") " Jun 02 19:07:24.222708 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222679 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c8e6481-392d-4345-9b93-e402e66b28e8" (UID: "0c8e6481-392d-4345-9b93-e402e66b28e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:24.222812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222726 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c8e6481-392d-4345-9b93-e402e66b28e8" (UID: "0c8e6481-392d-4345-9b93-e402e66b28e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:24.222812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.222737 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-console-config" (OuterVolumeSpecName: "console-config") pod "0c8e6481-392d-4345-9b93-e402e66b28e8" (UID: "0c8e6481-392d-4345-9b93-e402e66b28e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:24.224438 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.224415 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c8e6481-392d-4345-9b93-e402e66b28e8" (UID: "0c8e6481-392d-4345-9b93-e402e66b28e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:24.224518 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.224470 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c8e6481-392d-4345-9b93-e402e66b28e8" (UID: "0c8e6481-392d-4345-9b93-e402e66b28e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:24.224557 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.224524 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8e6481-392d-4345-9b93-e402e66b28e8-kube-api-access-lc5b4" (OuterVolumeSpecName: "kube-api-access-lc5b4") pod "0c8e6481-392d-4345-9b93-e402e66b28e8" (UID: "0c8e6481-392d-4345-9b93-e402e66b28e8"). InnerVolumeSpecName "kube-api-access-lc5b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:24.323324 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.323273 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-serving-cert\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:24.323324 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.323291 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8e6481-392d-4345-9b93-e402e66b28e8-console-oauth-config\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:24.323324 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.323300 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-oauth-serving-cert\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:24.323324 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.323309 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc5b4\" (UniqueName: \"kubernetes.io/projected/0c8e6481-392d-4345-9b93-e402e66b28e8-kube-api-access-lc5b4\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:24.323324 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.323319 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-console-config\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:24.323527 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.323329 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8e6481-392d-4345-9b93-e402e66b28e8-service-ca\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:24.511256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.511230 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f5f759bc-75p6c"] Jun 02 19:07:24.514518 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:24.514494 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f5f759bc-75p6c"] Jun 02 19:07:25.549636 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:25.549604 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c8e6481-392d-4345-9b93-e402e66b28e8" path="/var/lib/kubelet/pods/0c8e6481-392d-4345-9b93-e402e66b28e8/volumes" Jun 02 19:07:39.967161 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:39.967123 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:07:40.039116 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:40.039088 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:07:40.260308 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:40.260285 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:07:58.103093 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103048 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:07:58.103671 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103628 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="prometheus" containerID="cri-o://67b7f57ad3b8c2508c6fbf4140da28cfa361c6a60e3448974fe25d5ad44dd563" gracePeriod=600 Jun 02 19:07:58.103812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103676 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="config-reloader" containerID="cri-o://7bf248cb74f8303d33c54fb962cabdc06932b0c942d8802d71c89daa1a81f405" gracePeriod=600 Jun 02 19:07:58.103812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103676 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="thanos-sidecar" containerID="cri-o://73851ffd5af6325304e827efabc45b4dcd77a27412bff9600b885adf0cff3a6b" gracePeriod=600 Jun 02 19:07:58.103812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103688 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-web" containerID="cri-o://1d04fa81db5f76b561cb12cfa77bbf868b804581eb23f403693fd93909e9dd57" gracePeriod=600 Jun 02 19:07:58.103812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103715 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://658cf0cd32922757d2a8ea06e73756649aaa740f9f617316a1d3a0d6c4c95e78" gracePeriod=600 Jun 02 19:07:58.103812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.103655 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy" containerID="cri-o://e63e7de2beaa05df3edaf160d01bc9882af413e9464a19e63c790bae14f12657" gracePeriod=600 Jun 02 19:07:58.302464 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302434 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="658cf0cd32922757d2a8ea06e73756649aaa740f9f617316a1d3a0d6c4c95e78" exitCode=0 Jun 02 19:07:58.302464 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302461 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="e63e7de2beaa05df3edaf160d01bc9882af413e9464a19e63c790bae14f12657" exitCode=0 Jun 02 19:07:58.302464 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302467 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="73851ffd5af6325304e827efabc45b4dcd77a27412bff9600b885adf0cff3a6b" exitCode=0 Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302476 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="7bf248cb74f8303d33c54fb962cabdc06932b0c942d8802d71c89daa1a81f405" exitCode=0 Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302481 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="67b7f57ad3b8c2508c6fbf4140da28cfa361c6a60e3448974fe25d5ad44dd563" exitCode=0 Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302514 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"658cf0cd32922757d2a8ea06e73756649aaa740f9f617316a1d3a0d6c4c95e78"} Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302550 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"e63e7de2beaa05df3edaf160d01bc9882af413e9464a19e63c790bae14f12657"} Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302560 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"73851ffd5af6325304e827efabc45b4dcd77a27412bff9600b885adf0cff3a6b"} Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302571 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"7bf248cb74f8303d33c54fb962cabdc06932b0c942d8802d71c89daa1a81f405"} Jun 02 19:07:58.302692 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:58.302580 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"67b7f57ad3b8c2508c6fbf4140da28cfa361c6a60e3448974fe25d5ad44dd563"} Jun 02 19:07:59.308990 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.308963 2573 generic.go:358] "Generic (PLEG): container finished" podID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerID="1d04fa81db5f76b561cb12cfa77bbf868b804581eb23f403693fd93909e9dd57" exitCode=0 Jun 02 19:07:59.309329 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.309047 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"1d04fa81db5f76b561cb12cfa77bbf868b804581eb23f403693fd93909e9dd57"} Jun 02 19:07:59.342498 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.342476 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:07:59.421004 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.420940 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-grpc-tls\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421004 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.420983 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-trusted-ca-bundle\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421004 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421005 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-kube-rbac-proxy\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421026 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421095 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421128 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-thanos-prometheus-http-client-file\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421172 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-metrics-client-certs\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421197 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-tls-assets\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421221 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-rulefiles-0\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421254 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-config-out\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421278 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-web-config\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421307 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-config\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421341 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-tls\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421367 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-db\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421404 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrqnx\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-kube-api-access-rrqnx\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421434 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421449 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-kubelet-serving-ca-bundle\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421517 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-metrics-client-ca\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.421602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421562 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-serving-certs-ca-bundle\") pod \"b321aa2f-54d8-4975-a904-9a90d18dff4f\" (UID: \"b321aa2f-54d8-4975-a904-9a90d18dff4f\") " Jun 02 19:07:59.422103 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421763 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:59.422103 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421945 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.422103 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.421965 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.423884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.422464 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:59.423884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.422788 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:59.423884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.423617 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:07:59.423884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.423832 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.424603 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.424573 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.424968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.424943 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.424968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.424954 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:59.425154 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.425044 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-config" (OuterVolumeSpecName: "config") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.425272 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.425247 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:07:59.425568 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.425523 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.426075 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.426023 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.426734 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.426708 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-config-out" (OuterVolumeSpecName: "config-out") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:07:59.426939 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.426923 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-kube-api-access-rrqnx" (OuterVolumeSpecName: "kube-api-access-rrqnx") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "kube-api-access-rrqnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:07:59.427206 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.427181 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.427284 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.427253 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.436215 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.436195 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-web-config" (OuterVolumeSpecName: "web-config") pod "b321aa2f-54d8-4975-a904-9a90d18dff4f" (UID: "b321aa2f-54d8-4975-a904-9a90d18dff4f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:07:59.522300 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522273 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-metrics-client-ca\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522300 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522300 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522315 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-grpc-tls\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522325 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-kube-rbac-proxy\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522334 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522344 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522353 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522361 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-metrics-client-certs\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522370 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-tls-assets\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522383 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522395 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-config-out\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522407 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-web-config\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522417 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-config\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522426 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b321aa2f-54d8-4975-a904-9a90d18dff4f-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522434 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b321aa2f-54d8-4975-a904-9a90d18dff4f-prometheus-k8s-db\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:07:59.522449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:07:59.522447 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrqnx\" (UniqueName: \"kubernetes.io/projected/b321aa2f-54d8-4975-a904-9a90d18dff4f-kube-api-access-rrqnx\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:08:00.314754 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.314715 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b321aa2f-54d8-4975-a904-9a90d18dff4f","Type":"ContainerDied","Data":"3fac5004a9881d57c483ca6d7c9320adf06038b25170183ca0e4a9b817c37fce"} Jun 02 19:08:00.315132 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.314775 2573 scope.go:117] "RemoveContainer" containerID="658cf0cd32922757d2a8ea06e73756649aaa740f9f617316a1d3a0d6c4c95e78" Jun 02 19:08:00.315132 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.314813 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.322210 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.322189 2573 scope.go:117] "RemoveContainer" containerID="e63e7de2beaa05df3edaf160d01bc9882af413e9464a19e63c790bae14f12657" Jun 02 19:08:00.328701 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.328682 2573 scope.go:117] "RemoveContainer" containerID="1d04fa81db5f76b561cb12cfa77bbf868b804581eb23f403693fd93909e9dd57" Jun 02 19:08:00.334988 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.334970 2573 scope.go:117] "RemoveContainer" containerID="73851ffd5af6325304e827efabc45b4dcd77a27412bff9600b885adf0cff3a6b" Jun 02 19:08:00.337274 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.337250 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:08:00.341520 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.341503 2573 scope.go:117] "RemoveContainer" containerID="7bf248cb74f8303d33c54fb962cabdc06932b0c942d8802d71c89daa1a81f405" Jun 02 19:08:00.347719 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.347699 2573 scope.go:117] "RemoveContainer" containerID="67b7f57ad3b8c2508c6fbf4140da28cfa361c6a60e3448974fe25d5ad44dd563" Jun 02 19:08:00.349371 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.349346 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:08:00.354472 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.354457 2573 scope.go:117] "RemoveContainer" containerID="83ddb68f7e95036c6c49de58c1bffbe57c39d404850591ce227db18294d471b2" Jun 02 19:08:00.380571 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380548 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:08:00.380799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380788 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8e6481-392d-4345-9b93-e402e66b28e8" containerName="console" Jun 02 19:08:00.380840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380800 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8e6481-392d-4345-9b93-e402e66b28e8" containerName="console" Jun 02 19:08:00.380840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380812 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="init-config-reloader" Jun 02 19:08:00.380840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380817 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="init-config-reloader" Jun 02 19:08:00.380840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380825 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="343ba68a-f7e3-44a1-8b6a-4a1016ff2246" containerName="registry" Jun 02 19:08:00.380840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380831 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="343ba68a-f7e3-44a1-8b6a-4a1016ff2246" containerName="registry" Jun 02 19:08:00.380840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380837 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380842 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380849 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-web" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380855 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-web" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380862 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="thanos-sidecar" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380867 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="thanos-sidecar" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380875 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="config-reloader" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380880 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="config-reloader" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380885 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-thanos" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380891 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-thanos" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380899 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="prometheus" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380904 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="prometheus" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380945 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="config-reloader" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380952 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380960 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="343ba68a-f7e3-44a1-8b6a-4a1016ff2246" containerName="registry" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380966 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-thanos" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380974 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c8e6481-392d-4345-9b93-e402e66b28e8" containerName="console" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380981 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="thanos-sidecar" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380986 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="prometheus" Jun 02 19:08:00.381002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.380992 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" containerName="kube-rbac-proxy-web" Jun 02 19:08:00.384766 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.384751 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.387517 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.387498 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 19:08:00.387599 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.387539 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 19:08:00.387599 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.387557 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 19:08:00.387921 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.387904 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 19:08:00.388009 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.387979 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 19:08:00.388116 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388013 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 19:08:00.388116 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388101 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 19:08:00.388256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388130 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 19:08:00.388256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388144 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jwdfr\"" Jun 02 19:08:00.388256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388184 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 19:08:00.388256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388244 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fb2hrdduhavdq\"" Jun 02 19:08:00.388479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388357 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 19:08:00.388479 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.388373 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 19:08:00.392707 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.392688 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 19:08:00.394897 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.394880 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 19:08:00.402811 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.402788 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:08:00.530117 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530241 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530241 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530150 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530241 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbkpw\" (UniqueName: \"kubernetes.io/projected/7768acd1-e102-4fcb-ac0e-8601acc6db5f-kube-api-access-nbkpw\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7768acd1-e102-4fcb-ac0e-8601acc6db5f-config-out\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-web-config\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7768acd1-e102-4fcb-ac0e-8601acc6db5f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530410 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-config\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530429 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.530607 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.530509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631128 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631102 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631223 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631154 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631223 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631178 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631223 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631198 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631223 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631215 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbkpw\" (UniqueName: \"kubernetes.io/projected/7768acd1-e102-4fcb-ac0e-8601acc6db5f-kube-api-access-nbkpw\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631236 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631266 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7768acd1-e102-4fcb-ac0e-8601acc6db5f-config-out\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631298 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631337 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-web-config\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631364 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631394 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631421 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7768acd1-e102-4fcb-ac0e-8601acc6db5f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631442 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631470 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631494 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-config\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631533 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631582 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631608 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631980 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.631980 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.632127 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.631981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.632654 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.632332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.634256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.634217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.634779 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.634745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.635894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.635166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-web-config\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.635894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.635402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.635894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.635469 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.635894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.635523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.635894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.635756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.635894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.635844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-config\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.636803 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.636783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7768acd1-e102-4fcb-ac0e-8601acc6db5f-config-out\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.636970 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.636948 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.637137 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.637120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7768acd1-e102-4fcb-ac0e-8601acc6db5f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.637302 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.637281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7768acd1-e102-4fcb-ac0e-8601acc6db5f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.637503 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.637488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7768acd1-e102-4fcb-ac0e-8601acc6db5f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.640280 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.640251 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbkpw\" (UniqueName: \"kubernetes.io/projected/7768acd1-e102-4fcb-ac0e-8601acc6db5f-kube-api-access-nbkpw\") pod \"prometheus-k8s-0\" (UID: \"7768acd1-e102-4fcb-ac0e-8601acc6db5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.694388 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.694368 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:00.826080 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:00.825989 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 19:08:00.828532 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:08:00.828507 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7768acd1_e102_4fcb_ac0e_8601acc6db5f.slice/crio-bad571bbefe0ca27f0dc88fa21cd4455d8f97ebf2132b259c00b134315fb0b67 WatchSource:0}: Error finding container bad571bbefe0ca27f0dc88fa21cd4455d8f97ebf2132b259c00b134315fb0b67: Status 404 returned error can't find the container with id bad571bbefe0ca27f0dc88fa21cd4455d8f97ebf2132b259c00b134315fb0b67 Jun 02 19:08:01.318691 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.318654 2573 generic.go:358] "Generic (PLEG): container finished" podID="7768acd1-e102-4fcb-ac0e-8601acc6db5f" containerID="7143be78cbfb9bf14837c562aab02b4a10dea56f7aa7e3d6259b5d6af675764a" exitCode=0 Jun 02 19:08:01.319156 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.318736 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerDied","Data":"7143be78cbfb9bf14837c562aab02b4a10dea56f7aa7e3d6259b5d6af675764a"} Jun 02 19:08:01.319156 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.318775 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"bad571bbefe0ca27f0dc88fa21cd4455d8f97ebf2132b259c00b134315fb0b67"} Jun 02 19:08:01.337329 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.337307 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:08:01.339526 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.339495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a4d9a4-a1ed-4261-bc1b-db9e96135ff0-metrics-certs\") pod \"network-metrics-daemon-nm8gp\" (UID: \"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0\") " pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:08:01.552453 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.552222 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kj59\"" Jun 02 19:08:01.553536 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.553317 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b321aa2f-54d8-4975-a904-9a90d18dff4f" path="/var/lib/kubelet/pods/b321aa2f-54d8-4975-a904-9a90d18dff4f/volumes" Jun 02 19:08:01.560676 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.560552 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nm8gp" Jun 02 19:08:01.703156 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:01.703123 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nm8gp"] Jun 02 19:08:01.705801 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:08:01.705774 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a4d9a4_a1ed_4261_bc1b_db9e96135ff0.slice/crio-44a35007d7b1b242a1e3581e0032c660db61a472d5c768aecdd89ff77082af21 WatchSource:0}: Error finding container 44a35007d7b1b242a1e3581e0032c660db61a472d5c768aecdd89ff77082af21: Status 404 returned error can't find the container with id 44a35007d7b1b242a1e3581e0032c660db61a472d5c768aecdd89ff77082af21 Jun 02 19:08:02.324010 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.323972 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nm8gp" event={"ID":"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0","Type":"ContainerStarted","Data":"44a35007d7b1b242a1e3581e0032c660db61a472d5c768aecdd89ff77082af21"} Jun 02 19:08:02.326617 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.326588 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"39a2494bf57af489dca4d7111fb7ab97e25dc88aa343c5b4c12016312a857b90"} Jun 02 19:08:02.326617 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.326615 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"075717057b53048bc156d0dfc52547611118ce477f28bda6c945f39505117245"} Jun 02 19:08:02.326767 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.326625 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"f70d666c37a95dfbdbafde0d72d692a68571d29bea00c2cca1970dac9e99011a"} Jun 02 19:08:02.326767 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.326633 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"983c64bea1f89c1e954131bb64f4987e6745a0efdb6056382c48965720518bbd"} Jun 02 19:08:02.326767 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.326642 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"71e956c155df251d180ed91f1702ade1b991427bc15591b653caa34426a93123"} Jun 02 19:08:02.326767 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.326650 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7768acd1-e102-4fcb-ac0e-8601acc6db5f","Type":"ContainerStarted","Data":"fd9e443a82fa1f9cb04e4364e6cd83f8890b02cc29d96bd5766c5a63d5417942"} Jun 02 19:08:02.354784 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:02.354711 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.354690398 podStartE2EDuration="2.354690398s" podCreationTimestamp="2026-06-02 19:08:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:08:02.353078079 +0000 UTC m=+253.352939640" watchObservedRunningTime="2026-06-02 19:08:02.354690398 +0000 UTC m=+253.354551959" Jun 02 19:08:03.331323 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:03.331284 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nm8gp" event={"ID":"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0","Type":"ContainerStarted","Data":"7569ab40a8762e4cfe130f109b21308139cbc74eb250955b77f2dd037e63f03b"} Jun 02 19:08:03.331664 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:03.331331 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nm8gp" event={"ID":"59a4d9a4-a1ed-4261-bc1b-db9e96135ff0","Type":"ContainerStarted","Data":"ab76a9c4d3198732d58115cc2553bd7e185e3507c0c92bed30525709567b7b82"} Jun 02 19:08:03.347380 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:03.347332 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nm8gp" podStartSLOduration=253.220953175 podStartE2EDuration="4m14.347319009s" podCreationTimestamp="2026-06-02 19:03:49 +0000 UTC" firstStartedPulling="2026-06-02 19:08:01.707856629 +0000 UTC m=+252.707718172" lastFinishedPulling="2026-06-02 19:08:02.834222464 +0000 UTC m=+253.834084006" observedRunningTime="2026-06-02 19:08:03.346458891 +0000 UTC m=+254.346320452" watchObservedRunningTime="2026-06-02 19:08:03.347319009 +0000 UTC m=+254.347180569" Jun 02 19:08:05.694515 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:05.694480 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:08:49.434830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:49.434799 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:08:49.435361 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:49.435269 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:08:49.440073 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:08:49.440047 2573 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 19:09:00.695545 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:00.695508 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:09:00.710589 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:00.710566 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:09:01.502573 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:01.502540 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 19:09:50.506088 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.505993 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt"] Jun 02 19:09:50.509191 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.509175 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.511860 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.511834 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:09:50.511964 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.511865 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 19:09:50.511964 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.511896 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-65g24\"" Jun 02 19:09:50.520731 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.520710 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt"] Jun 02 19:09:50.633243 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.633210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d865ed9c-281a-4a7c-8367-1ce15ab73e72-tmp\") pod \"openshift-lws-operator-bfc7f696d-vmnjt\" (UID: \"d865ed9c-281a-4a7c-8367-1ce15ab73e72\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.633398 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.633248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbqqw\" (UniqueName: \"kubernetes.io/projected/d865ed9c-281a-4a7c-8367-1ce15ab73e72-kube-api-access-sbqqw\") pod \"openshift-lws-operator-bfc7f696d-vmnjt\" (UID: \"d865ed9c-281a-4a7c-8367-1ce15ab73e72\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.734389 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.734359 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d865ed9c-281a-4a7c-8367-1ce15ab73e72-tmp\") pod \"openshift-lws-operator-bfc7f696d-vmnjt\" (UID: \"d865ed9c-281a-4a7c-8367-1ce15ab73e72\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.734551 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.734393 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbqqw\" (UniqueName: \"kubernetes.io/projected/d865ed9c-281a-4a7c-8367-1ce15ab73e72-kube-api-access-sbqqw\") pod \"openshift-lws-operator-bfc7f696d-vmnjt\" (UID: \"d865ed9c-281a-4a7c-8367-1ce15ab73e72\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.734754 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.734731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d865ed9c-281a-4a7c-8367-1ce15ab73e72-tmp\") pod \"openshift-lws-operator-bfc7f696d-vmnjt\" (UID: \"d865ed9c-281a-4a7c-8367-1ce15ab73e72\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.744979 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.744955 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbqqw\" (UniqueName: \"kubernetes.io/projected/d865ed9c-281a-4a7c-8367-1ce15ab73e72-kube-api-access-sbqqw\") pod \"openshift-lws-operator-bfc7f696d-vmnjt\" (UID: \"d865ed9c-281a-4a7c-8367-1ce15ab73e72\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.829992 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.829937 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" Jun 02 19:09:50.947954 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.947924 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt"] Jun 02 19:09:50.951963 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:09:50.951937 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd865ed9c_281a_4a7c_8367_1ce15ab73e72.slice/crio-d11a4543c0de5d4dc18fa8bb9b083d1e4f20c5372afd7e336a96130eea3e7ca6 WatchSource:0}: Error finding container d11a4543c0de5d4dc18fa8bb9b083d1e4f20c5372afd7e336a96130eea3e7ca6: Status 404 returned error can't find the container with id d11a4543c0de5d4dc18fa8bb9b083d1e4f20c5372afd7e336a96130eea3e7ca6 Jun 02 19:09:50.953845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:50.953827 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:09:51.620374 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:51.620339 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" event={"ID":"d865ed9c-281a-4a7c-8367-1ce15ab73e72","Type":"ContainerStarted","Data":"d11a4543c0de5d4dc18fa8bb9b083d1e4f20c5372afd7e336a96130eea3e7ca6"} Jun 02 19:09:54.630112 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:54.630077 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" event={"ID":"d865ed9c-281a-4a7c-8367-1ce15ab73e72","Type":"ContainerStarted","Data":"c3386fe2c64fd20270568d023916a3ceddefbf2a87eb34ff3041ee0e14838b9c"} Jun 02 19:09:54.656003 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:09:54.655962 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vmnjt" podStartSLOduration=1.765075226 podStartE2EDuration="4.655949086s" podCreationTimestamp="2026-06-02 19:09:50 +0000 UTC" firstStartedPulling="2026-06-02 19:09:50.953948993 +0000 UTC m=+361.953810531" lastFinishedPulling="2026-06-02 19:09:53.844822853 +0000 UTC m=+364.844684391" observedRunningTime="2026-06-02 19:09:54.653987356 +0000 UTC m=+365.653848916" watchObservedRunningTime="2026-06-02 19:09:54.655949086 +0000 UTC m=+365.655810648" Jun 02 19:10:09.943170 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.943137 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp"] Jun 02 19:10:09.946715 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.946694 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:09.950766 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.950745 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 19:10:09.950873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.950770 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5vvfd\"" Jun 02 19:10:09.950873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.950775 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 19:10:09.950873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.950796 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 19:10:09.956054 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.956018 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp"] Jun 02 19:10:09.994999 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.994972 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vx4v\" (UniqueName: \"kubernetes.io/projected/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-kube-api-access-5vx4v\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:09.995136 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.995051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-cert\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:09.995136 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.995107 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-metrics-cert\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:09.995136 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:09.995135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-manager-config\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.095483 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.095449 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vx4v\" (UniqueName: \"kubernetes.io/projected/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-kube-api-access-5vx4v\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.095637 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.095503 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-cert\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.095637 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.095530 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-metrics-cert\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.095637 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.095552 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-manager-config\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.096366 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.096344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-manager-config\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.097908 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.097887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-cert\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.098043 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.097993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-metrics-cert\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.104971 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.104947 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vx4v\" (UniqueName: \"kubernetes.io/projected/eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf-kube-api-access-5vx4v\") pod \"lws-controller-manager-686947f9c6-24jdp\" (UID: \"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf\") " pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.255855 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.255825 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:10.396475 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.396450 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp"] Jun 02 19:10:10.398555 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:10:10.398526 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb17ec09_ced4_42b3_b8a7_1004a1cfe2cf.slice/crio-579ea8a290f5bc17747e4ba16b74a38f5aa5b5ce6b74613a149c857574b48388 WatchSource:0}: Error finding container 579ea8a290f5bc17747e4ba16b74a38f5aa5b5ce6b74613a149c857574b48388: Status 404 returned error can't find the container with id 579ea8a290f5bc17747e4ba16b74a38f5aa5b5ce6b74613a149c857574b48388 Jun 02 19:10:10.674233 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:10.674163 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" event={"ID":"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf","Type":"ContainerStarted","Data":"579ea8a290f5bc17747e4ba16b74a38f5aa5b5ce6b74613a149c857574b48388"} Jun 02 19:10:12.681908 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:12.681874 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" event={"ID":"eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf","Type":"ContainerStarted","Data":"a420ae00827718524537dbc38320a37df32eb985c5273cb423ba90ba701041c8"} Jun 02 19:10:12.682298 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:12.681990 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:12.724473 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:12.724432 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" podStartSLOduration=2.125104153 podStartE2EDuration="3.724420127s" podCreationTimestamp="2026-06-02 19:10:09 +0000 UTC" firstStartedPulling="2026-06-02 19:10:10.400608928 +0000 UTC m=+381.400470467" lastFinishedPulling="2026-06-02 19:10:11.999924898 +0000 UTC m=+382.999786441" observedRunningTime="2026-06-02 19:10:12.720908152 +0000 UTC m=+383.720769713" watchObservedRunningTime="2026-06-02 19:10:12.724420127 +0000 UTC m=+383.724281687" Jun 02 19:10:14.332719 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.332682 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw"] Jun 02 19:10:14.336008 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.335993 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.340393 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.340368 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 19:10:14.340393 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.340373 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 19:10:14.340788 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.340769 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 19:10:14.340889 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.340825 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xpjmn\"" Jun 02 19:10:14.341392 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.341373 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 19:10:14.354968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.354946 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw"] Jun 02 19:10:14.432137 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.432112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.432245 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.432139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.432245 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.432236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.432315 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.432261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.432353 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.432313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwb6m\" (UniqueName: \"kubernetes.io/projected/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-kube-api-access-mwb6m\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.533519 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.533480 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwb6m\" (UniqueName: \"kubernetes.io/projected/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-kube-api-access-mwb6m\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.533519 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.533523 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.533717 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.533549 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.533717 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.533605 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.533717 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.533621 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.534069 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.534018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-manifests\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.535895 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.535874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-tmp\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.535984 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.535925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.536148 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.536131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-webhook-cert\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.541852 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.541833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwb6m\" (UniqueName: \"kubernetes.io/projected/4d6e646a-432a-4486-82f1-68c6a9cb9ed7-kube-api-access-mwb6m\") pod \"opendatahub-operator-controller-manager-7548bb679b-n4dmw\" (UID: \"4d6e646a-432a-4486-82f1-68c6a9cb9ed7\") " pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.645973 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.645918 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:14.796366 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:14.796331 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw"] Jun 02 19:10:14.798294 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:10:14.798265 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6e646a_432a_4486_82f1_68c6a9cb9ed7.slice/crio-dd4a1e54395587ebb995194ec8658bec5990de7c5623243a917dc21881294b4b WatchSource:0}: Error finding container dd4a1e54395587ebb995194ec8658bec5990de7c5623243a917dc21881294b4b: Status 404 returned error can't find the container with id dd4a1e54395587ebb995194ec8658bec5990de7c5623243a917dc21881294b4b Jun 02 19:10:15.692636 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:15.692601 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" event={"ID":"4d6e646a-432a-4486-82f1-68c6a9cb9ed7","Type":"ContainerStarted","Data":"dd4a1e54395587ebb995194ec8658bec5990de7c5623243a917dc21881294b4b"} Jun 02 19:10:17.700175 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:17.700140 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" event={"ID":"4d6e646a-432a-4486-82f1-68c6a9cb9ed7","Type":"ContainerStarted","Data":"b4b898f60f70dababae48c28e211b8026d3ee1b0fbb8b714c0e3dda2f029fc68"} Jun 02 19:10:18.705307 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:18.705274 2573 generic.go:358] "Generic (PLEG): container finished" podID="4d6e646a-432a-4486-82f1-68c6a9cb9ed7" containerID="b4b898f60f70dababae48c28e211b8026d3ee1b0fbb8b714c0e3dda2f029fc68" exitCode=0 Jun 02 19:10:18.705685 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:18.705335 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" event={"ID":"4d6e646a-432a-4486-82f1-68c6a9cb9ed7","Type":"ContainerDied","Data":"b4b898f60f70dababae48c28e211b8026d3ee1b0fbb8b714c0e3dda2f029fc68"} Jun 02 19:10:19.710609 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:19.710568 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" event={"ID":"4d6e646a-432a-4486-82f1-68c6a9cb9ed7","Type":"ContainerStarted","Data":"b635c11d5b3a06162059a490a72cf8448b174fcb6ac293712165221a669cc898"} Jun 02 19:10:19.711059 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:19.710706 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:19.736550 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:19.736492 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" podStartSLOduration=1.49354889 podStartE2EDuration="5.736475179s" podCreationTimestamp="2026-06-02 19:10:14 +0000 UTC" firstStartedPulling="2026-06-02 19:10:14.800718741 +0000 UTC m=+385.800580282" lastFinishedPulling="2026-06-02 19:10:19.04364503 +0000 UTC m=+390.043506571" observedRunningTime="2026-06-02 19:10:19.733369276 +0000 UTC m=+390.733230836" watchObservedRunningTime="2026-06-02 19:10:19.736475179 +0000 UTC m=+390.736336739" Jun 02 19:10:23.687436 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:23.687409 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-686947f9c6-24jdp" Jun 02 19:10:30.716548 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:30.716517 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7548bb679b-n4dmw" Jun 02 19:10:59.552791 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.552757 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45"] Jun 02 19:10:59.563536 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.563509 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.566930 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.566905 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 19:10:59.567085 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.566981 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8k6c2\"" Jun 02 19:10:59.567283 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.567267 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 19:10:59.567375 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.567301 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 19:10:59.576304 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.576278 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45"] Jun 02 19:10:59.614921 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.614896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615066 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.614953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615066 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.614979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.615065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.615094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.615111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.615136 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.615160 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgp8\" (UniqueName: \"kubernetes.io/projected/065294b8-6c1d-4a9b-aff8-c2bea15828e9-kube-api-access-mkgp8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.615188 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.615185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716439 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716409 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716450 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716466 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716502 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716527 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgp8\" (UniqueName: \"kubernetes.io/projected/065294b8-6c1d-4a9b-aff8-c2bea15828e9-kube-api-access-mkgp8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716560 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716847 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716687 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716847 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716767 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716847 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716800 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.716992 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.716885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.717058 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.717023 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.717115 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.717064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.717168 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.717125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.717495 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.717478 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.718874 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.718855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.719333 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.719316 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.727163 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.727126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgp8\" (UniqueName: \"kubernetes.io/projected/065294b8-6c1d-4a9b-aff8-c2bea15828e9-kube-api-access-mkgp8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.732976 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.732952 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065294b8-6c1d-4a9b-aff8-c2bea15828e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bxnk45\" (UID: \"065294b8-6c1d-4a9b-aff8-c2bea15828e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:10:59.876341 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:10:59.876252 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:11:00.032999 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:00.032975 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45"] Jun 02 19:11:00.035345 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:11:00.035314 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065294b8_6c1d_4a9b_aff8_c2bea15828e9.slice/crio-110fe7afe72f5b5336827d91d4a2becf66ea188f88ebf81b29b25233b716a548 WatchSource:0}: Error finding container 110fe7afe72f5b5336827d91d4a2becf66ea188f88ebf81b29b25233b716a548: Status 404 returned error can't find the container with id 110fe7afe72f5b5336827d91d4a2becf66ea188f88ebf81b29b25233b716a548 Jun 02 19:11:00.847297 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:00.847249 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" event={"ID":"065294b8-6c1d-4a9b-aff8-c2bea15828e9","Type":"ContainerStarted","Data":"110fe7afe72f5b5336827d91d4a2becf66ea188f88ebf81b29b25233b716a548"} Jun 02 19:11:02.772494 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:02.772456 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 19:11:02.772726 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:02.772526 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 19:11:02.772726 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:02.772559 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 19:11:02.854727 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:02.854677 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" event={"ID":"065294b8-6c1d-4a9b-aff8-c2bea15828e9","Type":"ContainerStarted","Data":"1b93d54c446cf3c82998cd0275b50ef850975e8beb095b657ed114100d363fb1"} Jun 02 19:11:02.876687 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:02.876644 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:11:02.879695 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:02.879642 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" podStartSLOduration=1.145930617 podStartE2EDuration="3.879625211s" podCreationTimestamp="2026-06-02 19:10:59 +0000 UTC" firstStartedPulling="2026-06-02 19:11:00.038519133 +0000 UTC m=+431.038380671" lastFinishedPulling="2026-06-02 19:11:02.772213724 +0000 UTC m=+433.772075265" observedRunningTime="2026-06-02 19:11:02.877323051 +0000 UTC m=+433.877184612" watchObservedRunningTime="2026-06-02 19:11:02.879625211 +0000 UTC m=+433.879486772" Jun 02 19:11:03.259791 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.259751 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-76d7946f8d-bpsz6"] Jun 02 19:11:03.263714 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.263683 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.267078 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.267052 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8wlnk\"" Jun 02 19:11:03.267225 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.267103 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 19:11:03.273480 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.273268 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76d7946f8d-bpsz6"] Jun 02 19:11:03.350650 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.350615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ecde934c-0e75-45e7-a1a8-6681dac8f86f-redirect-config\") pod \"dashboard-redirect-76d7946f8d-bpsz6\" (UID: \"ecde934c-0e75-45e7-a1a8-6681dac8f86f\") " pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.350835 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.350689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx4sp\" (UniqueName: \"kubernetes.io/projected/ecde934c-0e75-45e7-a1a8-6681dac8f86f-kube-api-access-nx4sp\") pod \"dashboard-redirect-76d7946f8d-bpsz6\" (UID: \"ecde934c-0e75-45e7-a1a8-6681dac8f86f\") " pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.451956 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.451922 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ecde934c-0e75-45e7-a1a8-6681dac8f86f-redirect-config\") pod \"dashboard-redirect-76d7946f8d-bpsz6\" (UID: \"ecde934c-0e75-45e7-a1a8-6681dac8f86f\") " pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.452154 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.451988 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4sp\" (UniqueName: \"kubernetes.io/projected/ecde934c-0e75-45e7-a1a8-6681dac8f86f-kube-api-access-nx4sp\") pod \"dashboard-redirect-76d7946f8d-bpsz6\" (UID: \"ecde934c-0e75-45e7-a1a8-6681dac8f86f\") " pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.452659 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.452637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ecde934c-0e75-45e7-a1a8-6681dac8f86f-redirect-config\") pod \"dashboard-redirect-76d7946f8d-bpsz6\" (UID: \"ecde934c-0e75-45e7-a1a8-6681dac8f86f\") " pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.461512 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.461483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx4sp\" (UniqueName: \"kubernetes.io/projected/ecde934c-0e75-45e7-a1a8-6681dac8f86f-kube-api-access-nx4sp\") pod \"dashboard-redirect-76d7946f8d-bpsz6\" (UID: \"ecde934c-0e75-45e7-a1a8-6681dac8f86f\") " pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.577701 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.577614 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" Jun 02 19:11:03.700283 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.700259 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76d7946f8d-bpsz6"] Jun 02 19:11:03.702466 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:11:03.702437 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecde934c_0e75_45e7_a1a8_6681dac8f86f.slice/crio-48cea273b08b1f563ef34ef06890154b075ba24d7ea4010bf7588d4f30ca0572 WatchSource:0}: Error finding container 48cea273b08b1f563ef34ef06890154b075ba24d7ea4010bf7588d4f30ca0572: Status 404 returned error can't find the container with id 48cea273b08b1f563ef34ef06890154b075ba24d7ea4010bf7588d4f30ca0572 Jun 02 19:11:03.858478 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.858386 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" event={"ID":"ecde934c-0e75-45e7-a1a8-6681dac8f86f","Type":"ContainerStarted","Data":"48cea273b08b1f563ef34ef06890154b075ba24d7ea4010bf7588d4f30ca0572"} Jun 02 19:11:03.881952 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:03.881921 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:11:04.862705 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:04.862670 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:11:04.863872 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:04.863844 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bxnk45" Jun 02 19:11:05.866536 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:05.866501 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" event={"ID":"ecde934c-0e75-45e7-a1a8-6681dac8f86f","Type":"ContainerStarted","Data":"aa96ad097253cf2ed5e667cf87bcd99f4dc21cf0392d1495ce83746762335ebd"} Jun 02 19:11:05.908882 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:05.908838 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-76d7946f8d-bpsz6" podStartSLOduration=0.917662652 podStartE2EDuration="2.908825411s" podCreationTimestamp="2026-06-02 19:11:03 +0000 UTC" firstStartedPulling="2026-06-02 19:11:03.703771569 +0000 UTC m=+434.703633107" lastFinishedPulling="2026-06-02 19:11:05.694934324 +0000 UTC m=+436.694795866" observedRunningTime="2026-06-02 19:11:05.906393 +0000 UTC m=+436.906254560" watchObservedRunningTime="2026-06-02 19:11:05.908825411 +0000 UTC m=+436.908686970" Jun 02 19:11:34.748134 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.748098 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmk6v"] Jun 02 19:11:34.756831 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.756812 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:34.760525 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.760500 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:11:34.760647 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.760587 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d5k67\"" Jun 02 19:11:34.762295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.762271 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:11:34.765409 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.765388 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmk6v"] Jun 02 19:11:34.921767 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.921729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mjfd\" (UniqueName: \"kubernetes.io/projected/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4-kube-api-access-5mjfd\") pod \"kuadrant-operator-catalog-wmk6v\" (UID: \"b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4\") " pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:34.944406 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.944365 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmk6v"] Jun 02 19:11:34.944610 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:11:34.944591 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5mjfd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" podUID="b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4" Jun 02 19:11:34.956508 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.956484 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:34.960866 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:34.960848 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:35.022529 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.022463 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mjfd\" (UniqueName: \"kubernetes.io/projected/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4-kube-api-access-5mjfd\") pod \"kuadrant-operator-catalog-wmk6v\" (UID: \"b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4\") " pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:35.032178 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.032145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mjfd\" (UniqueName: \"kubernetes.io/projected/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4-kube-api-access-5mjfd\") pod \"kuadrant-operator-catalog-wmk6v\" (UID: \"b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4\") " pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:35.153525 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.153494 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hsbs2"] Jun 02 19:11:35.155540 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.155525 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:35.164589 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.164561 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hsbs2"] Jun 02 19:11:35.224248 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.224211 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mjfd\" (UniqueName: \"kubernetes.io/projected/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4-kube-api-access-5mjfd\") pod \"b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4\" (UID: \"b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4\") " Jun 02 19:11:35.226256 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.226225 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4-kube-api-access-5mjfd" (OuterVolumeSpecName: "kube-api-access-5mjfd") pod "b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4" (UID: "b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4"). InnerVolumeSpecName "kube-api-access-5mjfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:11:35.325359 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.325292 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c2lq\" (UniqueName: \"kubernetes.io/projected/0ba57990-52e0-449c-ac7c-1d664ff388b0-kube-api-access-8c2lq\") pod \"kuadrant-operator-catalog-hsbs2\" (UID: \"0ba57990-52e0-449c-ac7c-1d664ff388b0\") " pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:35.325474 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.325361 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mjfd\" (UniqueName: \"kubernetes.io/projected/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4-kube-api-access-5mjfd\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:11:35.426387 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.426349 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c2lq\" (UniqueName: \"kubernetes.io/projected/0ba57990-52e0-449c-ac7c-1d664ff388b0-kube-api-access-8c2lq\") pod \"kuadrant-operator-catalog-hsbs2\" (UID: \"0ba57990-52e0-449c-ac7c-1d664ff388b0\") " pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:35.435225 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.435202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c2lq\" (UniqueName: \"kubernetes.io/projected/0ba57990-52e0-449c-ac7c-1d664ff388b0-kube-api-access-8c2lq\") pod \"kuadrant-operator-catalog-hsbs2\" (UID: \"0ba57990-52e0-449c-ac7c-1d664ff388b0\") " pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:35.471238 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.471201 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:35.602002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.601977 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hsbs2"] Jun 02 19:11:35.604134 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:11:35.604107 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba57990_52e0_449c_ac7c_1d664ff388b0.slice/crio-dc9a965e5a12c4a486ee0cc9aa44763e84281c992935a9b6c01de9ceb1e8e78a WatchSource:0}: Error finding container dc9a965e5a12c4a486ee0cc9aa44763e84281c992935a9b6c01de9ceb1e8e78a: Status 404 returned error can't find the container with id dc9a965e5a12c4a486ee0cc9aa44763e84281c992935a9b6c01de9ceb1e8e78a Jun 02 19:11:35.961012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.960872 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" event={"ID":"0ba57990-52e0-449c-ac7c-1d664ff388b0","Type":"ContainerStarted","Data":"dc9a965e5a12c4a486ee0cc9aa44763e84281c992935a9b6c01de9ceb1e8e78a"} Jun 02 19:11:35.961012 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.960908 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wmk6v" Jun 02 19:11:35.988976 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.988951 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmk6v"] Jun 02 19:11:35.990328 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:35.990308 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmk6v"] Jun 02 19:11:37.551135 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:37.551101 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4" path="/var/lib/kubelet/pods/b2bb17b8-6b26-4e71-b0cd-1f4c367db9b4/volumes" Jun 02 19:11:37.968666 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:37.968632 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" event={"ID":"0ba57990-52e0-449c-ac7c-1d664ff388b0","Type":"ContainerStarted","Data":"8320e1d54d9df9b466f0f6406fc7af775d6a70b703450133ecac5293446e910b"} Jun 02 19:11:37.986139 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:37.986092 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" podStartSLOduration=0.769826494 podStartE2EDuration="2.986080317s" podCreationTimestamp="2026-06-02 19:11:35 +0000 UTC" firstStartedPulling="2026-06-02 19:11:35.605416894 +0000 UTC m=+466.605278431" lastFinishedPulling="2026-06-02 19:11:37.821670713 +0000 UTC m=+468.821532254" observedRunningTime="2026-06-02 19:11:37.984974914 +0000 UTC m=+468.984836474" watchObservedRunningTime="2026-06-02 19:11:37.986080317 +0000 UTC m=+468.985941908" Jun 02 19:11:45.472003 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:45.471966 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:45.472003 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:45.472011 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:45.494584 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:45.494549 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:11:46.014223 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:11:46.014191 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hsbs2" Jun 02 19:12:00.238408 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.238371 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b48f77d86-t8bzj"] Jun 02 19:12:00.241997 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.241980 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.244600 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.244571 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 19:12:00.244806 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.244792 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 19:12:00.244979 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.244956 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 19:12:00.245117 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.245095 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m5dlq\"" Jun 02 19:12:00.245117 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.245105 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 19:12:00.245822 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.245804 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 19:12:00.249375 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.249353 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 19:12:00.250941 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.250921 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b48f77d86-t8bzj"] Jun 02 19:12:00.332893 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.332869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-trusted-ca-bundle\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.333014 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.332902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-oauth-config\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.333014 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.332921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-config\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.333014 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.333000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-serving-cert\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.333199 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.333044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-oauth-serving-cert\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.333199 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.333102 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-service-ca\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.333199 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.333138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz5wd\" (UniqueName: \"kubernetes.io/projected/5ee85d1f-aac6-4094-bf27-b60af9b48350-kube-api-access-vz5wd\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.433725 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433698 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-oauth-config\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.433862 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433729 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-config\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.433862 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433757 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-serving-cert\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.433968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433858 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-oauth-serving-cert\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.433968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433897 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-service-ca\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.433968 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433914 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vz5wd\" (UniqueName: \"kubernetes.io/projected/5ee85d1f-aac6-4094-bf27-b60af9b48350-kube-api-access-vz5wd\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.434128 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.433994 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-trusted-ca-bundle\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.434580 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.434554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-config\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.434580 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.434577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-oauth-serving-cert\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.434741 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.434605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-service-ca\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.434874 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.434855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee85d1f-aac6-4094-bf27-b60af9b48350-trusted-ca-bundle\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.436322 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.436294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-serving-cert\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.436413 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.436371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee85d1f-aac6-4094-bf27-b60af9b48350-console-oauth-config\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.442449 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.442427 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz5wd\" (UniqueName: \"kubernetes.io/projected/5ee85d1f-aac6-4094-bf27-b60af9b48350-kube-api-access-vz5wd\") pod \"console-b48f77d86-t8bzj\" (UID: \"5ee85d1f-aac6-4094-bf27-b60af9b48350\") " pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.553289 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.553224 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:00.677921 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:00.677895 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b48f77d86-t8bzj"] Jun 02 19:12:00.680109 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:12:00.680079 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee85d1f_aac6_4094_bf27_b60af9b48350.slice/crio-645b68a5301d5ca1dd7af50e90e38961ab37a35049020d975811ef9245bdfbee WatchSource:0}: Error finding container 645b68a5301d5ca1dd7af50e90e38961ab37a35049020d975811ef9245bdfbee: Status 404 returned error can't find the container with id 645b68a5301d5ca1dd7af50e90e38961ab37a35049020d975811ef9245bdfbee Jun 02 19:12:01.040236 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:01.040206 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b48f77d86-t8bzj" event={"ID":"5ee85d1f-aac6-4094-bf27-b60af9b48350","Type":"ContainerStarted","Data":"0e50826dc7d88628114fba593c4db08716008b99e6717a7ef313c47cbcf62ce9"} Jun 02 19:12:01.040236 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:01.040240 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b48f77d86-t8bzj" event={"ID":"5ee85d1f-aac6-4094-bf27-b60af9b48350","Type":"ContainerStarted","Data":"645b68a5301d5ca1dd7af50e90e38961ab37a35049020d975811ef9245bdfbee"} Jun 02 19:12:01.060897 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:01.060847 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b48f77d86-t8bzj" podStartSLOduration=1.060835348 podStartE2EDuration="1.060835348s" podCreationTimestamp="2026-06-02 19:12:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:12:01.059099305 +0000 UTC m=+492.058960865" watchObservedRunningTime="2026-06-02 19:12:01.060835348 +0000 UTC m=+492.060696907" Jun 02 19:12:08.527616 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.527579 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8"] Jun 02 19:12:08.530478 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.530461 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.533841 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.533821 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2krs9\"" Jun 02 19:12:08.548650 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.548623 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8"] Jun 02 19:12:08.601558 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.601524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c729c\" (UniqueName: \"kubernetes.io/projected/50ca320a-7ded-41f8-bb3c-e6a84f80b607-kube-api-access-c729c\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.601835 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.601803 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50ca320a-7ded-41f8-bb3c-e6a84f80b607-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.702882 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.702843 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50ca320a-7ded-41f8-bb3c-e6a84f80b607-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.703057 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.702940 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c729c\" (UniqueName: \"kubernetes.io/projected/50ca320a-7ded-41f8-bb3c-e6a84f80b607-kube-api-access-c729c\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.703366 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.703337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50ca320a-7ded-41f8-bb3c-e6a84f80b607-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.712430 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.712407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c729c\" (UniqueName: \"kubernetes.io/projected/50ca320a-7ded-41f8-bb3c-e6a84f80b607-kube-api-access-c729c\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.840932 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.840854 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:08.973730 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:08.973705 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8"] Jun 02 19:12:08.975388 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:12:08.975364 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ca320a_7ded_41f8_bb3c_e6a84f80b607.slice/crio-b9d396f1635c7e15104cc45223d92fd9ac51b5ccd012fe82ba82101910224a8d WatchSource:0}: Error finding container b9d396f1635c7e15104cc45223d92fd9ac51b5ccd012fe82ba82101910224a8d: Status 404 returned error can't find the container with id b9d396f1635c7e15104cc45223d92fd9ac51b5ccd012fe82ba82101910224a8d Jun 02 19:12:09.071333 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:09.071296 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" event={"ID":"50ca320a-7ded-41f8-bb3c-e6a84f80b607","Type":"ContainerStarted","Data":"b9d396f1635c7e15104cc45223d92fd9ac51b5ccd012fe82ba82101910224a8d"} Jun 02 19:12:10.553369 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:10.553334 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:10.553369 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:10.553374 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:10.558799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:10.558772 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:11.081408 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:11.081382 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b48f77d86-t8bzj" Jun 02 19:12:12.620964 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.620922 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-r5b5n"] Jun 02 19:12:12.627289 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.627260 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:12.630163 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.630146 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dbpg5\"" Jun 02 19:12:12.633544 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.633525 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-r5b5n"] Jun 02 19:12:12.738894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.738854 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mkg\" (UniqueName: \"kubernetes.io/projected/10166293-7b90-45cb-a876-a1e4aacd3ec0-kube-api-access-58mkg\") pod \"authorino-operator-657f44b778-r5b5n\" (UID: \"10166293-7b90-45cb-a876-a1e4aacd3ec0\") " pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:12.839833 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.839798 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58mkg\" (UniqueName: \"kubernetes.io/projected/10166293-7b90-45cb-a876-a1e4aacd3ec0-kube-api-access-58mkg\") pod \"authorino-operator-657f44b778-r5b5n\" (UID: \"10166293-7b90-45cb-a876-a1e4aacd3ec0\") " pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:12.852016 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.851984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mkg\" (UniqueName: \"kubernetes.io/projected/10166293-7b90-45cb-a876-a1e4aacd3ec0-kube-api-access-58mkg\") pod \"authorino-operator-657f44b778-r5b5n\" (UID: \"10166293-7b90-45cb-a876-a1e4aacd3ec0\") " pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:12.938987 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:12.938911 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:13.078989 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:13.078959 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-r5b5n"] Jun 02 19:12:14.143288 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:12:14.143243 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10166293_7b90_45cb_a876_a1e4aacd3ec0.slice/crio-54d46121f9f0bd24ebea00af9dd0d287ff687b9f966249f79de8c6d986c14d9e WatchSource:0}: Error finding container 54d46121f9f0bd24ebea00af9dd0d287ff687b9f966249f79de8c6d986c14d9e: Status 404 returned error can't find the container with id 54d46121f9f0bd24ebea00af9dd0d287ff687b9f966249f79de8c6d986c14d9e Jun 02 19:12:15.095340 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:15.095298 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" event={"ID":"50ca320a-7ded-41f8-bb3c-e6a84f80b607","Type":"ContainerStarted","Data":"271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7"} Jun 02 19:12:15.095892 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:15.095404 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:15.102631 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:15.102594 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" event={"ID":"10166293-7b90-45cb-a876-a1e4aacd3ec0","Type":"ContainerStarted","Data":"54d46121f9f0bd24ebea00af9dd0d287ff687b9f966249f79de8c6d986c14d9e"} Jun 02 19:12:15.120906 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:15.120788 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" podStartSLOduration=1.890802562 podStartE2EDuration="7.120772583s" podCreationTimestamp="2026-06-02 19:12:08 +0000 UTC" firstStartedPulling="2026-06-02 19:12:08.977602211 +0000 UTC m=+499.977463762" lastFinishedPulling="2026-06-02 19:12:14.207572243 +0000 UTC m=+505.207433783" observedRunningTime="2026-06-02 19:12:15.11956285 +0000 UTC m=+506.119424400" watchObservedRunningTime="2026-06-02 19:12:15.120772583 +0000 UTC m=+506.120634144" Jun 02 19:12:18.113873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:18.113831 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" event={"ID":"10166293-7b90-45cb-a876-a1e4aacd3ec0","Type":"ContainerStarted","Data":"7776a0a1a4856ffa45a7137f85c73d7ce851a55351e338ce1117985c3d9645bd"} Jun 02 19:12:18.114259 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:18.113915 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:18.134400 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:18.134349 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" podStartSLOduration=3.093612326 podStartE2EDuration="6.134337266s" podCreationTimestamp="2026-06-02 19:12:12 +0000 UTC" firstStartedPulling="2026-06-02 19:12:14.144991991 +0000 UTC m=+505.144853533" lastFinishedPulling="2026-06-02 19:12:17.185716921 +0000 UTC m=+508.185578473" observedRunningTime="2026-06-02 19:12:18.13181656 +0000 UTC m=+509.131678133" watchObservedRunningTime="2026-06-02 19:12:18.134337266 +0000 UTC m=+509.134198825" Jun 02 19:12:26.107848 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:26.107807 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:27.721740 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.721704 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8"] Jun 02 19:12:27.722174 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.721944 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" containerName="manager" containerID="cri-o://271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7" gracePeriod=2 Jun 02 19:12:27.731390 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.731364 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8"] Jun 02 19:12:27.758507 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.758475 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp"] Jun 02 19:12:27.758829 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.758809 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" containerName="manager" Jun 02 19:12:27.758829 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.758824 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" containerName="manager" Jun 02 19:12:27.758956 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.758916 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" containerName="manager" Jun 02 19:12:27.762015 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.761971 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:27.764401 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.764370 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:27.780634 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.780608 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp"] Jun 02 19:12:27.868273 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.868234 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d386763d-e046-4ece-a6d0-c4fdd1c5688b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dc4tp\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:27.868434 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.868289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvp5\" (UniqueName: \"kubernetes.io/projected/d386763d-e046-4ece-a6d0-c4fdd1c5688b-kube-api-access-2hvp5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dc4tp\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:27.957534 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.957511 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:27.959843 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.959817 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:27.969217 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.969195 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d386763d-e046-4ece-a6d0-c4fdd1c5688b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dc4tp\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:27.969315 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.969232 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvp5\" (UniqueName: \"kubernetes.io/projected/d386763d-e046-4ece-a6d0-c4fdd1c5688b-kube-api-access-2hvp5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dc4tp\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:27.969524 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.969505 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d386763d-e046-4ece-a6d0-c4fdd1c5688b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dc4tp\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:27.987535 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:27.987514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvp5\" (UniqueName: \"kubernetes.io/projected/d386763d-e046-4ece-a6d0-c4fdd1c5688b-kube-api-access-2hvp5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-dc4tp\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:28.069954 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.069868 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c729c\" (UniqueName: \"kubernetes.io/projected/50ca320a-7ded-41f8-bb3c-e6a84f80b607-kube-api-access-c729c\") pod \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " Jun 02 19:12:28.069954 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.069911 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50ca320a-7ded-41f8-bb3c-e6a84f80b607-extensions-socket-volume\") pod \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\" (UID: \"50ca320a-7ded-41f8-bb3c-e6a84f80b607\") " Jun 02 19:12:28.070476 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.070453 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50ca320a-7ded-41f8-bb3c-e6a84f80b607-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "50ca320a-7ded-41f8-bb3c-e6a84f80b607" (UID: "50ca320a-7ded-41f8-bb3c-e6a84f80b607"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:12:28.072088 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.072069 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ca320a-7ded-41f8-bb3c-e6a84f80b607-kube-api-access-c729c" (OuterVolumeSpecName: "kube-api-access-c729c") pod "50ca320a-7ded-41f8-bb3c-e6a84f80b607" (UID: "50ca320a-7ded-41f8-bb3c-e6a84f80b607"). InnerVolumeSpecName "kube-api-access-c729c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:12:28.099384 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.099355 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:28.149734 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.149701 2573 generic.go:358] "Generic (PLEG): container finished" podID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" containerID="271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7" exitCode=0 Jun 02 19:12:28.149871 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.149753 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" Jun 02 19:12:28.149871 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.149788 2573 scope.go:117] "RemoveContainer" containerID="271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7" Jun 02 19:12:28.153046 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.152994 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:28.161430 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.161414 2573 scope.go:117] "RemoveContainer" containerID="271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7" Jun 02 19:12:28.161848 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:12:28.161798 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7\": container with ID starting with 271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7 not found: ID does not exist" containerID="271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7" Jun 02 19:12:28.161946 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.161835 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7"} err="failed to get container status \"271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7\": rpc error: code = NotFound desc = could not find container \"271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7\": container with ID starting with 271dc7b8faecc721faf660b73bfde992ed444d4d014bf0fb783dece4abbdd7e7 not found: ID does not exist" Jun 02 19:12:28.164222 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.164201 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:28.170622 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.170599 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c729c\" (UniqueName: \"kubernetes.io/projected/50ca320a-7ded-41f8-bb3c-e6a84f80b607-kube-api-access-c729c\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:12:28.170622 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.170620 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50ca320a-7ded-41f8-bb3c-e6a84f80b607-extensions-socket-volume\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:12:28.226435 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:28.226373 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp"] Jun 02 19:12:28.228816 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:12:28.228784 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd386763d_e046_4ece_a6d0_c4fdd1c5688b.slice/crio-94e7147f9eb9ad18b8a0861955db98f408835985d4d1247ac261270e3047d19d WatchSource:0}: Error finding container 94e7147f9eb9ad18b8a0861955db98f408835985d4d1247ac261270e3047d19d: Status 404 returned error can't find the container with id 94e7147f9eb9ad18b8a0861955db98f408835985d4d1247ac261270e3047d19d Jun 02 19:12:29.118840 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.118804 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-r5b5n" Jun 02 19:12:29.121519 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.121491 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:29.156959 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.156926 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" event={"ID":"d386763d-e046-4ece-a6d0-c4fdd1c5688b","Type":"ContainerStarted","Data":"3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc"} Jun 02 19:12:29.156959 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.156962 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" event={"ID":"d386763d-e046-4ece-a6d0-c4fdd1c5688b","Type":"ContainerStarted","Data":"94e7147f9eb9ad18b8a0861955db98f408835985d4d1247ac261270e3047d19d"} Jun 02 19:12:29.157213 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.157019 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:29.160405 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.160382 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:29.203257 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.203207 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" podStartSLOduration=2.203191597 podStartE2EDuration="2.203191597s" podCreationTimestamp="2026-06-02 19:12:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:12:29.200478258 +0000 UTC m=+520.200339818" watchObservedRunningTime="2026-06-02 19:12:29.203191597 +0000 UTC m=+520.203053157" Jun 02 19:12:29.550492 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.550459 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" path="/var/lib/kubelet/pods/50ca320a-7ded-41f8-bb3c-e6a84f80b607/volumes" Jun 02 19:12:29.551002 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:29.550978 2573 status_manager.go:895] "Failed to get status for pod" podUID="50ca320a-7ded-41f8-bb3c-e6a84f80b607" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2hxp8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2hxp8\" is forbidden: User \"system:node:ip-10-0-137-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-73.ec2.internal' and this object" Jun 02 19:12:40.162216 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:40.162135 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:44.337558 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.337515 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp"] Jun 02 19:12:44.338366 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.337728 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" podUID="d386763d-e046-4ece-a6d0-c4fdd1c5688b" containerName="manager" containerID="cri-o://3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc" gracePeriod=10 Jun 02 19:12:44.584193 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.584169 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:44.609592 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.609528 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hvp5\" (UniqueName: \"kubernetes.io/projected/d386763d-e046-4ece-a6d0-c4fdd1c5688b-kube-api-access-2hvp5\") pod \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " Jun 02 19:12:44.609678 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.609620 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d386763d-e046-4ece-a6d0-c4fdd1c5688b-extensions-socket-volume\") pod \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\" (UID: \"d386763d-e046-4ece-a6d0-c4fdd1c5688b\") " Jun 02 19:12:44.610019 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.609990 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d386763d-e046-4ece-a6d0-c4fdd1c5688b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d386763d-e046-4ece-a6d0-c4fdd1c5688b" (UID: "d386763d-e046-4ece-a6d0-c4fdd1c5688b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:12:44.620082 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.619859 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d386763d-e046-4ece-a6d0-c4fdd1c5688b-kube-api-access-2hvp5" (OuterVolumeSpecName: "kube-api-access-2hvp5") pod "d386763d-e046-4ece-a6d0-c4fdd1c5688b" (UID: "d386763d-e046-4ece-a6d0-c4fdd1c5688b"). InnerVolumeSpecName "kube-api-access-2hvp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:12:44.710803 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.710778 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hvp5\" (UniqueName: \"kubernetes.io/projected/d386763d-e046-4ece-a6d0-c4fdd1c5688b-kube-api-access-2hvp5\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:12:44.710803 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:44.710802 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d386763d-e046-4ece-a6d0-c4fdd1c5688b-extensions-socket-volume\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:12:45.216698 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.216665 2573 generic.go:358] "Generic (PLEG): container finished" podID="d386763d-e046-4ece-a6d0-c4fdd1c5688b" containerID="3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc" exitCode=0 Jun 02 19:12:45.216910 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.216754 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" Jun 02 19:12:45.216910 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.216754 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" event={"ID":"d386763d-e046-4ece-a6d0-c4fdd1c5688b","Type":"ContainerDied","Data":"3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc"} Jun 02 19:12:45.216910 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.216801 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp" event={"ID":"d386763d-e046-4ece-a6d0-c4fdd1c5688b","Type":"ContainerDied","Data":"94e7147f9eb9ad18b8a0861955db98f408835985d4d1247ac261270e3047d19d"} Jun 02 19:12:45.216910 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.216821 2573 scope.go:117] "RemoveContainer" containerID="3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc" Jun 02 19:12:45.225448 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.225431 2573 scope.go:117] "RemoveContainer" containerID="3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc" Jun 02 19:12:45.225701 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:12:45.225683 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc\": container with ID starting with 3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc not found: ID does not exist" containerID="3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc" Jun 02 19:12:45.225757 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.225710 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc"} err="failed to get container status \"3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc\": rpc error: code = NotFound desc = could not find container \"3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc\": container with ID starting with 3506af7b8f3ccacd2a2226656634993610031070412891b511fb40e56d5a9cfc not found: ID does not exist" Jun 02 19:12:45.239740 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.239714 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp"] Jun 02 19:12:45.246738 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.246718 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-dc4tp"] Jun 02 19:12:45.550894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:12:45.550857 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d386763d-e046-4ece-a6d0-c4fdd1c5688b" path="/var/lib/kubelet/pods/d386763d-e046-4ece-a6d0-c4fdd1c5688b/volumes" Jun 02 19:13:00.569558 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.569519 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl"] Jun 02 19:13:00.569929 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.569876 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d386763d-e046-4ece-a6d0-c4fdd1c5688b" containerName="manager" Jun 02 19:13:00.569929 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.569887 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d386763d-e046-4ece-a6d0-c4fdd1c5688b" containerName="manager" Jun 02 19:13:00.569997 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.569953 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="d386763d-e046-4ece-a6d0-c4fdd1c5688b" containerName="manager" Jun 02 19:13:00.574366 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.574345 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.577578 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.577547 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qk2nm\"" Jun 02 19:13:00.589320 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.588774 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl"] Jun 02 19:13:00.658372 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658492 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a11e07-f810-44ce-83b9-f869d9abe557-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658492 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzr64\" (UniqueName: \"kubernetes.io/projected/37a11e07-f810-44ce-83b9-f869d9abe557-kube-api-access-jzr64\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658484 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a11e07-f810-44ce-83b9-f869d9abe557-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658629 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658629 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658694 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a11e07-f810-44ce-83b9-f869d9abe557-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.658694 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.658683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.759746 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759712 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a11e07-f810-44ce-83b9-f869d9abe557-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.759884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759759 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.759884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759803 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.759884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759820 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.759884 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759849 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a11e07-f810-44ce-83b9-f869d9abe557-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760082 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759883 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760082 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759938 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760082 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.759971 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a11e07-f810-44ce-83b9-f869d9abe557-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760082 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.760002 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzr64\" (UniqueName: \"kubernetes.io/projected/37a11e07-f810-44ce-83b9-f869d9abe557-kube-api-access-jzr64\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760346 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.760321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760421 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.760352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760477 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.760435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760568 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.760546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.760824 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.760805 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a11e07-f810-44ce-83b9-f869d9abe557-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.761983 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.761962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a11e07-f810-44ce-83b9-f869d9abe557-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.762203 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.762188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a11e07-f810-44ce-83b9-f869d9abe557-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.768284 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.768264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a11e07-f810-44ce-83b9-f869d9abe557-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.768369 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.768346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzr64\" (UniqueName: \"kubernetes.io/projected/37a11e07-f810-44ce-83b9-f869d9abe557-kube-api-access-jzr64\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-89qsl\" (UID: \"37a11e07-f810-44ce-83b9-f869d9abe557\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:00.889864 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:00.889790 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:01.020148 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.020113 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl"] Jun 02 19:13:01.023489 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:13:01.023462 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a11e07_f810_44ce_83b9_f869d9abe557.slice/crio-cc5950d34f01b9229dd570a8e079dd2b8f333ce80474ac03b46fdcad2b105f58 WatchSource:0}: Error finding container cc5950d34f01b9229dd570a8e079dd2b8f333ce80474ac03b46fdcad2b105f58: Status 404 returned error can't find the container with id cc5950d34f01b9229dd570a8e079dd2b8f333ce80474ac03b46fdcad2b105f58 Jun 02 19:13:01.025623 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.025584 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 19:13:01.025729 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.025658 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 19:13:01.025729 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.025698 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 19:13:01.269338 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.269299 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" event={"ID":"37a11e07-f810-44ce-83b9-f869d9abe557","Type":"ContainerStarted","Data":"d03dbfaf4dde7f16ca9f561ae553171d8221d9ee42c5095cf4a9aa78c4e8b39a"} Jun 02 19:13:01.269338 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.269336 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" event={"ID":"37a11e07-f810-44ce-83b9-f869d9abe557","Type":"ContainerStarted","Data":"cc5950d34f01b9229dd570a8e079dd2b8f333ce80474ac03b46fdcad2b105f58"} Jun 02 19:13:01.306796 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.306735 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" podStartSLOduration=1.306722499 podStartE2EDuration="1.306722499s" podCreationTimestamp="2026-06-02 19:13:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:13:01.303824271 +0000 UTC m=+552.303685852" watchObservedRunningTime="2026-06-02 19:13:01.306722499 +0000 UTC m=+552.306584059" Jun 02 19:13:01.890754 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:01.890705 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:02.894970 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:02.894934 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:03.275835 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:03.275801 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:03.276768 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:03.276751 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-89qsl" Jun 02 19:13:04.808432 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.808400 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:04.810842 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.810825 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:04.813678 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.813655 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g98bw\"" Jun 02 19:13:04.814254 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.814232 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 19:13:04.827677 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.827656 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:04.897671 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.897638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-config-file\") pod \"limitador-limitador-7d549b5b-2w6jx\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:04.897837 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.897700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259sp\" (UniqueName: \"kubernetes.io/projected/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-kube-api-access-259sp\") pod \"limitador-limitador-7d549b5b-2w6jx\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:04.909303 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.909270 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:04.999145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.999108 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-259sp\" (UniqueName: \"kubernetes.io/projected/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-kube-api-access-259sp\") pod \"limitador-limitador-7d549b5b-2w6jx\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:04.999315 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.999204 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-config-file\") pod \"limitador-limitador-7d549b5b-2w6jx\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:04.999746 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:04.999728 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-config-file\") pod \"limitador-limitador-7d549b5b-2w6jx\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:05.007287 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.007267 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-259sp\" (UniqueName: \"kubernetes.io/projected/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-kube-api-access-259sp\") pod \"limitador-limitador-7d549b5b-2w6jx\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:05.121400 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.121315 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:05.247422 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.247354 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:05.250582 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:13:05.250539 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d24c09a_d6eb_4ac8_a533_202f5ddcfd03.slice/crio-7fc0475c5363d356b2b8e953182c394c3460b6a5cda6b3d25731b79346bae959 WatchSource:0}: Error finding container 7fc0475c5363d356b2b8e953182c394c3460b6a5cda6b3d25731b79346bae959: Status 404 returned error can't find the container with id 7fc0475c5363d356b2b8e953182c394c3460b6a5cda6b3d25731b79346bae959 Jun 02 19:13:05.282079 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.282049 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" event={"ID":"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03","Type":"ContainerStarted","Data":"7fc0475c5363d356b2b8e953182c394c3460b6a5cda6b3d25731b79346bae959"} Jun 02 19:13:05.616098 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.616067 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p97h5"] Jun 02 19:13:05.618905 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.618883 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:05.621929 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.621899 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xqqsv\"" Jun 02 19:13:05.632295 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.632261 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p97h5"] Jun 02 19:13:05.706535 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.706503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtnnm\" (UniqueName: \"kubernetes.io/projected/49656962-3f46-449f-a705-481ce92c9fed-kube-api-access-mtnnm\") pod \"authorino-f99f4b5cd-p97h5\" (UID: \"49656962-3f46-449f-a705-481ce92c9fed\") " pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:05.807711 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.807681 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnnm\" (UniqueName: \"kubernetes.io/projected/49656962-3f46-449f-a705-481ce92c9fed-kube-api-access-mtnnm\") pod \"authorino-f99f4b5cd-p97h5\" (UID: \"49656962-3f46-449f-a705-481ce92c9fed\") " pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:05.816389 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.816359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtnnm\" (UniqueName: \"kubernetes.io/projected/49656962-3f46-449f-a705-481ce92c9fed-kube-api-access-mtnnm\") pod \"authorino-f99f4b5cd-p97h5\" (UID: \"49656962-3f46-449f-a705-481ce92c9fed\") " pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:05.928336 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:05.928259 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:06.097997 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:06.097964 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p97h5"] Jun 02 19:13:06.101759 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:13:06.101723 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49656962_3f46_449f_a705_481ce92c9fed.slice/crio-56c763fdeb4edb9577c0fba57438ed35f4a3318454f4b6f1d8895f9f8763425a WatchSource:0}: Error finding container 56c763fdeb4edb9577c0fba57438ed35f4a3318454f4b6f1d8895f9f8763425a: Status 404 returned error can't find the container with id 56c763fdeb4edb9577c0fba57438ed35f4a3318454f4b6f1d8895f9f8763425a Jun 02 19:13:06.286706 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:06.286668 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" event={"ID":"49656962-3f46-449f-a705-481ce92c9fed","Type":"ContainerStarted","Data":"56c763fdeb4edb9577c0fba57438ed35f4a3318454f4b6f1d8895f9f8763425a"} Jun 02 19:13:10.082966 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:10.082933 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p97h5"] Jun 02 19:13:10.304185 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:10.304146 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" event={"ID":"49656962-3f46-449f-a705-481ce92c9fed","Type":"ContainerStarted","Data":"c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8"} Jun 02 19:13:10.305515 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:10.305480 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" event={"ID":"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03","Type":"ContainerStarted","Data":"ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6"} Jun 02 19:13:10.305618 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:10.305607 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:10.319064 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:10.319007 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" podStartSLOduration=1.498141691 podStartE2EDuration="5.318993863s" podCreationTimestamp="2026-06-02 19:13:05 +0000 UTC" firstStartedPulling="2026-06-02 19:13:06.103379729 +0000 UTC m=+557.103241270" lastFinishedPulling="2026-06-02 19:13:09.924231901 +0000 UTC m=+560.924093442" observedRunningTime="2026-06-02 19:13:10.317748973 +0000 UTC m=+561.317610531" watchObservedRunningTime="2026-06-02 19:13:10.318993863 +0000 UTC m=+561.318855423" Jun 02 19:13:10.333876 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:10.333836 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" podStartSLOduration=1.669183731 podStartE2EDuration="6.333824432s" podCreationTimestamp="2026-06-02 19:13:04 +0000 UTC" firstStartedPulling="2026-06-02 19:13:05.252625472 +0000 UTC m=+556.252487010" lastFinishedPulling="2026-06-02 19:13:09.917266168 +0000 UTC m=+560.917127711" observedRunningTime="2026-06-02 19:13:10.332656884 +0000 UTC m=+561.332518443" watchObservedRunningTime="2026-06-02 19:13:10.333824432 +0000 UTC m=+561.333685991" Jun 02 19:13:11.309557 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:11.309481 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" podUID="49656962-3f46-449f-a705-481ce92c9fed" containerName="authorino" containerID="cri-o://c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8" gracePeriod=30 Jun 02 19:13:11.565861 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:11.565805 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:11.681487 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:11.681457 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtnnm\" (UniqueName: \"kubernetes.io/projected/49656962-3f46-449f-a705-481ce92c9fed-kube-api-access-mtnnm\") pod \"49656962-3f46-449f-a705-481ce92c9fed\" (UID: \"49656962-3f46-449f-a705-481ce92c9fed\") " Jun 02 19:13:11.683531 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:11.683498 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49656962-3f46-449f-a705-481ce92c9fed-kube-api-access-mtnnm" (OuterVolumeSpecName: "kube-api-access-mtnnm") pod "49656962-3f46-449f-a705-481ce92c9fed" (UID: "49656962-3f46-449f-a705-481ce92c9fed"). InnerVolumeSpecName "kube-api-access-mtnnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:13:11.783042 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:11.783012 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtnnm\" (UniqueName: \"kubernetes.io/projected/49656962-3f46-449f-a705-481ce92c9fed-kube-api-access-mtnnm\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:13:12.314518 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.314481 2573 generic.go:358] "Generic (PLEG): container finished" podID="49656962-3f46-449f-a705-481ce92c9fed" containerID="c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8" exitCode=0 Jun 02 19:13:12.314907 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.314535 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" Jun 02 19:13:12.314907 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.314564 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" event={"ID":"49656962-3f46-449f-a705-481ce92c9fed","Type":"ContainerDied","Data":"c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8"} Jun 02 19:13:12.314907 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.314602 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p97h5" event={"ID":"49656962-3f46-449f-a705-481ce92c9fed","Type":"ContainerDied","Data":"56c763fdeb4edb9577c0fba57438ed35f4a3318454f4b6f1d8895f9f8763425a"} Jun 02 19:13:12.314907 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.314617 2573 scope.go:117] "RemoveContainer" containerID="c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8" Jun 02 19:13:12.322967 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.322768 2573 scope.go:117] "RemoveContainer" containerID="c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8" Jun 02 19:13:12.323108 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:13:12.323015 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8\": container with ID starting with c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8 not found: ID does not exist" containerID="c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8" Jun 02 19:13:12.323108 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.323062 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8"} err="failed to get container status \"c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8\": rpc error: code = NotFound desc = could not find container \"c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8\": container with ID starting with c64b50e29fc0a3b2df13bbc3651a80b477226f1c8090a8fbf9665574c70796d8 not found: ID does not exist" Jun 02 19:13:12.336132 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.336108 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p97h5"] Jun 02 19:13:12.339755 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:12.339727 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p97h5"] Jun 02 19:13:13.550567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:13.550533 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49656962-3f46-449f-a705-481ce92c9fed" path="/var/lib/kubelet/pods/49656962-3f46-449f-a705-481ce92c9fed/volumes" Jun 02 19:13:21.058243 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.058214 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:21.058793 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.058434 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" podUID="4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" containerName="limitador" containerID="cri-o://ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6" gracePeriod=30 Jun 02 19:13:21.059190 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.059152 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:21.602576 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.602555 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:21.671073 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.670988 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-config-file\") pod \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " Jun 02 19:13:21.671190 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.671083 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-259sp\" (UniqueName: \"kubernetes.io/projected/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-kube-api-access-259sp\") pod \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\" (UID: \"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03\") " Jun 02 19:13:21.671390 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.671370 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-config-file" (OuterVolumeSpecName: "config-file") pod "4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" (UID: "4d24c09a-d6eb-4ac8-a533-202f5ddcfd03"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:13:21.673097 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.673072 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-kube-api-access-259sp" (OuterVolumeSpecName: "kube-api-access-259sp") pod "4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" (UID: "4d24c09a-d6eb-4ac8-a533-202f5ddcfd03"). InnerVolumeSpecName "kube-api-access-259sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:13:21.772178 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.772143 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-259sp\" (UniqueName: \"kubernetes.io/projected/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-kube-api-access-259sp\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:13:21.772178 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:21.772172 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03-config-file\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:13:22.351298 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.351262 2573 generic.go:358] "Generic (PLEG): container finished" podID="4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" containerID="ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6" exitCode=0 Jun 02 19:13:22.351733 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.351314 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" event={"ID":"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03","Type":"ContainerDied","Data":"ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6"} Jun 02 19:13:22.351733 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.351360 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" event={"ID":"4d24c09a-d6eb-4ac8-a533-202f5ddcfd03","Type":"ContainerDied","Data":"7fc0475c5363d356b2b8e953182c394c3460b6a5cda6b3d25731b79346bae959"} Jun 02 19:13:22.351733 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.351383 2573 scope.go:117] "RemoveContainer" containerID="ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6" Jun 02 19:13:22.351733 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.351325 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2w6jx" Jun 02 19:13:22.359789 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.359766 2573 scope.go:117] "RemoveContainer" containerID="ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6" Jun 02 19:13:22.360061 ip-10-0-137-73 kubenswrapper[2573]: E0602 19:13:22.360023 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6\": container with ID starting with ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6 not found: ID does not exist" containerID="ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6" Jun 02 19:13:22.360145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.360072 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6"} err="failed to get container status \"ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6\": rpc error: code = NotFound desc = could not find container \"ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6\": container with ID starting with ecd37f5c5ee7716cf31455c3a9f274966689f4c8757ad98e3ad045018c5414c6 not found: ID does not exist" Jun 02 19:13:22.373538 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.373514 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:22.377853 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:22.377833 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2w6jx"] Jun 02 19:13:23.550676 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:23.550640 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" path="/var/lib/kubelet/pods/4d24c09a-d6eb-4ac8-a533-202f5ddcfd03/volumes" Jun 02 19:13:25.962966 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.962932 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6mk74"] Jun 02 19:13:25.963357 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.963320 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49656962-3f46-449f-a705-481ce92c9fed" containerName="authorino" Jun 02 19:13:25.963357 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.963332 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="49656962-3f46-449f-a705-481ce92c9fed" containerName="authorino" Jun 02 19:13:25.963357 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.963350 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" containerName="limitador" Jun 02 19:13:25.963357 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.963359 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" containerName="limitador" Jun 02 19:13:25.963544 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.963426 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d24c09a-d6eb-4ac8-a533-202f5ddcfd03" containerName="limitador" Jun 02 19:13:25.963544 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.963441 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="49656962-3f46-449f-a705-481ce92c9fed" containerName="authorino" Jun 02 19:13:25.967390 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.967370 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:25.970894 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.970874 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 19:13:25.975259 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:25.974975 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6mk74"] Jun 02 19:13:26.008670 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.008642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6ba5cb8-aae0-42e5-a383-8cd2093960be-data\") pod \"postgres-68c4fbbd6f-6mk74\" (UID: \"f6ba5cb8-aae0-42e5-a383-8cd2093960be\") " pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.008823 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.008758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6gq\" (UniqueName: \"kubernetes.io/projected/f6ba5cb8-aae0-42e5-a383-8cd2093960be-kube-api-access-xf6gq\") pod \"postgres-68c4fbbd6f-6mk74\" (UID: \"f6ba5cb8-aae0-42e5-a383-8cd2093960be\") " pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.110202 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.110165 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6gq\" (UniqueName: \"kubernetes.io/projected/f6ba5cb8-aae0-42e5-a383-8cd2093960be-kube-api-access-xf6gq\") pod \"postgres-68c4fbbd6f-6mk74\" (UID: \"f6ba5cb8-aae0-42e5-a383-8cd2093960be\") " pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.110371 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.110311 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6ba5cb8-aae0-42e5-a383-8cd2093960be-data\") pod \"postgres-68c4fbbd6f-6mk74\" (UID: \"f6ba5cb8-aae0-42e5-a383-8cd2093960be\") " pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.110720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.110700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6ba5cb8-aae0-42e5-a383-8cd2093960be-data\") pod \"postgres-68c4fbbd6f-6mk74\" (UID: \"f6ba5cb8-aae0-42e5-a383-8cd2093960be\") " pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.118473 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.118448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6gq\" (UniqueName: \"kubernetes.io/projected/f6ba5cb8-aae0-42e5-a383-8cd2093960be-kube-api-access-xf6gq\") pod \"postgres-68c4fbbd6f-6mk74\" (UID: \"f6ba5cb8-aae0-42e5-a383-8cd2093960be\") " pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.279687 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.279651 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:26.405630 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:26.405607 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6mk74"] Jun 02 19:13:26.407383 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:13:26.407350 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ba5cb8_aae0_42e5_a383_8cd2093960be.slice/crio-1e7de596ac1a8a0bfb8e34588f625b8b317423e131339c08e172d404951c492f WatchSource:0}: Error finding container 1e7de596ac1a8a0bfb8e34588f625b8b317423e131339c08e172d404951c492f: Status 404 returned error can't find the container with id 1e7de596ac1a8a0bfb8e34588f625b8b317423e131339c08e172d404951c492f Jun 02 19:13:27.370316 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:27.370282 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6mk74" event={"ID":"f6ba5cb8-aae0-42e5-a383-8cd2093960be","Type":"ContainerStarted","Data":"1e7de596ac1a8a0bfb8e34588f625b8b317423e131339c08e172d404951c492f"} Jun 02 19:13:29.379331 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:29.379296 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6mk74" event={"ID":"f6ba5cb8-aae0-42e5-a383-8cd2093960be","Type":"ContainerStarted","Data":"388c33b1c151e6e1dafe96867f26cf0a70ca9e7b353f0c1ee4004051102d14f4"} Jun 02 19:13:29.379733 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:29.379374 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:29.397305 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:29.397262 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-6mk74" podStartSLOduration=1.921096355 podStartE2EDuration="4.397250038s" podCreationTimestamp="2026-06-02 19:13:25 +0000 UTC" firstStartedPulling="2026-06-02 19:13:26.408694567 +0000 UTC m=+577.408556105" lastFinishedPulling="2026-06-02 19:13:28.88484825 +0000 UTC m=+579.884709788" observedRunningTime="2026-06-02 19:13:29.395397256 +0000 UTC m=+580.395258818" watchObservedRunningTime="2026-06-02 19:13:29.397250038 +0000 UTC m=+580.397111598" Jun 02 19:13:35.413596 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:35.413561 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-6mk74" Jun 02 19:13:44.666734 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.666702 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cm2hj"] Jun 02 19:13:44.671140 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.671121 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" Jun 02 19:13:44.673658 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.673638 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 19:13:44.674664 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.674650 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 19:13:44.674743 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.674698 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-j4gv7\"" Jun 02 19:13:44.677748 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.677726 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cm2hj"] Jun 02 19:13:44.785827 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.785791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4z2l\" (UniqueName: \"kubernetes.io/projected/831ecbfd-7eec-44cb-b41a-69c486464587-kube-api-access-v4z2l\") pod \"keycloak-operator-7864d68cbd-cm2hj\" (UID: \"831ecbfd-7eec-44cb-b41a-69c486464587\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" Jun 02 19:13:44.887116 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.887073 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4z2l\" (UniqueName: \"kubernetes.io/projected/831ecbfd-7eec-44cb-b41a-69c486464587-kube-api-access-v4z2l\") pod \"keycloak-operator-7864d68cbd-cm2hj\" (UID: \"831ecbfd-7eec-44cb-b41a-69c486464587\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" Jun 02 19:13:44.896255 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.896233 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4z2l\" (UniqueName: \"kubernetes.io/projected/831ecbfd-7eec-44cb-b41a-69c486464587-kube-api-access-v4z2l\") pod \"keycloak-operator-7864d68cbd-cm2hj\" (UID: \"831ecbfd-7eec-44cb-b41a-69c486464587\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" Jun 02 19:13:44.985411 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:44.985349 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" Jun 02 19:13:45.108664 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:45.108642 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cm2hj"] Jun 02 19:13:45.110831 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:13:45.110794 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831ecbfd_7eec_44cb_b41a_69c486464587.slice/crio-d4737eb0fd01be4a80c14300f03ffdada695698dbe73d613d210367272e4cc49 WatchSource:0}: Error finding container d4737eb0fd01be4a80c14300f03ffdada695698dbe73d613d210367272e4cc49: Status 404 returned error can't find the container with id d4737eb0fd01be4a80c14300f03ffdada695698dbe73d613d210367272e4cc49 Jun 02 19:13:45.434494 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:45.434460 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" event={"ID":"831ecbfd-7eec-44cb-b41a-69c486464587","Type":"ContainerStarted","Data":"d4737eb0fd01be4a80c14300f03ffdada695698dbe73d613d210367272e4cc49"} Jun 02 19:13:51.208267 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:51.208237 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:13:51.208663 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:51.208244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:13:51.457709 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:51.457673 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" event={"ID":"831ecbfd-7eec-44cb-b41a-69c486464587","Type":"ContainerStarted","Data":"0b587dd59ab0c331dbe9dfd5404c25d151b337c57468be88f266047038d24432"} Jun 02 19:13:51.473700 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:13:51.473610 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-cm2hj" podStartSLOduration=1.327609687 podStartE2EDuration="7.473595023s" podCreationTimestamp="2026-06-02 19:13:44 +0000 UTC" firstStartedPulling="2026-06-02 19:13:45.112266553 +0000 UTC m=+596.112128094" lastFinishedPulling="2026-06-02 19:13:51.258251892 +0000 UTC m=+602.258113430" observedRunningTime="2026-06-02 19:13:51.472916332 +0000 UTC m=+602.472777893" watchObservedRunningTime="2026-06-02 19:13:51.473595023 +0000 UTC m=+602.473456582" Jun 02 19:14:31.948471 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:31.948430 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64c4cc7969-9snvp"] Jun 02 19:14:31.955187 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:31.955168 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:31.957737 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:31.957710 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64c4cc7969-9snvp"] Jun 02 19:14:31.959084 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:31.959056 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xqqsv\"" Jun 02 19:14:31.959185 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:31.959080 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 19:14:32.101920 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.101892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-tls-cert\") pod \"authorino-64c4cc7969-9snvp\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.102115 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.101936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4tfh\" (UniqueName: \"kubernetes.io/projected/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-kube-api-access-l4tfh\") pod \"authorino-64c4cc7969-9snvp\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.202812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.202728 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-tls-cert\") pod \"authorino-64c4cc7969-9snvp\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.202812 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.202775 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4tfh\" (UniqueName: \"kubernetes.io/projected/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-kube-api-access-l4tfh\") pod \"authorino-64c4cc7969-9snvp\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.205157 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.205135 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-tls-cert\") pod \"authorino-64c4cc7969-9snvp\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.211090 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.211070 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4tfh\" (UniqueName: \"kubernetes.io/projected/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-kube-api-access-l4tfh\") pod \"authorino-64c4cc7969-9snvp\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.265763 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.265732 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:14:32.393127 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.393095 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64c4cc7969-9snvp"] Jun 02 19:14:32.394965 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:14:32.394933 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e48a9dc_9690_4843_a3d4_87c2ccb73a7c.slice/crio-f73e5e0e1406703e0761f5b5620386bd50d4718351f5eab05a7be08366920caf WatchSource:0}: Error finding container f73e5e0e1406703e0761f5b5620386bd50d4718351f5eab05a7be08366920caf: Status 404 returned error can't find the container with id f73e5e0e1406703e0761f5b5620386bd50d4718351f5eab05a7be08366920caf Jun 02 19:14:32.598189 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:32.598152 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64c4cc7969-9snvp" event={"ID":"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c","Type":"ContainerStarted","Data":"f73e5e0e1406703e0761f5b5620386bd50d4718351f5eab05a7be08366920caf"} Jun 02 19:14:33.602793 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:33.602756 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64c4cc7969-9snvp" event={"ID":"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c","Type":"ContainerStarted","Data":"b68dcc8c9884e51e4c2d38ece3f8cbc154fa5143f3369b9c60be3183b64e95d7"} Jun 02 19:14:33.618670 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:14:33.618626 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-64c4cc7969-9snvp" podStartSLOduration=2.287695906 podStartE2EDuration="2.618614978s" podCreationTimestamp="2026-06-02 19:14:31 +0000 UTC" firstStartedPulling="2026-06-02 19:14:32.396365271 +0000 UTC m=+643.396226810" lastFinishedPulling="2026-06-02 19:14:32.727284344 +0000 UTC m=+643.727145882" observedRunningTime="2026-06-02 19:14:33.617372886 +0000 UTC m=+644.617234446" watchObservedRunningTime="2026-06-02 19:14:33.618614978 +0000 UTC m=+644.618476538" Jun 02 19:16:01.678082 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:01.677986 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64c4cc7969-9snvp"] Jun 02 19:16:01.678568 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:01.678228 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-64c4cc7969-9snvp" podUID="1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" containerName="authorino" containerID="cri-o://b68dcc8c9884e51e4c2d38ece3f8cbc154fa5143f3369b9c60be3183b64e95d7" gracePeriod=30 Jun 02 19:16:01.914888 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:01.914857 2573 generic.go:358] "Generic (PLEG): container finished" podID="1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" containerID="b68dcc8c9884e51e4c2d38ece3f8cbc154fa5143f3369b9c60be3183b64e95d7" exitCode=0 Jun 02 19:16:01.915089 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:01.914938 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64c4cc7969-9snvp" event={"ID":"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c","Type":"ContainerDied","Data":"b68dcc8c9884e51e4c2d38ece3f8cbc154fa5143f3369b9c60be3183b64e95d7"} Jun 02 19:16:01.938913 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:01.938848 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:16:02.097638 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.097601 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-tls-cert\") pod \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " Jun 02 19:16:02.097861 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.097665 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4tfh\" (UniqueName: \"kubernetes.io/projected/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-kube-api-access-l4tfh\") pod \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\" (UID: \"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c\") " Jun 02 19:16:02.099966 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.099932 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-kube-api-access-l4tfh" (OuterVolumeSpecName: "kube-api-access-l4tfh") pod "1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" (UID: "1e48a9dc-9690-4843-a3d4-87c2ccb73a7c"). InnerVolumeSpecName "kube-api-access-l4tfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:16:02.108763 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.108731 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" (UID: "1e48a9dc-9690-4843-a3d4-87c2ccb73a7c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:16:02.199226 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.199132 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-tls-cert\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:16:02.199226 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.199168 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4tfh\" (UniqueName: \"kubernetes.io/projected/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c-kube-api-access-l4tfh\") on node \"ip-10-0-137-73.ec2.internal\" DevicePath \"\"" Jun 02 19:16:02.919828 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.919800 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64c4cc7969-9snvp" Jun 02 19:16:02.919828 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.919820 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64c4cc7969-9snvp" event={"ID":"1e48a9dc-9690-4843-a3d4-87c2ccb73a7c","Type":"ContainerDied","Data":"f73e5e0e1406703e0761f5b5620386bd50d4718351f5eab05a7be08366920caf"} Jun 02 19:16:02.920345 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.919860 2573 scope.go:117] "RemoveContainer" containerID="b68dcc8c9884e51e4c2d38ece3f8cbc154fa5143f3369b9c60be3183b64e95d7" Jun 02 19:16:02.942170 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.942143 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64c4cc7969-9snvp"] Jun 02 19:16:02.946044 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:02.946010 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64c4cc7969-9snvp"] Jun 02 19:16:03.551768 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:03.551734 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" path="/var/lib/kubelet/pods/1e48a9dc-9690-4843-a3d4-87c2ccb73a7c/volumes" Jun 02 19:16:10.136711 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.136677 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl"] Jun 02 19:16:10.137099 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.137081 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" containerName="authorino" Jun 02 19:16:10.137099 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.137096 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" containerName="authorino" Jun 02 19:16:10.137190 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.137167 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e48a9dc-9690-4843-a3d4-87c2ccb73a7c" containerName="authorino" Jun 02 19:16:10.140039 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.140016 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.143626 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.143602 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 19:16:10.143740 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.143636 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 19:16:10.143740 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.143649 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 19:16:10.143740 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.143602 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6rl8w\"" Jun 02 19:16:10.149516 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.149492 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl"] Jun 02 19:16:10.275387 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.275355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.275549 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.275401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.275549 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.275473 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9ddd03-1d76-44eb-924f-edb153e861a0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.275549 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.275504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.275549 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.275530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrp2\" (UniqueName: \"kubernetes.io/projected/ef9ddd03-1d76-44eb-924f-edb153e861a0-kube-api-access-msrp2\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.275549 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.275546 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376401 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376369 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376556 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376412 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376556 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376457 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9ddd03-1d76-44eb-924f-edb153e861a0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376556 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376477 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376556 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376501 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msrp2\" (UniqueName: \"kubernetes.io/projected/ef9ddd03-1d76-44eb-924f-edb153e861a0-kube-api-access-msrp2\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376556 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376518 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376848 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376888 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.376953 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.376932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.378777 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.378760 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9ddd03-1d76-44eb-924f-edb153e861a0-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.378873 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.378857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9ddd03-1d76-44eb-924f-edb153e861a0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.384990 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.384962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrp2\" (UniqueName: \"kubernetes.io/projected/ef9ddd03-1d76-44eb-924f-edb153e861a0-kube-api-access-msrp2\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl\" (UID: \"ef9ddd03-1d76-44eb-924f-edb153e861a0\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.451061 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.450967 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:10.577709 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.577684 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl"] Jun 02 19:16:10.580103 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:16:10.580069 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9ddd03_1d76_44eb_924f_edb153e861a0.slice/crio-8c6756c7844084ab9e48f3ba721a057c5bcca5ccf2a9b9cc36a47841e96fe7e3 WatchSource:0}: Error finding container 8c6756c7844084ab9e48f3ba721a057c5bcca5ccf2a9b9cc36a47841e96fe7e3: Status 404 returned error can't find the container with id 8c6756c7844084ab9e48f3ba721a057c5bcca5ccf2a9b9cc36a47841e96fe7e3 Jun 02 19:16:10.581853 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.581834 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:16:10.955961 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:10.955922 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" event={"ID":"ef9ddd03-1d76-44eb-924f-edb153e861a0","Type":"ContainerStarted","Data":"8c6756c7844084ab9e48f3ba721a057c5bcca5ccf2a9b9cc36a47841e96fe7e3"} Jun 02 19:16:14.973515 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:14.973425 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" event={"ID":"ef9ddd03-1d76-44eb-924f-edb153e861a0","Type":"ContainerStarted","Data":"b2082fcd37d00744c6602eb3a17cbb6de0516e67a1b760f376e1841bab7a78b2"} Jun 02 19:16:16.986325 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:16.986290 2573 generic.go:358] "Generic (PLEG): container finished" podID="ef9ddd03-1d76-44eb-924f-edb153e861a0" containerID="b2082fcd37d00744c6602eb3a17cbb6de0516e67a1b760f376e1841bab7a78b2" exitCode=0 Jun 02 19:16:16.986809 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:16.986368 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" event={"ID":"ef9ddd03-1d76-44eb-924f-edb153e861a0","Type":"ContainerDied","Data":"b2082fcd37d00744c6602eb3a17cbb6de0516e67a1b760f376e1841bab7a78b2"} Jun 02 19:16:18.995525 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:18.995491 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" event={"ID":"ef9ddd03-1d76-44eb-924f-edb153e861a0","Type":"ContainerStarted","Data":"9fd0c59390c933ffb4835ef37ed2389bc811e581b868fc207c9228b24484b795"} Jun 02 19:16:19.017908 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:19.017865 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" podStartSLOduration=1.1629448 podStartE2EDuration="9.017852918s" podCreationTimestamp="2026-06-02 19:16:10 +0000 UTC" firstStartedPulling="2026-06-02 19:16:10.582017031 +0000 UTC m=+741.581878584" lastFinishedPulling="2026-06-02 19:16:18.436925144 +0000 UTC m=+749.436786702" observedRunningTime="2026-06-02 19:16:19.015542527 +0000 UTC m=+750.015404086" watchObservedRunningTime="2026-06-02 19:16:19.017852918 +0000 UTC m=+750.017714477" Jun 02 19:16:20.451753 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:20.451720 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:20.452139 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:20.451765 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:20.464463 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:20.464437 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:21.013586 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:21.013560 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl" Jun 02 19:16:26.444172 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.444135 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k"] Jun 02 19:16:26.462818 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.462790 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k"] Jun 02 19:16:26.462978 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.462915 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.465685 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.465659 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 19:16:26.530326 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.530297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.530326 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.530328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.530528 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.530395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.530528 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.530424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pcq\" (UniqueName: \"kubernetes.io/projected/d7550a07-c25b-4559-a1cb-7c124ddc87fe-kube-api-access-s5pcq\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.530605 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.530544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.530605 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.530569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7550a07-c25b-4559-a1cb-7c124ddc87fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.631708 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.631670 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.631926 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.631719 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7550a07-c25b-4559-a1cb-7c124ddc87fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.631926 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.631768 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.631926 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.631796 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.631926 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.631878 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.632230 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.631930 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pcq\" (UniqueName: \"kubernetes.io/projected/d7550a07-c25b-4559-a1cb-7c124ddc87fe-kube-api-access-s5pcq\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.632230 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.632121 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.632351 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.632232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.632402 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.632374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.634531 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.634429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7550a07-c25b-4559-a1cb-7c124ddc87fe-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.634941 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.634896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7550a07-c25b-4559-a1cb-7c124ddc87fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.640438 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.640416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pcq\" (UniqueName: \"kubernetes.io/projected/d7550a07-c25b-4559-a1cb-7c124ddc87fe-kube-api-access-s5pcq\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k\" (UID: \"d7550a07-c25b-4559-a1cb-7c124ddc87fe\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.774807 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.774776 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:26.903773 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:26.903749 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k"] Jun 02 19:16:26.905949 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:16:26.905914 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7550a07_c25b_4559_a1cb_7c124ddc87fe.slice/crio-b40ade2eff4856edf82de598b827a0825c8bc14eeedb14ed0901f85240ce269d WatchSource:0}: Error finding container b40ade2eff4856edf82de598b827a0825c8bc14eeedb14ed0901f85240ce269d: Status 404 returned error can't find the container with id b40ade2eff4856edf82de598b827a0825c8bc14eeedb14ed0901f85240ce269d Jun 02 19:16:27.022101 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:27.022068 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" event={"ID":"d7550a07-c25b-4559-a1cb-7c124ddc87fe","Type":"ContainerStarted","Data":"b40ade2eff4856edf82de598b827a0825c8bc14eeedb14ed0901f85240ce269d"} Jun 02 19:16:28.027172 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:28.027138 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" event={"ID":"d7550a07-c25b-4559-a1cb-7c124ddc87fe","Type":"ContainerStarted","Data":"68210c6a515f84cf2cec38dc7cc48c079a8b50b3e89577b1e539bb88f9f7e0d0"} Jun 02 19:16:29.031688 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:29.031655 2573 generic.go:358] "Generic (PLEG): container finished" podID="d7550a07-c25b-4559-a1cb-7c124ddc87fe" containerID="68210c6a515f84cf2cec38dc7cc48c079a8b50b3e89577b1e539bb88f9f7e0d0" exitCode=0 Jun 02 19:16:29.032090 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:29.031740 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" event={"ID":"d7550a07-c25b-4559-a1cb-7c124ddc87fe","Type":"ContainerDied","Data":"68210c6a515f84cf2cec38dc7cc48c079a8b50b3e89577b1e539bb88f9f7e0d0"} Jun 02 19:16:30.037340 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.037257 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" event={"ID":"d7550a07-c25b-4559-a1cb-7c124ddc87fe","Type":"ContainerStarted","Data":"9c2053c00985886c10a8ee5239e3c056132aee407612c45aacfb1c4c75a3232a"} Jun 02 19:16:30.056689 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.056635 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" podStartSLOduration=3.349161572 podStartE2EDuration="4.056623048s" podCreationTimestamp="2026-06-02 19:16:26 +0000 UTC" firstStartedPulling="2026-06-02 19:16:29.032369256 +0000 UTC m=+760.032230794" lastFinishedPulling="2026-06-02 19:16:29.739830729 +0000 UTC m=+760.739692270" observedRunningTime="2026-06-02 19:16:30.055144001 +0000 UTC m=+761.055005561" watchObservedRunningTime="2026-06-02 19:16:30.056623048 +0000 UTC m=+761.056484608" Jun 02 19:16:30.134618 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.134555 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv"] Jun 02 19:16:30.138766 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.138745 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.141376 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.141354 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 19:16:30.149193 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.149165 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv"] Jun 02 19:16:30.263106 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.263074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.263276 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.263119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npszn\" (UniqueName: \"kubernetes.io/projected/fc604332-4f8b-4297-8c51-4a55ce6d1e39-kube-api-access-npszn\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.263276 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.263174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.263276 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.263206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.263276 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.263235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc604332-4f8b-4297-8c51-4a55ce6d1e39-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.263410 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.263322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364479 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364534 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364561 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc604332-4f8b-4297-8c51-4a55ce6d1e39-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364835 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364609 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364835 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364704 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364835 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364767 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npszn\" (UniqueName: \"kubernetes.io/projected/fc604332-4f8b-4297-8c51-4a55ce6d1e39-kube-api-access-npszn\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.364989 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.364963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.365064 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.365002 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.365122 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.365066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.366821 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.366804 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc604332-4f8b-4297-8c51-4a55ce6d1e39-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.367176 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.367160 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc604332-4f8b-4297-8c51-4a55ce6d1e39-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.372602 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.372580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npszn\" (UniqueName: \"kubernetes.io/projected/fc604332-4f8b-4297-8c51-4a55ce6d1e39-kube-api-access-npszn\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv\" (UID: \"fc604332-4f8b-4297-8c51-4a55ce6d1e39\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.450763 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.450730 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:30.575516 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:30.575492 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv"] Jun 02 19:16:30.577336 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:16:30.577298 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc604332_4f8b_4297_8c51_4a55ce6d1e39.slice/crio-6e67645bdb39af1e44abcd8bcf10db34e60427b1de0815fb0bbfa343b1001947 WatchSource:0}: Error finding container 6e67645bdb39af1e44abcd8bcf10db34e60427b1de0815fb0bbfa343b1001947: Status 404 returned error can't find the container with id 6e67645bdb39af1e44abcd8bcf10db34e60427b1de0815fb0bbfa343b1001947 Jun 02 19:16:31.042320 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:31.042283 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" event={"ID":"fc604332-4f8b-4297-8c51-4a55ce6d1e39","Type":"ContainerStarted","Data":"ba0af398dca336c96a3784d31cefcec39f775d03d8835ced4877c4c722174083"} Jun 02 19:16:31.042320 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:31.042320 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" event={"ID":"fc604332-4f8b-4297-8c51-4a55ce6d1e39","Type":"ContainerStarted","Data":"6e67645bdb39af1e44abcd8bcf10db34e60427b1de0815fb0bbfa343b1001947"} Jun 02 19:16:32.048235 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:32.048192 2573 generic.go:358] "Generic (PLEG): container finished" podID="fc604332-4f8b-4297-8c51-4a55ce6d1e39" containerID="ba0af398dca336c96a3784d31cefcec39f775d03d8835ced4877c4c722174083" exitCode=0 Jun 02 19:16:32.048599 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:32.048277 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" event={"ID":"fc604332-4f8b-4297-8c51-4a55ce6d1e39","Type":"ContainerDied","Data":"ba0af398dca336c96a3784d31cefcec39f775d03d8835ced4877c4c722174083"} Jun 02 19:16:33.054597 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:33.054561 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" event={"ID":"fc604332-4f8b-4297-8c51-4a55ce6d1e39","Type":"ContainerStarted","Data":"d720c1f17370a2eb2608ffc69b7d999149cc62117f0e73613b1d0a37ef6460dc"} Jun 02 19:16:33.073021 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:33.072966 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" podStartSLOduration=2.618965564 podStartE2EDuration="3.072949254s" podCreationTimestamp="2026-06-02 19:16:30 +0000 UTC" firstStartedPulling="2026-06-02 19:16:32.048754182 +0000 UTC m=+763.048615720" lastFinishedPulling="2026-06-02 19:16:32.502737868 +0000 UTC m=+763.502599410" observedRunningTime="2026-06-02 19:16:33.072411477 +0000 UTC m=+764.072273037" watchObservedRunningTime="2026-06-02 19:16:33.072949254 +0000 UTC m=+764.072810817" Jun 02 19:16:36.775852 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:36.775816 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:36.775852 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:36.775857 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:36.788444 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:36.788417 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:37.079932 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:37.079852 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k" Jun 02 19:16:40.450851 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:40.450818 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:40.451251 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:40.450907 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:40.463634 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:40.463615 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:16:41.092799 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:16:41.092772 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv" Jun 02 19:18:51.234152 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:18:51.234122 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:18:51.236253 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:18:51.236228 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:23:51.259621 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:23:51.259591 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:23:51.262685 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:23:51.262662 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:28:51.285877 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:28:51.285849 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:28:51.290523 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:28:51.290504 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:33:51.320823 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:33:51.320789 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:33:51.323924 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:33:51.323891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:38:51.348897 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:38:51.348862 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:38:51.352460 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:38:51.352439 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:41:06.087151 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:06.087119 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76d7946f8d-bpsz6_ecde934c-0e75-45e7-a1a8-6681dac8f86f/nginx/0.log" Jun 02 19:41:07.268569 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:07.268495 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-n4dmw_4d6e646a-432a-4486-82f1-68c6a9cb9ed7/copy-manifests/0.log" Jun 02 19:41:07.288219 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:07.288194 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-n4dmw_4d6e646a-432a-4486-82f1-68c6a9cb9ed7/manager/0.log" Jun 02 19:41:07.403941 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:07.403914 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6mk74_f6ba5cb8-aae0-42e5-a383-8cd2093960be/postgres/0.log" Jun 02 19:41:08.841540 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:08.841510 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-r5b5n_10166293-7b90-45cb-a876-a1e4aacd3ec0/manager/0.log" Jun 02 19:41:09.196521 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:09.196450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hsbs2_0ba57990-52e0-449c-ac7c-1d664ff388b0/registry-server/0.log" Jun 02 19:41:09.913800 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:09.913763 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bxnk45_065294b8-6c1d-4a9b-aff8-c2bea15828e9/istio-proxy/0.log" Jun 02 19:41:10.368622 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:10.368589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-89qsl_37a11e07-f810-44ce-83b9-f869d9abe557/istio-proxy/0.log" Jun 02 19:41:10.942672 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:10.942640 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl_ef9ddd03-1d76-44eb-924f-edb153e861a0/storage-initializer/0.log" Jun 02 19:41:10.952068 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:10.952025 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-b4jxl_ef9ddd03-1d76-44eb-924f-edb153e861a0/main/0.log" Jun 02 19:41:11.063845 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:11.063819 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k_d7550a07-c25b-4559-a1cb-7c124ddc87fe/storage-initializer/0.log" Jun 02 19:41:11.072221 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:11.072193 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-2gw4k_d7550a07-c25b-4559-a1cb-7c124ddc87fe/main/0.log" Jun 02 19:41:11.182466 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:11.182423 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv_fc604332-4f8b-4297-8c51-4a55ce6d1e39/storage-initializer/0.log" Jun 02 19:41:11.191687 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:11.191646 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-gv9vv_fc604332-4f8b-4297-8c51-4a55ce6d1e39/main/0.log" Jun 02 19:41:18.538384 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:18.538347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tvgqr_749d6ff0-d2c8-4cc2-ad63-085ec3c73edf/global-pull-secret-syncer/0.log" Jun 02 19:41:18.713203 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:18.713172 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zd5pn_5b4faecd-10a7-4109-9614-87361cb79dcc/konnectivity-agent/0.log" Jun 02 19:41:18.802366 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:18.802287 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-73.ec2.internal_ec4997182c29a400e7055ab03e8070cb/haproxy/0.log" Jun 02 19:41:23.173116 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:23.172998 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-r5b5n_10166293-7b90-45cb-a876-a1e4aacd3ec0/manager/0.log" Jun 02 19:41:23.301644 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:23.301620 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hsbs2_0ba57990-52e0-449c-ac7c-1d664ff388b0/registry-server/0.log" Jun 02 19:41:24.897340 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:24.897291 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-trjx2_1ec4a432-c106-48c8-b39d-da7bfb8be7c4/cluster-monitoring-operator/0.log" Jun 02 19:41:25.278379 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.278344 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvnjg_0bc27827-aa32-4d46-9dc7-2dcb47b415ea/node-exporter/0.log" Jun 02 19:41:25.326249 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.326152 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvnjg_0bc27827-aa32-4d46-9dc7-2dcb47b415ea/kube-rbac-proxy/0.log" Jun 02 19:41:25.368053 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.368012 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvnjg_0bc27827-aa32-4d46-9dc7-2dcb47b415ea/init-textfile/0.log" Jun 02 19:41:25.540297 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.540273 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-45ggn_3bc4af2c-e49a-46f5-8ea9-6881a64d6693/kube-rbac-proxy-main/0.log" Jun 02 19:41:25.568807 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.568783 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-45ggn_3bc4af2c-e49a-46f5-8ea9-6881a64d6693/kube-rbac-proxy-self/0.log" Jun 02 19:41:25.606079 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.605985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-45ggn_3bc4af2c-e49a-46f5-8ea9-6881a64d6693/openshift-state-metrics/0.log" Jun 02 19:41:25.650827 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.650803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/prometheus/0.log" Jun 02 19:41:25.678927 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.678906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/config-reloader/0.log" Jun 02 19:41:25.710457 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.710438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/thanos-sidecar/0.log" Jun 02 19:41:25.735668 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.735650 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/kube-rbac-proxy-web/0.log" Jun 02 19:41:25.766138 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.766113 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/kube-rbac-proxy/0.log" Jun 02 19:41:25.806887 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.806861 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/kube-rbac-proxy-thanos/0.log" Jun 02 19:41:25.831830 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.831813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7768acd1-e102-4fcb-ac0e-8601acc6db5f/init-config-reloader/0.log" Jun 02 19:41:25.964473 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.964395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58cc9d4867-8gdn8_d3648b52-1a51-4653-96c3-ac465e2cc34d/telemeter-client/0.log" Jun 02 19:41:25.991499 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:25.991474 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58cc9d4867-8gdn8_d3648b52-1a51-4653-96c3-ac465e2cc34d/reload/0.log" Jun 02 19:41:26.019194 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:26.019169 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58cc9d4867-8gdn8_d3648b52-1a51-4653-96c3-ac465e2cc34d/kube-rbac-proxy/0.log" Jun 02 19:41:27.290720 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:27.290693 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-m92pb_44d5d271-b24c-430c-9bef-8d549be00274/networking-console-plugin/0.log" Jun 02 19:41:28.358769 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.358738 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b48f77d86-t8bzj_5ee85d1f-aac6-4094-bf27-b60af9b48350/console/0.log" Jun 02 19:41:28.404451 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.404422 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-vnpvr_0f294d6c-bf80-4b59-96a4-477204b0d4e6/download-server/0.log" Jun 02 19:41:28.639560 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.639486 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc"] Jun 02 19:41:28.642864 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.642850 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.645960 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.645939 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d8wrw\"/\"default-dockercfg-pd7s2\"" Jun 02 19:41:28.647182 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.647165 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8wrw\"/\"kube-root-ca.crt\"" Jun 02 19:41:28.647272 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.647180 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8wrw\"/\"openshift-service-ca.crt\"" Jun 02 19:41:28.655601 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.655580 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc"] Jun 02 19:41:28.757769 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.757740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-lib-modules\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.757946 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.757785 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-proc\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.758022 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.757963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-sys\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.758022 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.758006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f6nr\" (UniqueName: \"kubernetes.io/projected/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-kube-api-access-7f6nr\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.758171 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.758093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-podres\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.858967 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.858935 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-sys\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.858976 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7f6nr\" (UniqueName: \"kubernetes.io/projected/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-kube-api-access-7f6nr\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859018 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-podres\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859057 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-lib-modules\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859145 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859070 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-sys\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859348 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-podres\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859348 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859195 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-proc\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859348 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859207 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-lib-modules\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.859348 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.859263 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-proc\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.869120 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.869099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f6nr\" (UniqueName: \"kubernetes.io/projected/9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2-kube-api-access-7f6nr\") pod \"perf-node-gather-daemonset-lmqzc\" (UID: \"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2\") " pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:28.927548 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.927478 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-ghmcm_fcac5c52-ac18-43fd-a380-6f5ac5adc56f/volume-data-source-validator/0.log" Jun 02 19:41:28.953905 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:28.953887 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:29.082755 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.082730 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc"] Jun 02 19:41:29.084588 ip-10-0-137-73 kubenswrapper[2573]: W0602 19:41:29.084553 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9cc53dc5_f7de_40a9_861d_7a49ab1fe6d2.slice/crio-f45a11e3e0cc00d1a676ebc2fc8f00434005421941a53a2fa136def1356105c1 WatchSource:0}: Error finding container f45a11e3e0cc00d1a676ebc2fc8f00434005421941a53a2fa136def1356105c1: Status 404 returned error can't find the container with id f45a11e3e0cc00d1a676ebc2fc8f00434005421941a53a2fa136def1356105c1 Jun 02 19:41:29.086128 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.086112 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:41:29.296573 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.296542 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" event={"ID":"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2","Type":"ContainerStarted","Data":"1e359b46d2e14452e950341e7e41752a3b73ef6cc274622acb5f280909dfad8a"} Jun 02 19:41:29.296726 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.296577 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" event={"ID":"9cc53dc5-f7de-40a9-861d-7a49ab1fe6d2","Type":"ContainerStarted","Data":"f45a11e3e0cc00d1a676ebc2fc8f00434005421941a53a2fa136def1356105c1"} Jun 02 19:41:29.296726 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.296665 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:29.316325 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.316280 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" podStartSLOduration=1.316263253 podStartE2EDuration="1.316263253s" podCreationTimestamp="2026-06-02 19:41:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:41:29.31536132 +0000 UTC m=+2260.315222879" watchObservedRunningTime="2026-06-02 19:41:29.316263253 +0000 UTC m=+2260.316124814" Jun 02 19:41:29.707976 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.707939 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dh4qz_58d3825d-d018-4530-a7b0-f1cb0222ccb3/dns/0.log" Jun 02 19:41:29.739416 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.739388 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dh4qz_58d3825d-d018-4530-a7b0-f1cb0222ccb3/kube-rbac-proxy/0.log" Jun 02 19:41:29.892707 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:29.892671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gbrrp_e979a935-06cf-4c6d-8ce9-a1fa2501ced1/dns-node-resolver/0.log" Jun 02 19:41:30.457737 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:30.457687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-595fffd55b-hjrxk_880d398f-80b9-431a-82f0-83e751c48f4a/registry/0.log" Jun 02 19:41:30.598308 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:30.598275 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2h7m_01635513-e06f-40f4-8aa3-2a9a6c23fff4/node-ca/0.log" Jun 02 19:41:31.701588 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:31.701557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bxnk45_065294b8-6c1d-4a9b-aff8-c2bea15828e9/istio-proxy/0.log" Jun 02 19:41:31.970567 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:31.970481 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-89qsl_37a11e07-f810-44ce-83b9-f869d9abe557/istio-proxy/0.log" Jun 02 19:41:32.595491 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:32.595466 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24gxr_83878d10-1c10-4444-8f73-1ebee8f4321d/serve-healthcheck-canary/0.log" Jun 02 19:41:33.338837 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:33.338807 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhm9b_0be76db0-4f00-4b89-8abb-a5ecb443d90c/kube-rbac-proxy/0.log" Jun 02 19:41:33.369511 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:33.369483 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhm9b_0be76db0-4f00-4b89-8abb-a5ecb443d90c/exporter/0.log" Jun 02 19:41:33.397568 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:33.397549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xhm9b_0be76db0-4f00-4b89-8abb-a5ecb443d90c/extractor/0.log" Jun 02 19:41:35.309775 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:35.309745 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d8wrw/perf-node-gather-daemonset-lmqzc" Jun 02 19:41:35.541974 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:35.541945 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76d7946f8d-bpsz6_ecde934c-0e75-45e7-a1a8-6681dac8f86f/nginx/0.log" Jun 02 19:41:36.179156 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:36.179101 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-n4dmw_4d6e646a-432a-4486-82f1-68c6a9cb9ed7/manager/0.log" Jun 02 19:41:36.201358 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:36.201330 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7548bb679b-n4dmw_4d6e646a-432a-4486-82f1-68c6a9cb9ed7/copy-manifests/0.log" Jun 02 19:41:36.230583 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:36.230549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6mk74_f6ba5cb8-aae0-42e5-a383-8cd2093960be/postgres/0.log" Jun 02 19:41:37.528368 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:37.528339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-686947f9c6-24jdp_eb17ec09-ced4-42b3-b8a7-1004a1cfe2cf/manager/0.log" Jun 02 19:41:37.589647 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:37.589617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-vmnjt_d865ed9c-281a-4a7c-8367-1ce15ab73e72/openshift-lws-operator/0.log" Jun 02 19:41:44.437919 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.437886 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/kube-multus-additional-cni-plugins/0.log" Jun 02 19:41:44.468691 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.468657 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/egress-router-binary-copy/0.log" Jun 02 19:41:44.502658 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.502632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/cni-plugins/0.log" Jun 02 19:41:44.534939 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.534921 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/bond-cni-plugin/0.log" Jun 02 19:41:44.559089 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.559071 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/routeoverride-cni/0.log" Jun 02 19:41:44.583048 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.583011 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/whereabouts-cni-bincopy/0.log" Jun 02 19:41:44.608077 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.608060 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xwkw6_2711a2b7-08aa-4f2c-89ad-1a44aae1e9d2/whereabouts-cni/0.log" Jun 02 19:41:44.676176 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.676151 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s7kb5_536b0d77-bc3b-4ce3-9dc4-fa3c3ce96269/kube-multus/0.log" Jun 02 19:41:44.998853 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:44.998828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nm8gp_59a4d9a4-a1ed-4261-bc1b-db9e96135ff0/network-metrics-daemon/0.log" Jun 02 19:41:45.023718 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:45.023679 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nm8gp_59a4d9a4-a1ed-4261-bc1b-db9e96135ff0/kube-rbac-proxy/0.log" Jun 02 19:41:45.902392 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:45.902290 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-controller/0.log" Jun 02 19:41:45.926638 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:45.926617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/0.log" Jun 02 19:41:45.946991 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:45.946963 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovn-acl-logging/1.log" Jun 02 19:41:45.976016 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:45.975994 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/kube-rbac-proxy-node/0.log" Jun 02 19:41:46.010543 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:46.010518 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 19:41:46.033207 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:46.033185 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/northd/0.log" Jun 02 19:41:46.060578 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:46.060556 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/nbdb/0.log" Jun 02 19:41:46.103367 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:46.103341 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/sbdb/0.log" Jun 02 19:41:46.301989 ip-10-0-137-73 kubenswrapper[2573]: I0602 19:41:46.301960 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fcbq_abe39f38-b20f-4545-85e5-cc00b8ec93e5/ovnkube-controller/0.log"