Jun 03 21:00:26.400924 ip-10-0-135-120 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 21:00:26.400940 ip-10-0-135-120 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 21:00:26.400949 ip-10-0-135-120 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 21:00:26.401171 ip-10-0-135-120 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 21:00:36.527037 ip-10-0-135-120 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 21:00:36.527059 ip-10-0-135-120 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 96d1895931e340249661c56aa5f135c5 -- Jun 03 21:03:17.463218 ip-10-0-135-120 systemd[1]: Starting Kubernetes Kubelet... Jun 03 21:03:17.873947 ip-10-0-135-120 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:03:17.873947 ip-10-0-135-120 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 21:03:17.873947 ip-10-0-135-120 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:03:17.873947 ip-10-0-135-120 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 21:03:17.873947 ip-10-0-135-120 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:03:17.874919 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.874819 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880489 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880515 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880519 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880522 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880525 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880529 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880532 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:03:17.880522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880535 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880538 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880542 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880545 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880548 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880551 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880554 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880556 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880559 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880561 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880564 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880566 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880571 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880575 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880578 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880581 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880583 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880586 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880596 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:03:17.880863 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880599 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880602 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880605 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880609 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880613 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880615 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880619 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880622 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880624 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880627 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880630 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880632 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880635 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880637 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880640 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880643 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880646 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880649 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880651 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:03:17.881309 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880654 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880657 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880659 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880662 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880665 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880668 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880671 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880674 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880676 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880679 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880681 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880684 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880686 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880689 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880691 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880694 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880697 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880699 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880703 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:03:17.881780 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880706 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880709 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880712 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880714 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880717 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880719 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880722 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880724 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880727 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880732 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880750 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880752 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880755 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880757 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880760 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880763 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880767 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880770 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880772 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880775 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:03:17.882237 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880778 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880780 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880783 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880785 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880788 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880790 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880793 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880796 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880799 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880801 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880804 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880806 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880809 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.880812 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881556 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881562 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881566 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881568 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881571 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881599 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:03:17.882777 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881603 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881608 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881611 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881614 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881618 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881620 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881624 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881626 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881629 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881632 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881635 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881637 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881641 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881645 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881648 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881650 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881653 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881655 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881658 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881662 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:03:17.883289 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881665 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881669 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881673 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881676 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881679 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881683 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881686 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881689 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881692 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881695 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881698 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881700 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881703 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881706 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881709 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881712 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881714 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881717 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881719 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881722 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:03:17.883811 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881724 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881727 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881729 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881732 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881751 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881756 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881759 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881762 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881764 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881767 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881769 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881772 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881775 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881777 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881780 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881783 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881786 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881789 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881791 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:03:17.884316 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881794 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881797 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881799 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881802 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881805 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881808 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881812 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881815 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881818 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881820 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881823 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881826 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881828 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881830 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881833 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881836 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881839 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881841 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881844 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:03:17.884816 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881850 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881852 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881855 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881858 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881863 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881866 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881869 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881872 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881875 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881877 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881880 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881883 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881886 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.881888 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882293 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882298 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882301 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882304 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882307 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882309 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:03:17.885303 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882311 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882314 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882316 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882320 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882322 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882325 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882327 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882330 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882333 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882335 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882338 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882340 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882347 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882350 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882353 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882355 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882359 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882361 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882364 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882367 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:03:17.885804 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882370 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882372 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882374 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882377 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882379 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882382 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882385 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882387 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882389 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882392 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882395 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882397 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882401 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882405 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882408 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882411 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882414 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882417 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882419 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:03:17.886333 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882422 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882424 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882427 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882429 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882432 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882436 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882439 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882442 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882445 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882447 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882450 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882453 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882456 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882460 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882462 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882465 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882467 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882470 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882474 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:03:17.886818 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882477 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882479 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882482 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882485 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882487 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882492 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882495 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882499 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882502 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882505 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882507 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882510 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882513 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882516 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882518 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882521 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882523 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882526 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882530 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:03:17.887282 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882532 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882536 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882538 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882540 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882544 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882546 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882549 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882551 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882553 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882556 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882558 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882561 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882563 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882566 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.882568 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882654 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882663 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882672 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882681 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882687 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882692 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 21:03:17.887766 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882699 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882705 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882708 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882711 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882715 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882718 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882721 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882724 2579 flags.go:64] FLAG: --cgroup-root="" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882727 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882730 2579 flags.go:64] FLAG: --client-ca-file="" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882747 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882751 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882755 2579 flags.go:64] FLAG: --cluster-domain="" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882761 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882764 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882768 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882771 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882775 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882778 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882782 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882785 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882789 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882792 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882795 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 21:03:17.888288 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882798 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882802 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882806 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882809 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882812 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882816 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882819 2579 flags.go:64] FLAG: --enable-server="true" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882822 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882828 2579 flags.go:64] FLAG: --event-burst="100" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882831 2579 flags.go:64] FLAG: --event-qps="50" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882834 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882837 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882840 2579 flags.go:64] FLAG: --eviction-hard="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882844 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882847 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882849 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882852 2579 flags.go:64] FLAG: --eviction-soft="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882855 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882859 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882862 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882866 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882868 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882872 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882875 2579 flags.go:64] FLAG: --feature-gates="" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882879 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 21:03:17.888874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882882 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882886 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882889 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882892 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882895 2579 flags.go:64] FLAG: --help="false" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882898 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-135-120.ec2.internal" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882901 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882905 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882907 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882911 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882914 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882917 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882920 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882923 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882926 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882929 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882932 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882935 2579 flags.go:64] FLAG: --kube-reserved="" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882938 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882940 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882944 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882946 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882949 2579 flags.go:64] FLAG: --lock-file="" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882952 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 21:03:17.889533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882955 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882959 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882965 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882968 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882971 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882974 2579 flags.go:64] FLAG: --logging-format="text" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882978 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882981 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882984 2579 flags.go:64] FLAG: --manifest-url="" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882987 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882992 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882995 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.882999 2579 flags.go:64] FLAG: --max-pods="110" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883002 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883005 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883008 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883011 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883014 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883017 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883020 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883029 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883032 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883035 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 21:03:17.890192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883038 2579 flags.go:64] FLAG: --pod-cidr="" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883041 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883047 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883050 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883053 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883056 2579 flags.go:64] FLAG: --port="10250" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883059 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883062 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e44c0495e21009ae" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883065 2579 flags.go:64] FLAG: --qos-reserved="" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883068 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883071 2579 flags.go:64] FLAG: --register-node="true" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883075 2579 flags.go:64] FLAG: --register-with-taints="" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883079 2579 flags.go:64] FLAG: --registry-burst="10" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883082 2579 flags.go:64] FLAG: --registry-qps="5" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883085 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883087 2579 flags.go:64] FLAG: --reserved-memory="" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883091 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883095 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883098 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883100 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883103 2579 flags.go:64] FLAG: --runonce="false" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883106 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883109 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883112 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883115 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 21:03:17.890787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883118 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883121 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883124 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883127 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883130 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883132 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883135 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883138 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883141 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883144 2579 flags.go:64] FLAG: --system-cgroups="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883146 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883151 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883154 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883157 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883161 2579 flags.go:64] FLAG: --tls-min-version="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883163 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883166 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883169 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883174 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883177 2579 flags.go:64] FLAG: --v="2" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883198 2579 flags.go:64] FLAG: --version="false" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883203 2579 flags.go:64] FLAG: --vmodule="" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883207 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.883211 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883341 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:03:17.891424 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883345 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883349 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883354 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883356 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883359 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883362 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883364 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883367 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883370 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883372 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883375 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883377 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883380 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883383 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883385 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883388 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883390 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883393 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883396 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883398 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:03:17.892054 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883401 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883403 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883405 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883408 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883410 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883414 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883416 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883419 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883421 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883423 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883426 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883428 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883432 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883435 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883438 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883441 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883444 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883446 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883448 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:03:17.892559 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883451 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883454 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883458 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883461 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883464 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883466 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883469 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883472 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883475 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883478 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883480 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883483 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883486 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883489 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883491 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883494 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883496 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883498 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883501 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883504 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:03:17.893058 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883506 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883509 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883511 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883515 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883518 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883521 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883530 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883534 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883538 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883541 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883544 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883547 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883550 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883553 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883556 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883558 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883561 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883563 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:03:17.893545 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883566 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883568 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883571 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883579 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883582 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883584 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883587 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883589 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883592 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883594 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883597 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883599 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883601 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883604 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883606 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883609 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883611 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883613 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883616 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:03:17.894043 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.883618 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.884479 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.891923 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.892084 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.892953 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.892963 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893036 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893042 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893047 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893050 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893053 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893056 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893058 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893063 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893066 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:03:17.894512 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893069 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893071 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893074 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893077 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893080 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893083 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893086 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893089 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893092 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893094 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893097 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893100 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893103 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893106 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893108 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893111 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893113 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893116 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893119 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893121 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:03:17.894934 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893126 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893130 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893135 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893138 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893141 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893144 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893146 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893149 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893151 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893154 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893157 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893159 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893162 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893164 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893167 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893170 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893172 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893174 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893177 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893179 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:03:17.895463 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893182 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893185 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893187 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893189 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893192 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893195 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893198 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893200 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893202 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893205 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893207 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893212 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893216 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893221 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893223 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893226 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893228 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893231 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893233 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:03:17.895994 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893236 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893238 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893242 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893246 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893249 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893252 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893254 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893257 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893260 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893262 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893264 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893267 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893269 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893272 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893274 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893277 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893280 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893282 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893285 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893287 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:03:17.896478 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893290 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893293 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893295 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893297 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893300 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893303 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893306 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893309 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893312 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893314 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.893320 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893441 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893447 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893450 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893453 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:03:17.896991 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893456 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893458 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893461 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893463 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893465 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893468 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893470 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893473 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893475 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893478 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893480 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893483 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893485 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893488 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893490 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893492 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893495 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893498 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893501 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893503 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:03:17.897367 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893506 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893509 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893512 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893515 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893517 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893520 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893523 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893525 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893529 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893531 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893533 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893536 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893538 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893541 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893543 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893546 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893548 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893551 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893554 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893556 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:03:17.897877 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893559 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893562 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893564 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893566 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893569 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893572 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893574 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893576 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893579 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893582 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893584 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893588 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893593 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893596 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893599 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893601 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893604 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893607 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893610 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:03:17.898361 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893612 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893615 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893617 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893620 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893622 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893625 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893627 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893630 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893632 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893635 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893637 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893640 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893642 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893645 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893647 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893649 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893652 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893654 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893657 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893660 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:03:17.898866 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893663 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893665 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893669 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893672 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893675 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893678 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893681 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893683 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893686 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893690 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893693 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893695 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893698 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893700 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:03:17.899344 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:17.893703 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:03:17.899697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.893708 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:03:17.899697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.893864 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 21:03:17.899697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.895917 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 21:03:17.899697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.897338 2579 server.go:1019] "Starting client certificate rotation" Jun 03 21:03:17.899697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.897452 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:03:17.899697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.897488 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:03:17.899913 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.899893 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:03:17.902034 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.902004 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:03:17.913412 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.913383 2579 log.go:25] "Validated CRI v1 runtime API" Jun 03 21:03:17.916546 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.916526 2579 log.go:25] "Validated CRI v1 image API" Jun 03 21:03:17.917503 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.917484 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 21:03:17.920885 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.920860 2579 fs.go:135] Filesystem UUIDs: map[3bdd93dd-da9b-41b0-b7eb-e1cb0ad42cfc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a8ddc383-9aaa-47e7-8563-d65708d6bea3:/dev/nvme0n1p4] Jun 03 21:03:17.920958 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.920884 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 21:03:17.926118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.925989 2579 manager.go:216] Machine: {Timestamp:2026-06-03 21:03:17.924687132 +0000 UTC m=+0.332450619 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100070 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e95ea0ceef1dc3778ed187b5118eb SystemUUID:ec2e95ea-0cee-f1dc-3778-ed187b5118eb BootID:96d18959-31e3-4024-9661-c56aa5f135c5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:40:eb:77:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:40:eb:77:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:4e:72:b8:fb:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 21:03:17.926118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.926112 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 21:03:17.926282 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.926269 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 21:03:17.927919 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.927890 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:03:17.928080 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.928045 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 21:03:17.928251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.928086 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 21:03:17.928790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.928780 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 21:03:17.928824 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.928794 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 21:03:17.928824 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.928802 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:03:17.929463 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.929451 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:03:17.930286 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.930273 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 21:03:17.933114 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933099 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:03:17.933248 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933238 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 21:03:17.933283 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933271 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 03 21:03:17.933283 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933281 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 21:03:17.933338 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933305 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 21:03:17.933338 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933317 2579 kubelet.go:398] "Adding apiserver pod source" Jun 03 21:03:17.933338 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933326 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 21:03:17.933773 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933758 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:03:17.933825 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.933787 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:03:17.936487 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.936469 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 21:03:17.938174 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938161 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 21:03:17.938234 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938191 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 21:03:17.938732 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938722 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 21:03:17.938787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938757 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 21:03:17.938787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938764 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 21:03:17.938787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938770 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 21:03:17.938787 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938780 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938786 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938811 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938817 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938824 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938829 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938838 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 21:03:17.938933 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.938845 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 21:03:17.939546 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.939536 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 21:03:17.939546 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.939546 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 21:03:17.947854 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.947835 2579 server.go:1268] "Started kubelet" Jun 03 21:03:17.951798 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.947918 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 21:03:17.951798 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.947978 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 21:03:17.951798 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.951525 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 21:03:17.952249 ip-10-0-135-120 systemd[1]: Started Kubernetes Kubelet. Jun 03 21:03:17.953126 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.953096 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6jgl2" Jun 03 21:03:17.954189 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.954165 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 21:03:17.954869 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:17.954836 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 21:03:17.954957 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:17.954914 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 21:03:17.955066 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.955041 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 21:03:17.955466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.955446 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 03 21:03:17.958396 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:17.956485 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-120.ec2.internal.18b5ae0cdbf1d5ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-120.ec2.internal,UID:ip-10-0-135-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-120.ec2.internal,},FirstTimestamp:2026-06-03 21:03:17.947799021 +0000 UTC m=+0.355562506,LastTimestamp:2026-06-03 21:03:17.947799021 +0000 UTC m=+0.355562506,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-120.ec2.internal,}" Jun 03 21:03:17.958705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.958681 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6jgl2" Jun 03 21:03:17.960481 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:17.960453 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 21:03:17.960591 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.960482 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 21:03:17.960650 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:17.960592 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:17.960818 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.960485 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 21:03:17.961086 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961058 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 21:03:17.961191 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961171 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 21:03:17.961274 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961081 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 21:03:17.961363 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961350 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 03 21:03:17.961417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961364 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 03 21:03:17.961494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961477 2579 factory.go:55] Registering systemd factory Jun 03 21:03:17.961555 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961498 2579 factory.go:223] Registration of the systemd container factory successfully Jun 03 21:03:17.961767 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961732 2579 factory.go:153] Registering CRI-O factory Jun 03 21:03:17.961767 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961768 2579 factory.go:223] Registration of the crio container factory successfully Jun 03 21:03:17.961879 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961852 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 21:03:17.961879 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961876 2579 factory.go:103] Registering Raw factory Jun 03 21:03:17.961968 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.961891 2579 manager.go:1196] Started watching for new ooms in manager Jun 03 21:03:17.962952 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.962941 2579 manager.go:349] Starting recovery of all containers Jun 03 21:03:17.968302 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.968281 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:03:17.971260 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:17.971229 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-120.ec2.internal\" not found" node="ip-10-0-135-120.ec2.internal" Jun 03 21:03:17.973783 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.973765 2579 manager.go:354] Recovery completed Jun 03 21:03:17.978751 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.978718 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:17.981325 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.981301 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:17.981427 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.981338 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:17.981427 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.981349 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:17.982291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.982269 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 21:03:17.982291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.982283 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 21:03:17.982395 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.982307 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:03:17.982395 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.982315 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:17.983512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.983497 2579 policy_none.go:49] "None policy: Start" Jun 03 21:03:17.983583 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.983519 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 21:03:17.983583 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.983534 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 21:03:17.984355 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.984334 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:17.984444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.984375 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:17.984444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.984387 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:17.984665 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:17.984651 2579 policy_none.go:47] "Start" Jun 03 21:03:18.022526 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.022504 2579 manager.go:337] "Starting Device Plugin manager" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.022602 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.022617 2579 server.go:87] "Starting device plugin registration server" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.022903 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.022915 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.023029 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.023123 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.023132 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.024066 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 21:03:18.030118 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.024126 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.031476 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.031450 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 21:03:18.032866 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.032848 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 21:03:18.032917 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.032887 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 21:03:18.032917 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.032908 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 21:03:18.033010 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.032995 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 21:03:18.034684 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.034658 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:03:18.123505 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.123464 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:18.124618 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.124563 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:18.124618 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.124596 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:18.124618 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.124608 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:18.124811 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.124634 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.132008 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.131988 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.132130 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.132017 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-120.ec2.internal\": node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.133340 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.133323 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal"] Jun 03 21:03:18.133405 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.133394 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:18.135904 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.135884 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:18.136001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.135920 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:18.136001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.135935 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:18.137070 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137058 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:18.137193 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.137249 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137213 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:18.137768 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137751 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:18.137842 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137781 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:18.137842 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137791 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:18.137842 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137755 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:18.137956 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137851 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:18.137956 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.137864 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:18.138999 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.138986 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.139053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.139009 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:03:18.139683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.139669 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:03:18.139767 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.139700 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:03:18.139767 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.139717 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:03:18.144380 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.144361 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.153407 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.153386 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-120.ec2.internal\" not found" node="ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.158094 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.158075 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-120.ec2.internal\" not found" node="ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.162590 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.162570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b2843120fa1fbceee6034eebb27c1fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"9b2843120fa1fbceee6034eebb27c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.162718 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.162602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b2843120fa1fbceee6034eebb27c1fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"9b2843120fa1fbceee6034eebb27c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.162718 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.162628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40cb1235e1746ccaa0e7fc6c6540c44b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-120.ec2.internal\" (UID: \"40cb1235e1746ccaa0e7fc6c6540c44b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.244978 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.244950 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.263206 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.263177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b2843120fa1fbceee6034eebb27c1fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"9b2843120fa1fbceee6034eebb27c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.263281 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.263210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b2843120fa1fbceee6034eebb27c1fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"9b2843120fa1fbceee6034eebb27c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.263281 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.263232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40cb1235e1746ccaa0e7fc6c6540c44b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-120.ec2.internal\" (UID: \"40cb1235e1746ccaa0e7fc6c6540c44b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.263352 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.263287 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b2843120fa1fbceee6034eebb27c1fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"9b2843120fa1fbceee6034eebb27c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.263352 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.263297 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b2843120fa1fbceee6034eebb27c1fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"9b2843120fa1fbceee6034eebb27c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.263352 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.263287 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40cb1235e1746ccaa0e7fc6c6540c44b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-120.ec2.internal\" (UID: \"40cb1235e1746ccaa0e7fc6c6540c44b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.345897 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.345856 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.446781 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.446697 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.456892 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.456863 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.461554 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.461532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Jun 03 21:03:18.547460 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.547420 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.647996 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.647944 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.748641 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.748551 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.849249 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.849211 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.896719 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.896685 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 21:03:18.897437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.896882 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:03:18.897437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.896882 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:03:18.950281 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:18.950246 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:18.964003 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.963955 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 20:58:17 +0000 UTC" deadline="2028-01-04 10:43:45.647092172 +0000 UTC" Jun 03 21:03:18.964003 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.963997 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13909h40m26.683098963s" Jun 03 21:03:18.983694 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:18.983515 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2843120fa1fbceee6034eebb27c1fd.slice/crio-d54e1eee09d8748fa335732a49c541611ebee442ed506e316c010afd1e7dcbe8 WatchSource:0}: Error finding container d54e1eee09d8748fa335732a49c541611ebee442ed506e316c010afd1e7dcbe8: Status 404 returned error can't find the container with id d54e1eee09d8748fa335732a49c541611ebee442ed506e316c010afd1e7dcbe8 Jun 03 21:03:18.984345 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:18.984320 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cb1235e1746ccaa0e7fc6c6540c44b.slice/crio-9e95715aa39ece0837b6546af75fc8789ab0cd52f53e614c4f5b9deac6d1907d WatchSource:0}: Error finding container 9e95715aa39ece0837b6546af75fc8789ab0cd52f53e614c4f5b9deac6d1907d: Status 404 returned error can't find the container with id 9e95715aa39ece0837b6546af75fc8789ab0cd52f53e614c4f5b9deac6d1907d Jun 03 21:03:18.989325 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:18.989305 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:03:19.036489 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.036370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" event={"ID":"9b2843120fa1fbceee6034eebb27c1fd","Type":"ContainerStarted","Data":"d54e1eee09d8748fa335732a49c541611ebee442ed506e316c010afd1e7dcbe8"} Jun 03 21:03:19.037408 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.037380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" event={"ID":"40cb1235e1746ccaa0e7fc6c6540c44b","Type":"ContainerStarted","Data":"9e95715aa39ece0837b6546af75fc8789ab0cd52f53e614c4f5b9deac6d1907d"} Jun 03 21:03:19.050551 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:19.050523 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:19.151012 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:19.150979 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:19.251588 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:19.251551 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Jun 03 21:03:19.267435 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.267409 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:03:19.361238 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.360960 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Jun 03 21:03:19.371435 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.371404 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:03:19.373315 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.373284 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Jun 03 21:03:19.381454 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.381424 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:03:19.530855 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.530732 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:03:19.783141 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.783059 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:03:19.934719 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.934684 2579 apiserver.go:52] "Watching apiserver" Jun 03 21:03:19.941315 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.941279 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 21:03:19.943300 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.943268 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-xpvqm","openshift-multus/network-metrics-daemon-wgmqq","kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r","openshift-cluster-node-tuning-operator/tuned-9lf8m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal","openshift-multus/multus-additional-cni-plugins-jxvrq","openshift-network-diagnostics/network-check-target-5lwc6","openshift-network-operator/iptables-alerter-g8b52","openshift-ovn-kubernetes/ovnkube-node-spj7s","kube-system/global-pull-secret-syncer-n7lph","kube-system/konnectivity-agent-jzphx","openshift-dns/node-resolver-pg4px","openshift-image-registry/node-ca-sz9zs"] Jun 03 21:03:19.944904 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.944877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.946103 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.946080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:19.947166 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.947134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:19.947681 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.947661 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 21:03:19.947814 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.947663 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 21:03:19.947960 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.947944 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.948139 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.948120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.948199 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.948120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 21:03:19.948661 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.948626 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.948772 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.948667 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f985w\"" Jun 03 21:03:19.949365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.948952 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.949365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.949036 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.949365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.949056 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9sqpk\"" Jun 03 21:03:19.949575 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.949556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.949685 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.949663 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5wxd6\"" Jun 03 21:03:19.949759 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.949678 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.949953 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.949930 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 21:03:19.950516 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.950500 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.951192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.951171 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 21:03:19.951408 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.951387 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.951623 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.951605 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.951696 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.951654 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vjb8n\"" Jun 03 21:03:19.951990 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.951971 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:19.952065 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:19.952045 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:19.952780 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.952759 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.952929 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.952901 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.953000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.952946 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:19.953000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.952902 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2mfr\"" Jun 03 21:03:19.954666 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.954648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.955783 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.955727 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.955891 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.955870 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 21:03:19.956110 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.956095 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.956326 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.956308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:19.956595 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.956566 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h729b\"" Jun 03 21:03:19.956869 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:19.956576 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:19.957070 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.957052 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 21:03:19.957434 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.957417 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gsx7n\"" Jun 03 21:03:19.960772 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.960708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.961123 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.961108 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 21:03:19.961846 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.961827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:19.961931 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:19.961902 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:19.963059 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.963038 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 21:03:19.963150 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.963099 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 21:03:19.963247 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.963222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:19.963344 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.963306 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 21:03:19.963918 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.963896 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 21:03:19.964154 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.964018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rgg79\"" Jun 03 21:03:19.964154 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.964091 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 21:03:19.964311 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.964292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 21:03:19.965698 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.965681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 21:03:19.965964 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.965946 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 21:03:19.965964 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.965962 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z8ftd\"" Jun 03 21:03:19.973515 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-hostroot\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.973669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973495 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:03:19.973669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-systemd\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.973669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-cni-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-daemon-config\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973651 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-socket-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-sys\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovnkube-script-lib\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-cni-binary-copy\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-cnibin\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-cni-bin\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-cni-multus\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-slash\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.973893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-cni-netd\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-cnibin\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-serviceca\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-kubelet\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.973986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8358b910-e09f-41bb-9158-0e65bf49e711-kubelet-config\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8358b910-e09f-41bb-9158-0e65bf49e711-dbus\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-sys-fs\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysctl-conf\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d955804-3794-4b42-aa17-b7e80e29c55e-tmp\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-etc-kubernetes\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql96\" (UniqueName: \"kubernetes.io/projected/4a29ca40-5f62-4e6a-9d30-f3275493d903-kube-api-access-7ql96\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-etc-selinux\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-socket-dir-parent\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.974235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-run-ovn-kubernetes\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh7r8\" (UniqueName: \"kubernetes.io/projected/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-kube-api-access-sh7r8\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh5c5\" (UniqueName: \"kubernetes.io/projected/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-kube-api-access-wh5c5\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysctl-d\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03bc0ec1-445a-4d5e-a294-601a8d82894d-host-slash\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-conf-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-node-log\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-log-socket\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-kubelet\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-run-netns\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-var-lib-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovnkube-config\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-kubernetes\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.974705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-os-release\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-run\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-systemd\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-etc-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovn-node-metrics-cert\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-system-cni-dir\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-os-release\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-host\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-ovn\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-env-overrides\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-tmp-dir\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-modprobe-d\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-systemd-units\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-cni-bin\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.974972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqx6\" (UniqueName: \"kubernetes.io/projected/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-kube-api-access-drqx6\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:19.975310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxz94\" (UniqueName: \"kubernetes.io/projected/829e950d-fac9-4e3a-adb2-714d47920218-kube-api-access-sxz94\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-device-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysconfig\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-k8s-cni-cncf-io\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8sr5\" (UniqueName: \"kubernetes.io/projected/b5a5df89-4137-46d4-a281-8053b0b9aa16-kube-api-access-b8sr5\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-host\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-tuned\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03bc0ec1-445a-4d5e-a294-601a8d82894d-iptables-alerter-script\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2h5\" (UniqueName: \"kubernetes.io/projected/03bc0ec1-445a-4d5e-a294-601a8d82894d-kube-api-access-bw2h5\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-multus-certs\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdxj\" (UniqueName: \"kubernetes.io/projected/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-kube-api-access-wpdxj\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-var-lib-kubelet\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-hosts-file\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:19.975950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-lib-modules\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.976466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-system-cni-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.976466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-netns\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:19.976466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:19.976466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-registration-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:19.976466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.975632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcm46\" (UniqueName: \"kubernetes.io/projected/4d955804-3794-4b42-aa17-b7e80e29c55e-kube-api-access-dcm46\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:19.996872 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:19.996834 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wp4zf" Jun 03 21:03:20.002077 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.002041 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wp4zf" Jun 03 21:03:20.062081 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.061989 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 21:03:20.076255 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-systemd-units\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.076255 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-cni-bin\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drqx6\" (UniqueName: \"kubernetes.io/projected/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-kube-api-access-drqx6\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxz94\" (UniqueName: \"kubernetes.io/projected/829e950d-fac9-4e3a-adb2-714d47920218-kube-api-access-sxz94\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-device-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysconfig\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-cni-bin\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-k8s-cni-cncf-io\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-systemd-units\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.076527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076415 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-device-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysconfig\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-k8s-cni-cncf-io\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8sr5\" (UniqueName: \"kubernetes.io/projected/b5a5df89-4137-46d4-a281-8053b0b9aa16-kube-api-access-b8sr5\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-host\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-tuned\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076889 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-host\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03bc0ec1-445a-4d5e-a294-601a8d82894d-iptables-alerter-script\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2h5\" (UniqueName: \"kubernetes.io/projected/03bc0ec1-445a-4d5e-a294-601a8d82894d-kube-api-access-bw2h5\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.077000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.076992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-multus-certs\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdxj\" (UniqueName: \"kubernetes.io/projected/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-kube-api-access-wpdxj\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-multus-certs\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077167 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-var-lib-kubelet\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-hosts-file\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077265 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-lib-modules\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077285 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-system-cni-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-netns\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.077372 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077372 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-system-cni-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-registration-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcm46\" (UniqueName: \"kubernetes.io/projected/4d955804-3794-4b42-aa17-b7e80e29c55e-kube-api-access-dcm46\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.077458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-lib-modules\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-run-netns\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-var-lib-kubelet\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.077477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:20.577426201 +0000 UTC m=+2.985189673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077493 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-registration-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077503 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03bc0ec1-445a-4d5e-a294-601a8d82894d-iptables-alerter-script\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-hosts-file\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-hostroot\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-hostroot\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-systemd\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-systemd\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-cni-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077817 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-cni-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-daemon-config\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-socket-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.078284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077913 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-sys\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077958 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-sys\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovnkube-script-lib\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.077995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-cni-binary-copy\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-cnibin\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-socket-dir\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-cnibin\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-cni-bin\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-cni-multus\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-slash\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-cni-netd\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-cnibin\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-serviceca\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-kubelet\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8358b910-e09f-41bb-9158-0e65bf49e711-kubelet-config\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8358b910-e09f-41bb-9158-0e65bf49e711-dbus\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:20.079129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-sys-fs\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysctl-conf\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d955804-3794-4b42-aa17-b7e80e29c55e-tmp\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-etc-kubernetes\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078546 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-daemon-config\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql96\" (UniqueName: \"kubernetes.io/projected/4a29ca40-5f62-4e6a-9d30-f3275493d903-kube-api-access-7ql96\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/829e950d-fac9-4e3a-adb2-714d47920218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-etc-selinux\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078589 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovnkube-script-lib\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078609 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-cni-bin\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-socket-dir-parent\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-cni-netd\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-cnibin\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96d00132-0d39-447e-88f5-582b18088ffe-agent-certs\") pod \"konnectivity-agent-jzphx\" (UID: \"96d00132-0d39-447e-88f5-582b18088ffe\") " pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-cni-multus\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-slash\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-etc-selinux\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.080084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8358b910-e09f-41bb-9158-0e65bf49e711-kubelet-config\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-run-ovn-kubernetes\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078827 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-socket-dir-parent\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-kubelet\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078897 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5a5df89-4137-46d4-a281-8053b0b9aa16-sys-fs\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh7r8\" (UniqueName: \"kubernetes.io/projected/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-kube-api-access-sh7r8\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh5c5\" (UniqueName: \"kubernetes.io/projected/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-kube-api-access-wh5c5\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078950 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8358b910-e09f-41bb-9158-0e65bf49e711-dbus\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysctl-d\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.078980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03bc0ec1-445a-4d5e-a294-601a8d82894d-host-slash\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-run-ovn-kubernetes\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079061 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-etc-kubernetes\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-conf-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-cni-binary-copy\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079086 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysctl-conf\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.080911 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-node-log\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-serviceca\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-log-socket\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-node-log\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.079164 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-kubelet\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03bc0ec1-445a-4d5e-a294-601a8d82894d-host-slash\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-host-var-lib-kubelet\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.079237 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:20.57921579 +0000 UTC m=+2.986979270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079247 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-multus-conf-dir\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96d00132-0d39-447e-88f5-582b18088ffe-konnectivity-ca\") pod \"konnectivity-agent-jzphx\" (UID: \"96d00132-0d39-447e-88f5-582b18088ffe\") " pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-run-netns\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-log-socket\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-var-lib-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-sysctl-d\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-host-run-netns\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.081899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovnkube-config\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-var-lib-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-kubernetes\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-os-release\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-run\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-systemd\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-etc-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-kubernetes\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovn-node-metrics-cert\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-system-cni-dir\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079703 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-run\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-os-release\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-systemd\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079801 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-etc-openvswitch\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-host\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:20.082688 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-ovn\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-env-overrides\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovnkube-config\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-tmp-dir\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-os-release\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.079997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-modprobe-d\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080086 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-modprobe-d\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-host\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/829e950d-fac9-4e3a-adb2-714d47920218-system-cni-dir\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-run-ovn\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-tmp-dir\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-os-release\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.080596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-env-overrides\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.081569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d955804-3794-4b42-aa17-b7e80e29c55e-etc-tuned\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.082074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d955804-3794-4b42-aa17-b7e80e29c55e-tmp\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.083365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.083147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-ovn-node-metrics-cert\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.085196 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.085173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxz94\" (UniqueName: \"kubernetes.io/projected/829e950d-fac9-4e3a-adb2-714d47920218-kube-api-access-sxz94\") pod \"multus-additional-cni-plugins-jxvrq\" (UID: \"829e950d-fac9-4e3a-adb2-714d47920218\") " pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.085314 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.085210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqx6\" (UniqueName: \"kubernetes.io/projected/bacf5d35-0b7c-485e-8b7c-6a4d0b782a29-kube-api-access-drqx6\") pod \"ovnkube-node-spj7s\" (UID: \"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29\") " pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.090467 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.090419 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:20.090467 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.090451 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:20.090467 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.090467 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:20.090931 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.090551 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:20.590528456 +0000 UTC m=+2.998291946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:20.090931 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.090560 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdxj\" (UniqueName: \"kubernetes.io/projected/7701e63f-aba1-45cc-bcd0-28d0ce89ef0d-kube-api-access-wpdxj\") pod \"multus-xpvqm\" (UID: \"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d\") " pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.090931 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.090718 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcm46\" (UniqueName: \"kubernetes.io/projected/4d955804-3794-4b42-aa17-b7e80e29c55e-kube-api-access-dcm46\") pod \"tuned-9lf8m\" (UID: \"4d955804-3794-4b42-aa17-b7e80e29c55e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.090931 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.090838 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2h5\" (UniqueName: \"kubernetes.io/projected/03bc0ec1-445a-4d5e-a294-601a8d82894d-kube-api-access-bw2h5\") pod \"iptables-alerter-g8b52\" (UID: \"03bc0ec1-445a-4d5e-a294-601a8d82894d\") " pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.091309 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.091284 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8sr5\" (UniqueName: \"kubernetes.io/projected/b5a5df89-4137-46d4-a281-8053b0b9aa16-kube-api-access-b8sr5\") pod \"aws-ebs-csi-driver-node-99c9r\" (UID: \"b5a5df89-4137-46d4-a281-8053b0b9aa16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.092411 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.092385 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh5c5\" (UniqueName: \"kubernetes.io/projected/3612e48c-9a99-4e0a-9a43-9bea4eaedd89-kube-api-access-wh5c5\") pod \"node-ca-sz9zs\" (UID: \"3612e48c-9a99-4e0a-9a43-9bea4eaedd89\") " pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.092564 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.092510 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql96\" (UniqueName: \"kubernetes.io/projected/4a29ca40-5f62-4e6a-9d30-f3275493d903-kube-api-access-7ql96\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:20.093321 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.093293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh7r8\" (UniqueName: \"kubernetes.io/projected/e42338e2-7f1b-4e1f-ac6f-435120ad5d7b-kube-api-access-sh7r8\") pod \"node-resolver-pg4px\" (UID: \"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b\") " pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.180621 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.180585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96d00132-0d39-447e-88f5-582b18088ffe-konnectivity-ca\") pod \"konnectivity-agent-jzphx\" (UID: \"96d00132-0d39-447e-88f5-582b18088ffe\") " pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.180782 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.180684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96d00132-0d39-447e-88f5-582b18088ffe-agent-certs\") pod \"konnectivity-agent-jzphx\" (UID: \"96d00132-0d39-447e-88f5-582b18088ffe\") " pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.181222 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.181203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96d00132-0d39-447e-88f5-582b18088ffe-konnectivity-ca\") pod \"konnectivity-agent-jzphx\" (UID: \"96d00132-0d39-447e-88f5-582b18088ffe\") " pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.183215 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.183184 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96d00132-0d39-447e-88f5-582b18088ffe-agent-certs\") pod \"konnectivity-agent-jzphx\" (UID: \"96d00132-0d39-447e-88f5-582b18088ffe\") " pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.258141 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.258100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" Jun 03 21:03:20.267470 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.267445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pg4px" Jun 03 21:03:20.276340 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.276305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sz9zs" Jun 03 21:03:20.284169 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.284139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" Jun 03 21:03:20.291550 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.291519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" Jun 03 21:03:20.299802 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.299777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g8b52" Jun 03 21:03:20.307210 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.307188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpvqm" Jun 03 21:03:20.314246 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.314163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:20.314806 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.314781 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:03:20.319245 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.319225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:20.584076 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.583981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:20.584076 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.584067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:20.584298 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.584109 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:20.584298 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.584185 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:20.584298 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.584193 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:21.584168437 +0000 UTC m=+3.991931921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:20.584298 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.584229 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:21.584217475 +0000 UTC m=+3.991980948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:20.685084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:20.685045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:20.685261 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.685217 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:20.685261 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.685241 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:20.685261 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.685256 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:20.685416 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:20.685319 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:21.685301684 +0000 UTC m=+4.093065159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:20.800272 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:20.800243 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d955804_3794_4b42_aa17_b7e80e29c55e.slice/crio-bdce307fdf2a4109b3d50f0f44a56d579c0a4e13ab32c2a18a9dda7eeab19265 WatchSource:0}: Error finding container bdce307fdf2a4109b3d50f0f44a56d579c0a4e13ab32c2a18a9dda7eeab19265: Status 404 returned error can't find the container with id bdce307fdf2a4109b3d50f0f44a56d579c0a4e13ab32c2a18a9dda7eeab19265 Jun 03 21:03:20.801565 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:20.801539 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3612e48c_9a99_4e0a_9a43_9bea4eaedd89.slice/crio-f0088840bdf2346d6b74dc4778c55e174f0d0a49dc1ecb15feb61dce51825288 WatchSource:0}: Error finding container f0088840bdf2346d6b74dc4778c55e174f0d0a49dc1ecb15feb61dce51825288: Status 404 returned error can't find the container with id f0088840bdf2346d6b74dc4778c55e174f0d0a49dc1ecb15feb61dce51825288 Jun 03 21:03:20.804088 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:20.803988 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d00132_0d39_447e_88f5_582b18088ffe.slice/crio-2928b03b2ff64862a661fe01f3285d54014e2988d57d5de6a28eb62d193e343f WatchSource:0}: Error finding container 2928b03b2ff64862a661fe01f3285d54014e2988d57d5de6a28eb62d193e343f: Status 404 returned error can't find the container with id 2928b03b2ff64862a661fe01f3285d54014e2988d57d5de6a28eb62d193e343f Jun 03 21:03:20.806710 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:20.806681 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bc0ec1_445a_4d5e_a294_601a8d82894d.slice/crio-31a8ec38afe33c5408d97fa31b4b9b966c4e0e918c9da9904044d19e2892d364 WatchSource:0}: Error finding container 31a8ec38afe33c5408d97fa31b4b9b966c4e0e918c9da9904044d19e2892d364: Status 404 returned error can't find the container with id 31a8ec38afe33c5408d97fa31b4b9b966c4e0e918c9da9904044d19e2892d364 Jun 03 21:03:20.807614 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:03:20.807591 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42338e2_7f1b_4e1f_ac6f_435120ad5d7b.slice/crio-286a56bdb9cf69899a7aa9fce00a5404fcae7a9214f1f7bfe7304cbadfb64aeb WatchSource:0}: Error finding container 286a56bdb9cf69899a7aa9fce00a5404fcae7a9214f1f7bfe7304cbadfb64aeb: Status 404 returned error can't find the container with id 286a56bdb9cf69899a7aa9fce00a5404fcae7a9214f1f7bfe7304cbadfb64aeb Jun 03 21:03:21.004362 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.004295 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:58:19 +0000 UTC" deadline="2028-02-19 14:55:29.09911601 +0000 UTC" Jun 03 21:03:21.004362 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.004358 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15017h52m8.094762132s" Jun 03 21:03:21.041935 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.041899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g8b52" event={"ID":"03bc0ec1-445a-4d5e-a294-601a8d82894d","Type":"ContainerStarted","Data":"31a8ec38afe33c5408d97fa31b4b9b966c4e0e918c9da9904044d19e2892d364"} Jun 03 21:03:21.043066 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.043033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sz9zs" event={"ID":"3612e48c-9a99-4e0a-9a43-9bea4eaedd89","Type":"ContainerStarted","Data":"f0088840bdf2346d6b74dc4778c55e174f0d0a49dc1ecb15feb61dce51825288"} Jun 03 21:03:21.046300 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.046272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" event={"ID":"40cb1235e1746ccaa0e7fc6c6540c44b","Type":"ContainerStarted","Data":"f7ca3e3ba0df97da76e89113b97d1f9c7389002397594fe38883c79be5da333f"} Jun 03 21:03:21.047441 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.047410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pg4px" event={"ID":"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b","Type":"ContainerStarted","Data":"286a56bdb9cf69899a7aa9fce00a5404fcae7a9214f1f7bfe7304cbadfb64aeb"} Jun 03 21:03:21.048470 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.048438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jzphx" event={"ID":"96d00132-0d39-447e-88f5-582b18088ffe","Type":"ContainerStarted","Data":"2928b03b2ff64862a661fe01f3285d54014e2988d57d5de6a28eb62d193e343f"} Jun 03 21:03:21.049492 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.049469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" event={"ID":"4d955804-3794-4b42-aa17-b7e80e29c55e","Type":"ContainerStarted","Data":"bdce307fdf2a4109b3d50f0f44a56d579c0a4e13ab32c2a18a9dda7eeab19265"} Jun 03 21:03:21.050480 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.050460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" event={"ID":"b5a5df89-4137-46d4-a281-8053b0b9aa16","Type":"ContainerStarted","Data":"351e4800b64173a5b3a2e4e04b59ea68615ed907a596edfc5b79272b9fc2ad39"} Jun 03 21:03:21.051560 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.051540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpvqm" event={"ID":"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d","Type":"ContainerStarted","Data":"0b8e1216e7aec55b955868cc017ae728f4241c18393033680bd6273598e7a49b"} Jun 03 21:03:21.052530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.052513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"a4c46b9d62b60b9b07184e3ab6fc7799856238711f603758530255954f0200be"} Jun 03 21:03:21.053474 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.053456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerStarted","Data":"222a81db4c2d8f49eec6163c8b3ce37397ad71ffca96033b6ec89b7f3e905ba9"} Jun 03 21:03:21.059479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.059434 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" podStartSLOduration=2.059420397 podStartE2EDuration="2.059420397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:21.059301566 +0000 UTC m=+3.467065062" watchObservedRunningTime="2026-06-03 21:03:21.059420397 +0000 UTC m=+3.467183891" Jun 03 21:03:21.592417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.592322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:21.592417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.592409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:21.592658 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.592553 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:21.592658 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.592618 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:23.592600309 +0000 UTC m=+6.000363785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:21.592805 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.592692 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:21.592805 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.592725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:23.59271426 +0000 UTC m=+6.000477736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:21.693835 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:21.693791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:21.694075 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.694007 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:21.694075 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.694027 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:21.694075 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.694040 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:21.694242 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:21.694112 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:23.69409046 +0000 UTC m=+6.101853935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:22.005577 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.005491 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:58:19 +0000 UTC" deadline="2028-01-06 14:54:16.983684096 +0000 UTC" Jun 03 21:03:22.005577 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.005525 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13961h50m54.978162865s" Jun 03 21:03:22.036953 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.036910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:22.037129 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:22.037043 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:22.037481 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.037458 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:22.037609 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:22.037587 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:22.037697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.037682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:22.038327 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:22.038285 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:22.068076 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.067092 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b2843120fa1fbceee6034eebb27c1fd" containerID="a585789fc4b5da04ae3899a154a318a9ce6a80433fc41cba3480ca766ff0f319" exitCode=0 Jun 03 21:03:22.068076 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:22.067803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" event={"ID":"9b2843120fa1fbceee6034eebb27c1fd","Type":"ContainerDied","Data":"a585789fc4b5da04ae3899a154a318a9ce6a80433fc41cba3480ca766ff0f319"} Jun 03 21:03:23.086936 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:23.086895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" event={"ID":"9b2843120fa1fbceee6034eebb27c1fd","Type":"ContainerStarted","Data":"750918bbe1d0537e2ff8943a2a0397b9d249af8ff4854cc74334202d1839af45"} Jun 03 21:03:23.101613 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:23.101549 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" podStartSLOduration=4.101526533 podStartE2EDuration="4.101526533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:23.101188198 +0000 UTC m=+5.508951694" watchObservedRunningTime="2026-06-03 21:03:23.101526533 +0000 UTC m=+5.509290028" Jun 03 21:03:23.612652 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:23.612611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:23.612862 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:23.612705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:23.612927 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.612879 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:23.612977 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.612948 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:27.612928197 +0000 UTC m=+10.020691673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:23.613371 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.613350 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:23.613459 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.613405 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:27.613390562 +0000 UTC m=+10.021154048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:23.713554 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:23.713511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:23.713786 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.713768 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:23.713873 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.713797 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:23.713873 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.713810 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:23.713873 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:23.713870 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:27.713851079 +0000 UTC m=+10.121614572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:24.036970 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:24.036419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:24.036970 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:24.036541 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:24.036970 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:24.036867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:24.037303 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:24.036973 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:24.037303 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:24.037005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:24.037303 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:24.037087 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:26.034353 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:26.033850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:26.034353 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:26.033880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:26.034353 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:26.033855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:26.034353 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:26.033998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:26.034353 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:26.034076 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:26.034353 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:26.034151 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:27.656127 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:27.655811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:27.656127 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:27.655899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:27.656127 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.655988 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:27.656127 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.656048 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:27.656127 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.656071 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:35.656047915 +0000 UTC m=+18.063811393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:27.656127 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.656100 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:35.656083904 +0000 UTC m=+18.063847400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:27.756982 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:27.756940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:27.757178 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.757108 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:27.757178 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.757123 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:27.757178 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.757134 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:27.757178 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:27.757179 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:35.757166912 +0000 UTC m=+18.164930384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:28.034105 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:28.034029 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:28.034259 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:28.034129 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:28.034487 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:28.034470 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:28.034594 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:28.034573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:28.034655 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:28.034643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:28.034731 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:28.034715 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:30.033940 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:30.033901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:30.034371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:30.033913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:30.034371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:30.033913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:30.034371 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:30.034143 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:30.034371 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:30.034075 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:30.034371 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:30.034195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:32.033782 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:32.033504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:32.034225 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:32.033896 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:32.034225 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:32.033504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:32.034225 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:32.033993 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:32.034225 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:32.033504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:32.034225 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:32.034083 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:34.033579 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:34.033103 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:34.033579 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:34.033116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:34.033579 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:34.033237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:34.033579 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:34.033117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:34.033579 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:34.033336 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:34.033579 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:34.033423 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:35.717156 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:35.717114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:35.717619 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:35.717201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:35.717619 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.717289 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:35.717619 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.717323 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:35.717619 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.717371 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:51.717345182 +0000 UTC m=+34.125108669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:35.717619 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.717472 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:51.717451391 +0000 UTC m=+34.125214867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:35.818450 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:35.818415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:35.818625 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.818605 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:35.818688 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.818627 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:35.818688 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.818638 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:35.818774 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:35.818693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:03:51.8186765 +0000 UTC m=+34.226439972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:36.033965 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:36.033876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:36.033965 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:36.033896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:36.034158 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:36.034027 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:36.034158 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:36.034071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:36.034224 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:36.034155 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:36.034224 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:36.034215 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:38.034117 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:38.034074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:38.034576 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:38.034170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:38.034576 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:38.034227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:38.034576 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:38.034291 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:38.034576 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:38.034335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:38.034576 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:38.034438 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:40.036719 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.036507 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:40.037422 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.036544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:40.037422 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:40.036848 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:40.037422 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.036565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:40.037422 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:40.036924 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:40.037422 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:40.037010 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:40.120398 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.120361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pg4px" event={"ID":"e42338e2-7f1b-4e1f-ac6f-435120ad5d7b","Type":"ContainerStarted","Data":"b19ed5ff48c9e5478f4da38c342563fd796c8794239d17194f55d9b91a275ce8"} Jun 03 21:03:40.121969 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.121937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jzphx" event={"ID":"96d00132-0d39-447e-88f5-582b18088ffe","Type":"ContainerStarted","Data":"f2cc91efcd251bab9b3c0c6a7256f7ae417fa32665fd4e25a66ea0104acbd134"} Jun 03 21:03:40.123282 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.123252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" event={"ID":"4d955804-3794-4b42-aa17-b7e80e29c55e","Type":"ContainerStarted","Data":"f86a044355452b47c73acb0b8b8f62b3bbcd1f36bfc10118dafb8f05c2a574a7"} Jun 03 21:03:40.124924 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.124902 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" event={"ID":"b5a5df89-4137-46d4-a281-8053b0b9aa16","Type":"ContainerStarted","Data":"5012bf7bd338907effb822a7ed03331bd7076d55e19537b5821290acf614a9c5"} Jun 03 21:03:40.126254 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.126234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpvqm" event={"ID":"7701e63f-aba1-45cc-bcd0-28d0ce89ef0d","Type":"ContainerStarted","Data":"67996113711fbf050b6aa63e6bf8ce1755cec6396e615849136a14eca17dd066"} Jun 03 21:03:40.128856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.128837 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:03:40.129220 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129201 2579 generic.go:356] "Generic (PLEG): container finished" podID="bacf5d35-0b7c-485e-8b7c-6a4d0b782a29" containerID="d2e0d3b4b12dacfab95148fe729a20e9a18b3be53860089d150579e5b664adb8" exitCode=1 Jun 03 21:03:40.129295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"aa6251c155b2156e1d7397266a41fe84af6aa31b2d3d06521ddb1e8d9bb674c7"} Jun 03 21:03:40.129352 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"aa692b98fded97b10bc6e89f89bcba403a3da6a8d753cbd2d9284cb5393a3947"} Jun 03 21:03:40.129413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"fb8fe7944e3540b6a4b3115feeb48c104e418c0c2337dd9867f91e20ccffe89a"} Jun 03 21:03:40.129413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"f9e90ae018aef276f2f8b18f1909588e6d1b2b5ee4e33cd7bda207aacc6ad3f1"} Jun 03 21:03:40.129495 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerDied","Data":"d2e0d3b4b12dacfab95148fe729a20e9a18b3be53860089d150579e5b664adb8"} Jun 03 21:03:40.129495 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.129449 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"80d3c2b8d9aff4ce399a018cc757b65f04d4d3ecea60029e8f92817ed44550f3"} Jun 03 21:03:40.130726 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.130705 2579 generic.go:356] "Generic (PLEG): container finished" podID="829e950d-fac9-4e3a-adb2-714d47920218" containerID="f08260551fab2255b9e88c94f6b84dacc862d4b57e6eccdf59db4e8b2e4675a7" exitCode=0 Jun 03 21:03:40.130834 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.130767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerDied","Data":"f08260551fab2255b9e88c94f6b84dacc862d4b57e6eccdf59db4e8b2e4675a7"} Jun 03 21:03:40.132298 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.132272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sz9zs" event={"ID":"3612e48c-9a99-4e0a-9a43-9bea4eaedd89","Type":"ContainerStarted","Data":"28c21490513a000e09b730f96cb8b07aa0583239beb89348ad8d650fe740a6e2"} Jun 03 21:03:40.134398 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.134356 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pg4px" podStartSLOduration=3.694798957 podStartE2EDuration="22.134343881s" totalImagesPullingTime="18.439544924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:40.134188115 +0000 UTC m=+22.541951610" watchObservedRunningTime="2026-06-03 21:03:40.134343881 +0000 UTC m=+22.542107375" Jun 03 21:03:40.147503 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.147437 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sz9zs" podStartSLOduration=3.6464861710000003 podStartE2EDuration="22.147421928s" totalImagesPullingTime="18.500935757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:40.147231451 +0000 UTC m=+22.554994945" watchObservedRunningTime="2026-06-03 21:03:40.147421928 +0000 UTC m=+22.555185423" Jun 03 21:03:40.163730 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.163680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lf8m" podStartSLOduration=3.659859972 podStartE2EDuration="22.16366036s" totalImagesPullingTime="18.503800388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:40.163287263 +0000 UTC m=+22.571050758" watchObservedRunningTime="2026-06-03 21:03:40.16366036 +0000 UTC m=+22.571423855" Jun 03 21:03:40.180391 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.180333 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xpvqm" podStartSLOduration=3.649137885 podStartE2EDuration="22.180316533s" totalImagesPullingTime="18.531178648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:40.179538499 +0000 UTC m=+22.587301991" watchObservedRunningTime="2026-06-03 21:03:40.180316533 +0000 UTC m=+22.588080027" Jun 03 21:03:40.215467 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:40.215417 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jzphx" podStartSLOduration=3.7712427 podStartE2EDuration="22.215399067s" totalImagesPullingTime="18.444156367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:40.214940925 +0000 UTC m=+22.622704419" watchObservedRunningTime="2026-06-03 21:03:40.215399067 +0000 UTC m=+22.623162595" Jun 03 21:03:41.016292 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.016002 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 21:03:41.034973 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.034886 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T21:03:41.01628758Z","UUID":"a8e98831-12ab-422f-96dc-649211ef8811","Handler":null,"Name":"","Endpoint":""} Jun 03 21:03:41.036508 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.036484 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 21:03:41.036616 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.036528 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 21:03:41.137080 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.137035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" event={"ID":"b5a5df89-4137-46d4-a281-8053b0b9aa16","Type":"ContainerStarted","Data":"4b6ca924943f924d6075c7560bb91b58ed66dd22d007d9773074986a855e3cf9"} Jun 03 21:03:41.138625 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.138600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g8b52" event={"ID":"03bc0ec1-445a-4d5e-a294-601a8d82894d","Type":"ContainerStarted","Data":"d09c537629043da8647f60075dd9308e0b2891dca2dfe22fb8dda19c780fefdc"} Jun 03 21:03:41.158657 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:41.156921 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g8b52" podStartSLOduration=4.658549508 podStartE2EDuration="23.15690195s" totalImagesPullingTime="18.498352442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:41.156201795 +0000 UTC m=+23.563965293" watchObservedRunningTime="2026-06-03 21:03:41.15690195 +0000 UTC m=+23.564665446" Jun 03 21:03:42.033715 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:42.033686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:42.033887 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:42.033686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:42.033887 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:42.033827 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:42.034004 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:42.033941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:42.034059 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:42.034014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:42.034146 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:42.034122 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:43.148504 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:43.148468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" event={"ID":"b5a5df89-4137-46d4-a281-8053b0b9aa16","Type":"ContainerStarted","Data":"589f797648d98ae175dd254c868d318610c1e7b7e1ade6d07c7b133507bf2ef7"} Jun 03 21:03:43.152015 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:43.151994 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:03:43.152413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:43.152391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"dd178db6e989168f031421ce8a5e8f01f8505bf22a3f7307653a921f429254d2"} Jun 03 21:03:43.166875 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:43.166802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99c9r" podStartSLOduration=4.443682974 podStartE2EDuration="25.166780349s" totalImagesPullingTime="20.723097375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:43.166028672 +0000 UTC m=+25.573792165" watchObservedRunningTime="2026-06-03 21:03:43.166780349 +0000 UTC m=+25.574543844" Jun 03 21:03:44.033791 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:44.033733 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:44.033985 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:44.033733 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:44.033985 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:44.033771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:44.033985 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:44.033893 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:44.034145 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:44.034016 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:44.034145 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:44.034090 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:44.450803 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:44.450567 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:44.935801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:44.935686 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:44.936258 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:44.936241 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:45.160304 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.160275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:03:45.160682 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.160657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"4e08b28344118ba10fb9f75f506764b984b3915cf9db4c2595de3d54f5f77d1f"} Jun 03 21:03:45.161104 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.160962 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:45.161104 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.161045 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:45.161253 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.161101 2579 scope.go:117] "RemoveContainer" containerID="d2e0d3b4b12dacfab95148fe729a20e9a18b3be53860089d150579e5b664adb8" Jun 03 21:03:45.162694 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.162671 2579 generic.go:356] "Generic (PLEG): container finished" podID="829e950d-fac9-4e3a-adb2-714d47920218" containerID="5a862b035703a4380dc2d74f34685ca614f3f27eabce7d22062b7946d1df0d05" exitCode=0 Jun 03 21:03:45.162801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.162767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerDied","Data":"5a862b035703a4380dc2d74f34685ca614f3f27eabce7d22062b7946d1df0d05"} Jun 03 21:03:45.163497 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.163438 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jzphx" Jun 03 21:03:45.180182 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:45.180151 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:46.033219 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.033132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:46.033219 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.033132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:46.033599 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.033133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:46.033599 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:46.033275 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:46.033599 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:46.033345 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:46.033599 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:46.033417 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:46.171259 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.171229 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:03:46.171626 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.171600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" event={"ID":"bacf5d35-0b7c-485e-8b7c-6a4d0b782a29","Type":"ContainerStarted","Data":"f56d9e1157eb4d5515adb23e40bef8460b0a19bc50f5a2bd0cf8dc4d8d801d3d"} Jun 03 21:03:46.171892 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.171876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:46.173964 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.173932 2579 generic.go:356] "Generic (PLEG): container finished" podID="829e950d-fac9-4e3a-adb2-714d47920218" containerID="42185bde75765ddf986e0bde6e06894d3ea4fe6c932f177706e08f2422f3a3fa" exitCode=0 Jun 03 21:03:46.174061 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.174019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerDied","Data":"42185bde75765ddf986e0bde6e06894d3ea4fe6c932f177706e08f2422f3a3fa"} Jun 03 21:03:46.188765 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.188712 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:03:46.198949 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:46.198896 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" podStartSLOduration=9.682959904 podStartE2EDuration="28.198882116s" totalImagesPullingTime="18.515922212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:46.197194989 +0000 UTC m=+28.604958484" watchObservedRunningTime="2026-06-03 21:03:46.198882116 +0000 UTC m=+28.606645610" Jun 03 21:03:47.178869 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:47.178771 2579 generic.go:356] "Generic (PLEG): container finished" podID="829e950d-fac9-4e3a-adb2-714d47920218" containerID="1e4b75549dcefb9ee746ede40a0929ed9a37ad60b42c5428908b518f6532708e" exitCode=0 Jun 03 21:03:47.178869 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:47.178834 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerDied","Data":"1e4b75549dcefb9ee746ede40a0929ed9a37ad60b42c5428908b518f6532708e"} Jun 03 21:03:48.037094 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:48.036336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:48.037094 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:48.036495 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:48.037629 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:48.037461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:48.037629 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:48.037584 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:48.037629 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:48.037627 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:48.037900 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:48.037756 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:50.038112 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:50.037856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:50.038537 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:50.037910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:50.038537 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:50.038223 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:50.038537 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:50.038310 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:50.038537 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:50.037910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:50.038537 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:50.038390 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:51.735257 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:51.735230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:51.735590 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:51.735297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:51.735590 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.735403 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:51.735590 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.735404 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:51.735590 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.735463 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret podName:8358b910-e09f-41bb-9158-0e65bf49e711 nodeName:}" failed. No retries permitted until 2026-06-03 21:04:23.735445455 +0000 UTC m=+66.143208944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret") pod "global-pull-secret-syncer-n7lph" (UID: "8358b910-e09f-41bb-9158-0e65bf49e711") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:03:51.735590 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.735477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs podName:4a29ca40-5f62-4e6a-9d30-f3275493d903 nodeName:}" failed. No retries permitted until 2026-06-03 21:04:23.735470727 +0000 UTC m=+66.143234200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs") pod "network-metrics-daemon-wgmqq" (UID: "4a29ca40-5f62-4e6a-9d30-f3275493d903") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:03:51.836100 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:51.836009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:51.836270 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.836165 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:03:51.836270 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.836186 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:03:51.836270 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.836197 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jqxm for pod openshift-network-diagnostics/network-check-target-5lwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:51.836270 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:51.836246 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm podName:27ae1d4c-1470-49b6-89d6-bfb8fd70dac8 nodeName:}" failed. No retries permitted until 2026-06-03 21:04:23.836231749 +0000 UTC m=+66.243995222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jqxm" (UniqueName: "kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm") pod "network-check-target-5lwc6" (UID: "27ae1d4c-1470-49b6-89d6-bfb8fd70dac8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:03:52.036539 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:52.036506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:52.036710 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:52.036591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:52.036710 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:52.036598 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:52.036710 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:52.036616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:52.036710 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:52.036682 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:52.036888 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:52.036759 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:52.192461 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:52.192423 2579 generic.go:356] "Generic (PLEG): container finished" podID="829e950d-fac9-4e3a-adb2-714d47920218" containerID="c372aef82f460d445f552dba6b3979c13d24a63bcdf159917c97ba6492d2d3e2" exitCode=0 Jun 03 21:03:52.192656 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:52.192478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerDied","Data":"c372aef82f460d445f552dba6b3979c13d24a63bcdf159917c97ba6492d2d3e2"} Jun 03 21:03:53.198044 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:53.198008 2579 generic.go:356] "Generic (PLEG): container finished" podID="829e950d-fac9-4e3a-adb2-714d47920218" containerID="78480bff3e3be883e25e97ec20ba2b6f48a1f8e0029b03cdab301fd1b53d4c54" exitCode=0 Jun 03 21:03:53.198044 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:53.198048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerDied","Data":"78480bff3e3be883e25e97ec20ba2b6f48a1f8e0029b03cdab301fd1b53d4c54"} Jun 03 21:03:54.036951 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:54.036919 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:54.037119 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:54.037012 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:54.037119 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:54.037023 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:54.037119 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:54.037038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:54.037119 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:54.037104 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:54.037253 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:54.037164 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:54.204081 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:54.204049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" event={"ID":"829e950d-fac9-4e3a-adb2-714d47920218","Type":"ContainerStarted","Data":"f3681254d611aa37a271f8427028063b08f24c4cd31728044779958b87db1ab0"} Jun 03 21:03:54.226644 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:54.226599 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxvrq" podStartSLOduration=8.053704404 podStartE2EDuration="36.226584606s" totalImagesPullingTime="28.172880202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:03:54.225167451 +0000 UTC m=+36.632930946" watchObservedRunningTime="2026-06-03 21:03:54.226584606 +0000 UTC m=+36.634348100" Jun 03 21:03:56.033539 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:56.033498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:56.034021 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:56.033498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:56.034021 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:56.033642 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:03:56.034021 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:56.033504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:56.034021 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:56.033684 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:56.034021 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:56.033771 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:58.036302 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:58.036267 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:03:58.036302 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:58.036302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:03:58.036874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:03:58.036282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:03:58.036874 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:58.036387 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:03:58.036874 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:58.036489 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:03:58.036874 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:03:58.036582 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:04:00.033476 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:00.033430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:00.034041 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:00.033430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:00.034041 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:00.033574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:04:00.034041 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:00.033437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:00.034041 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:00.033642 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:04:00.034041 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:00.033699 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:04:02.036926 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:02.036895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:02.037386 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:02.036995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:02.037386 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:02.036999 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:04:02.037386 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:02.037026 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:02.037386 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:02.037129 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:04:02.037386 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:02.037176 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:04:03.365216 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:03.365182 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lwc6"] Jun 03 21:04:03.365646 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:03.365311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:03.365646 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:03.365427 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:04:03.367479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:03.367444 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgmqq"] Jun 03 21:04:03.367608 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:03.367535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:03.367667 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:03.367622 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:04:03.378452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:03.378417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7lph"] Jun 03 21:04:03.378586 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:03.378541 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:03.378683 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:03.378660 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:04:05.034112 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:05.033930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:05.034566 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:05.033988 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:05.034566 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:05.034184 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:04:05.034566 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:05.034252 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:04:05.034566 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:05.033992 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:05.034566 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:05.034367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:04:07.033583 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.033545 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:07.033982 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.033590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:07.033982 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.033644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:07.033982 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:07.033656 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lph" podUID="8358b910-e09f-41bb-9158-0e65bf49e711" Jun 03 21:04:07.033982 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:07.033757 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wgmqq" podUID="4a29ca40-5f62-4e6a-9d30-f3275493d903" Jun 03 21:04:07.033982 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:07.033833 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lwc6" podUID="27ae1d4c-1470-49b6-89d6-bfb8fd70dac8" Jun 03 21:04:07.367203 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.367175 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeReady" Jun 03 21:04:07.367369 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.367294 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 21:04:07.401623 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.401584 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-859c8d746b-fsw9g"] Jun 03 21:04:07.423627 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.423598 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nbmlj"] Jun 03 21:04:07.423777 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.423731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.427784 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.426202 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 21:04:07.427784 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.426663 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 21:04:07.427784 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.426703 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6dbt2\"" Jun 03 21:04:07.427784 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.426890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 21:04:07.438781 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.438750 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 21:04:07.439413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.439393 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859c8d746b-fsw9g"] Jun 03 21:04:07.439528 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.439429 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8fkrw"] Jun 03 21:04:07.439528 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.439514 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.442084 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.442059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 21:04:07.442205 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.442152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q2nck\"" Jun 03 21:04:07.442367 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.442352 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 21:04:07.461641 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.461605 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nbmlj"] Jun 03 21:04:07.461826 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.461659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fkrw"] Jun 03 21:04:07.461826 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.461681 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k65zq"] Jun 03 21:04:07.461826 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.461812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.464314 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.464290 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 21:04:07.464475 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.464339 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 21:04:07.464475 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.464363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xx7cz\"" Jun 03 21:04:07.464475 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.464363 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 21:04:07.483797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.483733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k65zq"] Jun 03 21:04:07.483956 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.483851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.486677 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.486651 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 21:04:07.486839 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.486694 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-582rx\"" Jun 03 21:04:07.486839 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.486726 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 21:04:07.486839 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.486660 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 21:04:07.487142 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.487124 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 21:04:07.546423 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v72c\" (UniqueName: \"kubernetes.io/projected/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-kube-api-access-6v72c\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.546609 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/199a3043-a52b-4066-b15f-f4462191eeca-registry-certificates\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546609 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-metrics-tls\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.546609 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-registry-tls\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546609 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcggf\" (UniqueName: \"kubernetes.io/projected/05106a86-9f0e-450f-b001-75f9027ba521-kube-api-access-qcggf\") pod \"ingress-canary-8fkrw\" (UID: \"05106a86-9f0e-450f-b001-75f9027ba521\") " pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.546609 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/199a3043-a52b-4066-b15f-f4462191eeca-image-registry-private-configuration\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-bound-sa-token\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-config-volume\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/199a3043-a52b-4066-b15f-f4462191eeca-installation-pull-secrets\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05106a86-9f0e-450f-b001-75f9027ba521-cert\") pod \"ingress-canary-8fkrw\" (UID: \"05106a86-9f0e-450f-b001-75f9027ba521\") " pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/199a3043-a52b-4066-b15f-f4462191eeca-ca-trust-extracted\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/199a3043-a52b-4066-b15f-f4462191eeca-trusted-ca\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcw84\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-kube-api-access-gcw84\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.546986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.546839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-tmp-dir\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.647765 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcw84\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-kube-api-access-gcw84\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.647765 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-tmp-dir\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.647765 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v72c\" (UniqueName: \"kubernetes.io/projected/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-kube-api-access-6v72c\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-crio-socket\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/199a3043-a52b-4066-b15f-f4462191eeca-registry-certificates\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-metrics-tls\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-data-volume\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-registry-tls\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcggf\" (UniqueName: \"kubernetes.io/projected/05106a86-9f0e-450f-b001-75f9027ba521-kube-api-access-qcggf\") pod \"ingress-canary-8fkrw\" (UID: \"05106a86-9f0e-450f-b001-75f9027ba521\") " pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.647971 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.647968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/199a3043-a52b-4066-b15f-f4462191eeca-image-registry-private-configuration\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-bound-sa-token\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-config-volume\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/199a3043-a52b-4066-b15f-f4462191eeca-installation-pull-secrets\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tk7\" (UniqueName: \"kubernetes.io/projected/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-kube-api-access-94tk7\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648153 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05106a86-9f0e-450f-b001-75f9027ba521-cert\") pod \"ingress-canary-8fkrw\" (UID: \"05106a86-9f0e-450f-b001-75f9027ba521\") " pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/199a3043-a52b-4066-b15f-f4462191eeca-ca-trust-extracted\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/199a3043-a52b-4066-b15f-f4462191eeca-trusted-ca\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.648251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.648856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648831 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/199a3043-a52b-4066-b15f-f4462191eeca-registry-certificates\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.648856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.648849 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-tmp-dir\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.649196 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.649146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/199a3043-a52b-4066-b15f-f4462191eeca-ca-trust-extracted\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.649293 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.649280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-config-volume\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.649594 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.649566 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/199a3043-a52b-4066-b15f-f4462191eeca-trusted-ca\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.652538 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.652517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05106a86-9f0e-450f-b001-75f9027ba521-cert\") pod \"ingress-canary-8fkrw\" (UID: \"05106a86-9f0e-450f-b001-75f9027ba521\") " pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.652671 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.652547 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-metrics-tls\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.652671 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.652525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/199a3043-a52b-4066-b15f-f4462191eeca-installation-pull-secrets\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.652671 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.652571 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/199a3043-a52b-4066-b15f-f4462191eeca-image-registry-private-configuration\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.652671 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.652595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-registry-tls\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.656254 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.656229 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcw84\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-kube-api-access-gcw84\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.656254 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.656245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/199a3043-a52b-4066-b15f-f4462191eeca-bound-sa-token\") pod \"image-registry-859c8d746b-fsw9g\" (UID: \"199a3043-a52b-4066-b15f-f4462191eeca\") " pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.656844 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.656819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v72c\" (UniqueName: \"kubernetes.io/projected/d6d6475b-45e6-41a3-bd04-b0d52c3dc36b-kube-api-access-6v72c\") pod \"dns-default-nbmlj\" (UID: \"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b\") " pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.656934 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.656894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcggf\" (UniqueName: \"kubernetes.io/projected/05106a86-9f0e-450f-b001-75f9027ba521-kube-api-access-qcggf\") pod \"ingress-canary-8fkrw\" (UID: \"05106a86-9f0e-450f-b001-75f9027ba521\") " pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.737025 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.736979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:07.748176 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.748138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:07.749319 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.749376 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94tk7\" (UniqueName: \"kubernetes.io/projected/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-kube-api-access-94tk7\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.749376 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.749544 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-crio-socket\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.749596 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-data-volume\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.749804 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-crio-socket\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.749938 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.749920 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-data-volume\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.751839 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.751818 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.757441 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.757413 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tk7\" (UniqueName: \"kubernetes.io/projected/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-kube-api-access-94tk7\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.760305 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.760276 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k65zq\" (UID: \"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93\") " pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.770587 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.770559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fkrw" Jun 03 21:04:07.792960 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.792930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k65zq" Jun 03 21:04:07.978999 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.978945 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859c8d746b-fsw9g"] Jun 03 21:04:07.980480 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:07.980069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nbmlj"] Jun 03 21:04:08.013037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.012856 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fkrw"] Jun 03 21:04:08.027940 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.025687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k65zq"] Jun 03 21:04:08.028797 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:08.028765 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05106a86_9f0e_450f_b001_75f9027ba521.slice/crio-e7bc55bef45183427e4bc8432dd9f6b66988c8ce30d8e3b09387983c9acd1b22 WatchSource:0}: Error finding container e7bc55bef45183427e4bc8432dd9f6b66988c8ce30d8e3b09387983c9acd1b22: Status 404 returned error can't find the container with id e7bc55bef45183427e4bc8432dd9f6b66988c8ce30d8e3b09387983c9acd1b22 Jun 03 21:04:08.030435 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:08.030414 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3d0dad_8ba7_4a0e_ba64_5152d74e0d93.slice/crio-9259f2bffb47c552c411a0bf42a0a43bca81ccff2de5c3e3ce742f78b03c6e85 WatchSource:0}: Error finding container 9259f2bffb47c552c411a0bf42a0a43bca81ccff2de5c3e3ce742f78b03c6e85: Status 404 returned error can't find the container with id 9259f2bffb47c552c411a0bf42a0a43bca81ccff2de5c3e3ce742f78b03c6e85 Jun 03 21:04:08.239822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.239778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k65zq" event={"ID":"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93","Type":"ContainerStarted","Data":"b302d2f6ff520b4dfe92d5f72e3970f8142bf1efd09fac3a8808edbeebb1800d"} Jun 03 21:04:08.240384 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.239851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k65zq" event={"ID":"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93","Type":"ContainerStarted","Data":"9259f2bffb47c552c411a0bf42a0a43bca81ccff2de5c3e3ce742f78b03c6e85"} Jun 03 21:04:08.241011 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.240981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fkrw" event={"ID":"05106a86-9f0e-450f-b001-75f9027ba521","Type":"ContainerStarted","Data":"e7bc55bef45183427e4bc8432dd9f6b66988c8ce30d8e3b09387983c9acd1b22"} Jun 03 21:04:08.242240 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.242212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nbmlj" event={"ID":"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b","Type":"ContainerStarted","Data":"431d6b94245bf1c8b428dee18e90d483f6d60675fe660cb5096055c0dc258a91"} Jun 03 21:04:08.243810 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.243787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" event={"ID":"199a3043-a52b-4066-b15f-f4462191eeca","Type":"ContainerStarted","Data":"3953f82190f0f103dfacb0d144172dd8513aa5eebd91f8e723e692179fdf3eb0"} Jun 03 21:04:08.243932 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.243830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" event={"ID":"199a3043-a52b-4066-b15f-f4462191eeca","Type":"ContainerStarted","Data":"2bd3f1261eb82f36f7f8b009596d909034ffdc64d06b1ba19d351e04af26c266"} Jun 03 21:04:08.244057 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.244035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:08.261880 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:08.261828 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" podStartSLOduration=6.261811931 podStartE2EDuration="6.261811931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:08.261431824 +0000 UTC m=+50.669195309" watchObservedRunningTime="2026-06-03 21:04:08.261811931 +0000 UTC m=+50.669575425" Jun 03 21:04:09.033413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.033375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:09.033600 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.033394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:09.033600 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.033506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:09.037655 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.037630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:04:09.037655 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.037654 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:04:09.037900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.037701 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v2q8m\"" Jun 03 21:04:09.037900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.037654 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:04:09.037900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.037824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j2fvl\"" Jun 03 21:04:09.037900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:09.037835 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:04:11.256372 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.256174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nbmlj" event={"ID":"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b","Type":"ContainerStarted","Data":"c3b17c0d28579e57bd2fbba53ccdd3c9d914af039422a899cff94d687bd47a2f"} Jun 03 21:04:11.257164 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.256415 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:11.257164 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.256440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nbmlj" event={"ID":"d6d6475b-45e6-41a3-bd04-b0d52c3dc36b","Type":"ContainerStarted","Data":"13e79847c767a8e361f2af7b5b73f0486d17316bf968515ec0ee8df1e2b2615f"} Jun 03 21:04:11.258366 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.258336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k65zq" event={"ID":"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93","Type":"ContainerStarted","Data":"11cc28155a40fe27a9b555258a1450e8918333c2161d9646780ac4f9d243dfd1"} Jun 03 21:04:11.259856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.259830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fkrw" event={"ID":"05106a86-9f0e-450f-b001-75f9027ba521","Type":"ContainerStarted","Data":"d723f6f46594c561769db5d7326f55dd1f68cc12028a13e9aafa7ddb850e5ca2"} Jun 03 21:04:11.274823 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.274769 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nbmlj" podStartSLOduration=1.713580847 podStartE2EDuration="4.274731001s" totalImagesPullingTime="2.561150154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:11.274245559 +0000 UTC m=+53.682009054" watchObservedRunningTime="2026-06-03 21:04:11.274731001 +0000 UTC m=+53.682494495" Jun 03 21:04:11.290818 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:11.290730 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8fkrw" podStartSLOduration=1.76684821 podStartE2EDuration="4.290707412s" totalImagesPullingTime="2.523859202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:11.289379445 +0000 UTC m=+53.697142941" watchObservedRunningTime="2026-06-03 21:04:11.290707412 +0000 UTC m=+53.698470910" Jun 03 21:04:12.268190 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:12.268093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k65zq" event={"ID":"cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93","Type":"ContainerStarted","Data":"2a565814c997b1df91353dda8717ce68e05d3979ec4ab9b015c8ee38e60e31e1"} Jun 03 21:04:12.286848 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:12.286725 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k65zq" podStartSLOduration=1.574438576 podStartE2EDuration="5.286711568s" totalImagesPullingTime="3.712272992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:04:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:12.285215464 +0000 UTC m=+54.692978970" watchObservedRunningTime="2026-06-03 21:04:12.286711568 +0000 UTC m=+54.694475063" Jun 03 21:04:18.193701 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:18.193671 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spj7s" Jun 03 21:04:19.127899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.127855 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f"] Jun 03 21:04:19.130815 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.130796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.133277 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.133254 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 21:04:19.133395 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.133358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 21:04:19.133395 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.133378 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mfvgc\"" Jun 03 21:04:19.134465 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.134448 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 21:04:19.134530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.134491 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:04:19.134530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.134510 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 21:04:19.140587 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.140563 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-74x2l"] Jun 03 21:04:19.142549 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.142528 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.143957 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.143934 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f"] Jun 03 21:04:19.145325 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.145295 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 21:04:19.145422 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.145353 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 21:04:19.145422 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.145386 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nr6v5\"" Jun 03 21:04:19.145495 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.145430 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 21:04:19.238336 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-sys\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-tls\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-textfile\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879bb6ee-26ff-48b5-97a5-2af534c3995e-metrics-client-ca\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-accelerators-collector-config\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lwg\" (UniqueName: \"kubernetes.io/projected/879bb6ee-26ff-48b5-97a5-2af534c3995e-kube-api-access-q4lwg\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-root\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aa681d8-d40f-41b6-9329-ffb6108e63c1-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-wtmp\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.238790 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.238734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9hnd\" (UniqueName: \"kubernetes.io/projected/7aa681d8-d40f-41b6-9329-ffb6108e63c1-kube-api-access-w9hnd\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.339698 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-tls\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339698 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-textfile\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879bb6ee-26ff-48b5-97a5-2af534c3995e-metrics-client-ca\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-accelerators-collector-config\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lwg\" (UniqueName: \"kubernetes.io/projected/879bb6ee-26ff-48b5-97a5-2af534c3995e-kube-api-access-q4lwg\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-root\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aa681d8-d40f-41b6-9329-ffb6108e63c1-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-wtmp\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-root\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.339988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.339974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hnd\" (UniqueName: \"kubernetes.io/projected/7aa681d8-d40f-41b6-9329-ffb6108e63c1-kube-api-access-w9hnd\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-sys\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340113 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-textfile\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-sys\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340257 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-wtmp\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340389 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:19.340302 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 21:04:19.340711 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:19.340453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-tls podName:7aa681d8-d40f-41b6-9329-ffb6108e63c1 nodeName:}" failed. No retries permitted until 2026-06-03 21:04:19.840432597 +0000 UTC m=+62.248196084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-g9d8f" (UID: "7aa681d8-d40f-41b6-9329-ffb6108e63c1") : secret "openshift-state-metrics-tls" not found Jun 03 21:04:19.340711 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879bb6ee-26ff-48b5-97a5-2af534c3995e-metrics-client-ca\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340711 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340516 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-accelerators-collector-config\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.340858 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.340708 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aa681d8-d40f-41b6-9329-ffb6108e63c1-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.344077 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.344054 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-tls\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.344077 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.344075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879bb6ee-26ff-48b5-97a5-2af534c3995e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.344242 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.344169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.349016 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.348982 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9hnd\" (UniqueName: \"kubernetes.io/projected/7aa681d8-d40f-41b6-9329-ffb6108e63c1-kube-api-access-w9hnd\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.349352 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.349324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lwg\" (UniqueName: \"kubernetes.io/projected/879bb6ee-26ff-48b5-97a5-2af534c3995e-kube-api-access-q4lwg\") pod \"node-exporter-74x2l\" (UID: \"879bb6ee-26ff-48b5-97a5-2af534c3995e\") " pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.452061 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.452020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-74x2l" Jun 03 21:04:19.461732 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:19.461697 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879bb6ee_26ff_48b5_97a5_2af534c3995e.slice/crio-ba8be7be4cba9ba3ec2811b9f75bad96fda9ae05cdebe127bce73a37cbf88d84 WatchSource:0}: Error finding container ba8be7be4cba9ba3ec2811b9f75bad96fda9ae05cdebe127bce73a37cbf88d84: Status 404 returned error can't find the container with id ba8be7be4cba9ba3ec2811b9f75bad96fda9ae05cdebe127bce73a37cbf88d84 Jun 03 21:04:19.844247 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.844157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:19.847191 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:19.847152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aa681d8-d40f-41b6-9329-ffb6108e63c1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-g9d8f\" (UID: \"7aa681d8-d40f-41b6-9329-ffb6108e63c1\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:20.041418 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.041385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" Jun 03 21:04:20.199117 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.199079 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:04:20.202695 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.202658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.205136 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.205114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnpt2\"" Jun 03 21:04:20.206006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.205980 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 21:04:20.206096 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 21:04:20.206175 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 21:04:20.206227 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206183 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 21:04:20.206342 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206324 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 21:04:20.206432 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 21:04:20.206617 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206600 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 21:04:20.206732 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206713 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 21:04:20.206825 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.206791 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 21:04:20.219207 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.219180 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:04:20.300006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.299970 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74x2l" event={"ID":"879bb6ee-26ff-48b5-97a5-2af534c3995e","Type":"ContainerStarted","Data":"ba8be7be4cba9ba3ec2811b9f75bad96fda9ae05cdebe127bce73a37cbf88d84"} Jun 03 21:04:20.349168 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349300 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349300 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b77f9dc9-2f93-4c97-8895-2d593649563a-config-out\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349300 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b77f9dc9-2f93-4c97-8895-2d593649563a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349423 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349423 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349423 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-web-config\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349563 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6pv7\" (UniqueName: \"kubernetes.io/projected/b77f9dc9-2f93-4c97-8895-2d593649563a-kube-api-access-n6pv7\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349563 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349644 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349679 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-config-volume\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349721 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.349876 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.349729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.374031 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.373998 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f"] Jun 03 21:04:20.378226 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:20.378191 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa681d8_d40f_41b6_9329_ffb6108e63c1.slice/crio-f0d041480c825b582c637eee9350068ef64ee0fe7c6b58289ec2c8243177f051 WatchSource:0}: Error finding container f0d041480c825b582c637eee9350068ef64ee0fe7c6b58289ec2c8243177f051: Status 404 returned error can't find the container with id f0d041480c825b582c637eee9350068ef64ee0fe7c6b58289ec2c8243177f051 Jun 03 21:04:20.450563 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.450668 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b77f9dc9-2f93-4c97-8895-2d593649563a-config-out\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.450668 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b77f9dc9-2f93-4c97-8895-2d593649563a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.450668 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.450860 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:20.450704 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-trusted-ca-bundle podName:b77f9dc9-2f93-4c97-8895-2d593649563a nodeName:}" failed. No retries permitted until 2026-06-03 21:04:20.950682041 +0000 UTC m=+63.358445518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b77f9dc9-2f93-4c97-8895-2d593649563a") : configmap references non-existent config key: ca-bundle.crt Jun 03 21:04:20.450860 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.450860 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-web-config\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.450860 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6pv7\" (UniqueName: \"kubernetes.io/projected/b77f9dc9-2f93-4c97-8895-2d593649563a-kube-api-access-n6pv7\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-config-volume\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.450998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.451036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451265 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.451060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.451641 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:20.451617 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 21:04:20.451731 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:04:20.451681 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-main-tls podName:b77f9dc9-2f93-4c97-8895-2d593649563a nodeName:}" failed. No retries permitted until 2026-06-03 21:04:20.95166433 +0000 UTC m=+63.359427808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b77f9dc9-2f93-4c97-8895-2d593649563a") : secret "alertmanager-main-tls" not found Jun 03 21:04:20.452431 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.452242 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.453037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.453015 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.453646 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.453580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b77f9dc9-2f93-4c97-8895-2d593649563a-config-out\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.454655 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.454632 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-web-config\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.454775 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.454638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.455100 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.455077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.455543 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.455525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-config-volume\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.455828 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.455806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.456912 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.456893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b77f9dc9-2f93-4c97-8895-2d593649563a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.457526 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.457507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.459859 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.459661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6pv7\" (UniqueName: \"kubernetes.io/projected/b77f9dc9-2f93-4c97-8895-2d593649563a-kube-api-access-n6pv7\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.955025 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.954983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.955226 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.955097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.955906 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.955865 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b77f9dc9-2f93-4c97-8895-2d593649563a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:20.958008 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:20.957979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b77f9dc9-2f93-4c97-8895-2d593649563a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b77f9dc9-2f93-4c97-8895-2d593649563a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:21.115786 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.115731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:04:21.270885 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.270854 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nbmlj" Jun 03 21:04:21.306625 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.306589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" event={"ID":"7aa681d8-d40f-41b6-9329-ffb6108e63c1","Type":"ContainerStarted","Data":"d6661de85b6cdc88caab28d360c862a22a21a7f99d20a5e5c3f5858863347251"} Jun 03 21:04:21.307063 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.306659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" event={"ID":"7aa681d8-d40f-41b6-9329-ffb6108e63c1","Type":"ContainerStarted","Data":"3e24cfaae3f3c5e51731af38263e154b2d76a32f5a69db6b092122b195dc29dd"} Jun 03 21:04:21.307063 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.306686 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" event={"ID":"7aa681d8-d40f-41b6-9329-ffb6108e63c1","Type":"ContainerStarted","Data":"f0d041480c825b582c637eee9350068ef64ee0fe7c6b58289ec2c8243177f051"} Jun 03 21:04:21.308403 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.308376 2579 generic.go:356] "Generic (PLEG): container finished" podID="879bb6ee-26ff-48b5-97a5-2af534c3995e" containerID="248e420923a552ccaec70cfd9181039624365f25cb830e92b2f742381d9b442b" exitCode=0 Jun 03 21:04:21.308543 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.308418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74x2l" event={"ID":"879bb6ee-26ff-48b5-97a5-2af534c3995e","Type":"ContainerDied","Data":"248e420923a552ccaec70cfd9181039624365f25cb830e92b2f742381d9b442b"} Jun 03 21:04:21.378494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:21.378454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:04:21.381709 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:21.381670 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77f9dc9_2f93_4c97_8895_2d593649563a.slice/crio-65dc18217d51b88b8ef98c9d706e02ca0b974d295c9df9c1fd59d5d00473d1ad WatchSource:0}: Error finding container 65dc18217d51b88b8ef98c9d706e02ca0b974d295c9df9c1fd59d5d00473d1ad: Status 404 returned error can't find the container with id 65dc18217d51b88b8ef98c9d706e02ca0b974d295c9df9c1fd59d5d00473d1ad Jun 03 21:04:22.120068 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.120032 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86b6d4648f-6tdqm"] Jun 03 21:04:22.123697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.123674 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.126208 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.126174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 21:04:22.126513 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.126433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 21:04:22.126513 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.126447 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 21:04:22.126513 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.126438 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xwnwn\"" Jun 03 21:04:22.126513 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.126457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c4liihe4lqs1t\"" Jun 03 21:04:22.127365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.127346 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 21:04:22.127475 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.127365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 21:04:22.138987 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.138954 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b6d4648f-6tdqm"] Jun 03 21:04:22.164154 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164346 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164346 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164346 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164346 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpq5q\" (UniqueName: \"kubernetes.io/projected/90f7833f-e303-45a0-a057-7521d9153ba3-kube-api-access-fpq5q\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164507 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-tls\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164507 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-grpc-tls\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.164507 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.164436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90f7833f-e303-45a0-a057-7521d9153ba3-metrics-client-ca\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.264856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.264822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.264869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.264894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.264918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpq5q\" (UniqueName: \"kubernetes.io/projected/90f7833f-e303-45a0-a057-7521d9153ba3-kube-api-access-fpq5q\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.264963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-tls\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.264986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-grpc-tls\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.265008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90f7833f-e303-45a0-a057-7521d9153ba3-metrics-client-ca\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.265313 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.265054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.266455 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.266365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90f7833f-e303-45a0-a057-7521d9153ba3-metrics-client-ca\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.268175 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.267772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.268175 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.268133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.269212 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.269173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.270156 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.270133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.270292 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.270272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-grpc-tls\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.270345 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.270327 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90f7833f-e303-45a0-a057-7521d9153ba3-secret-thanos-querier-tls\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.276685 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.276665 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpq5q\" (UniqueName: \"kubernetes.io/projected/90f7833f-e303-45a0-a057-7521d9153ba3-kube-api-access-fpq5q\") pod \"thanos-querier-86b6d4648f-6tdqm\" (UID: \"90f7833f-e303-45a0-a057-7521d9153ba3\") " pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.313932 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.313898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74x2l" event={"ID":"879bb6ee-26ff-48b5-97a5-2af534c3995e","Type":"ContainerStarted","Data":"f6bd28c1f0275bc97c82c93dc273fc722019b5459995564f81259437219e4516"} Jun 03 21:04:22.314370 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.313958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74x2l" event={"ID":"879bb6ee-26ff-48b5-97a5-2af534c3995e","Type":"ContainerStarted","Data":"d2e31af7261bacb463d10ec37dc8e8e66f96b79085a1ca4180804eefdbd736e3"} Jun 03 21:04:22.315966 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.315941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" event={"ID":"7aa681d8-d40f-41b6-9329-ffb6108e63c1","Type":"ContainerStarted","Data":"a1f6f8b3a93b2ea9b1fad6fb95d5b634b6613f3ff778d9779e943b5e0a5a55c1"} Jun 03 21:04:22.320806 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.320777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"65dc18217d51b88b8ef98c9d706e02ca0b974d295c9df9c1fd59d5d00473d1ad"} Jun 03 21:04:22.333163 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.333113 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-74x2l" podStartSLOduration=2.443138924 podStartE2EDuration="3.333098893s" totalImagesPullingTime="808.236899ms" totalInitContainerRuntime="81.72307ms" isStatefulPod=true podCreationTimestamp="2026-06-03 21:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:22.332098921 +0000 UTC m=+64.739862416" watchObservedRunningTime="2026-06-03 21:04:22.333098893 +0000 UTC m=+64.740862366" Jun 03 21:04:22.348929 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.348871 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-g9d8f" podStartSLOduration=2.598221969 podStartE2EDuration="3.348850285s" totalImagesPullingTime="750.628316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:22.347160501 +0000 UTC m=+64.754923996" watchObservedRunningTime="2026-06-03 21:04:22.348850285 +0000 UTC m=+64.756613782" Jun 03 21:04:22.435299 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.435257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:22.568420 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:22.568396 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b6d4648f-6tdqm"] Jun 03 21:04:22.570764 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:22.570722 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f7833f_e303_45a0_a057_7521d9153ba3.slice/crio-2d9c59780266386a894b5c9bdb9e7b6de03d20d4d9a4d75d9b12177054f48dae WatchSource:0}: Error finding container 2d9c59780266386a894b5c9bdb9e7b6de03d20d4d9a4d75d9b12177054f48dae: Status 404 returned error can't find the container with id 2d9c59780266386a894b5c9bdb9e7b6de03d20d4d9a4d75d9b12177054f48dae Jun 03 21:04:23.327174 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.327125 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"2d9c59780266386a894b5c9bdb9e7b6de03d20d4d9a4d75d9b12177054f48dae"} Jun 03 21:04:23.328892 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.328863 2579 generic.go:356] "Generic (PLEG): container finished" podID="b77f9dc9-2f93-4c97-8895-2d593649563a" containerID="b41ae3289707973dec773fbe7a6f06f66035fe3998e67b1c0719d51a4e25b27a" exitCode=0 Jun 03 21:04:23.329029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.328949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerDied","Data":"b41ae3289707973dec773fbe7a6f06f66035fe3998e67b1c0719d51a4e25b27a"} Jun 03 21:04:23.778350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.778304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:23.778350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.778355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:23.780796 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.780774 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:04:23.781757 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.781731 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:04:23.790977 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.790952 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358b910-e09f-41bb-9158-0e65bf49e711-original-pull-secret\") pod \"global-pull-secret-syncer-n7lph\" (UID: \"8358b910-e09f-41bb-9158-0e65bf49e711\") " pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:23.791122 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.791102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a29ca40-5f62-4e6a-9d30-f3275493d903-metrics-certs\") pod \"network-metrics-daemon-wgmqq\" (UID: \"4a29ca40-5f62-4e6a-9d30-f3275493d903\") " pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:23.879224 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.879167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:23.882415 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.882390 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:04:23.891954 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.891928 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:04:23.902834 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:23.902806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jqxm\" (UniqueName: \"kubernetes.io/projected/27ae1d4c-1470-49b6-89d6-bfb8fd70dac8-kube-api-access-2jqxm\") pod \"network-check-target-5lwc6\" (UID: \"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8\") " pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:24.046806 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.046702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lph" Jun 03 21:04:24.056872 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.056842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v2q8m\"" Jun 03 21:04:24.062949 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.062920 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j2fvl\"" Jun 03 21:04:24.064998 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.064962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wgmqq" Jun 03 21:04:24.071379 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.071356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:24.581363 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.581112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7lph"] Jun 03 21:04:24.615184 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.615086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lwc6"] Jun 03 21:04:24.619540 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:24.619450 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ae1d4c_1470_49b6_89d6_bfb8fd70dac8.slice/crio-7ea663ae8a37be46a8a426063d56b7231ce7db920c0b5408d545f18316f38ad7 WatchSource:0}: Error finding container 7ea663ae8a37be46a8a426063d56b7231ce7db920c0b5408d545f18316f38ad7: Status 404 returned error can't find the container with id 7ea663ae8a37be46a8a426063d56b7231ce7db920c0b5408d545f18316f38ad7 Jun 03 21:04:24.816335 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:24.816294 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wgmqq"] Jun 03 21:04:24.967697 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:04:24.967626 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a29ca40_5f62_4e6a_9d30_f3275493d903.slice/crio-35949e1ddb923f7dfe3c39af1e127f6a71452d84346936bdf455eb7d7d9df4f2 WatchSource:0}: Error finding container 35949e1ddb923f7dfe3c39af1e127f6a71452d84346936bdf455eb7d7d9df4f2: Status 404 returned error can't find the container with id 35949e1ddb923f7dfe3c39af1e127f6a71452d84346936bdf455eb7d7d9df4f2 Jun 03 21:04:25.346267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.346228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"19aec9f9f3ee6b08c2265dd5de649dcd961e58617a6d212a127a4660f380ca13"} Jun 03 21:04:25.346465 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.346362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"a9575620a110b8d690540d34b1a6803d63e34faae332bc4809eac68f4daa7ba1"} Jun 03 21:04:25.346465 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.346428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"b1aecba5b7b85ce9a3f4c412ed0738a04cfcf750a6c7b607331a6aee8ace73f7"} Jun 03 21:04:25.346589 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.346469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"e9c35aa8a06f919254cb0d3d01c2de5e545b99de29cabc36d672c699779c561a"} Jun 03 21:04:25.348818 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.348751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lwc6" event={"ID":"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8","Type":"ContainerStarted","Data":"7ea663ae8a37be46a8a426063d56b7231ce7db920c0b5408d545f18316f38ad7"} Jun 03 21:04:25.350179 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.350121 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7lph" event={"ID":"8358b910-e09f-41bb-9158-0e65bf49e711","Type":"ContainerStarted","Data":"9c54453062cd740c40e92d57b414ec841fa03d765bb65bab8e16cc9f5afbd64f"} Jun 03 21:04:25.353022 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.352993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"dd2fdfe055691169a36142479be8b052fee03d7a6c85b31a1898b52420931f9f"} Jun 03 21:04:25.353148 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.353072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"878d607bee006ce84acfb00dac01a9b18462a850e8bcf307270858190cf31bbc"} Jun 03 21:04:25.353148 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.353127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"ec5d0ff4b93e4095df4871d1015210d5bcacbfc87c9ab302c5c701a08ce2b556"} Jun 03 21:04:25.354448 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:25.354393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgmqq" event={"ID":"4a29ca40-5f62-4e6a-9d30-f3275493d903","Type":"ContainerStarted","Data":"35949e1ddb923f7dfe3c39af1e127f6a71452d84346936bdf455eb7d7d9df4f2"} Jun 03 21:04:26.369159 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:26.368886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"98a5536f23efc3a53240795a960afbda1f5353a0cf1631984451853a36215b1a"} Jun 03 21:04:26.374271 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:26.374183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgmqq" event={"ID":"4a29ca40-5f62-4e6a-9d30-f3275493d903","Type":"ContainerStarted","Data":"cad565c534829a320cc1a6e3b6f7d68a08452719dbee82efd788d52475f41144"} Jun 03 21:04:26.382355 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:26.382204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"a076c8ccb3f0236d3d4da7852147aa3517066fd0f61854ea970270fc2a7f1bb9"} Jun 03 21:04:26.382355 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:26.382283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b77f9dc9-2f93-4c97-8895-2d593649563a","Type":"ContainerStarted","Data":"44f8e045b8890e925f9a49625fdfc055e010ebd151c5fa030b36ca19c4d6b02e"} Jun 03 21:04:26.412926 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:26.412608 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.965017561 podStartE2EDuration="6.412583936s" totalImagesPullingTime="3.43191046s" totalInitContainerRuntime="15.655915ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:04:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:26.410044901 +0000 UTC m=+68.817808395" watchObservedRunningTime="2026-06-03 21:04:26.412583936 +0000 UTC m=+68.820347431" Jun 03 21:04:27.390814 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:27.390775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"03ca7d79389eee40b044c681bf6b39459dd0a2d5a147154e576126dc5c8cea99"} Jun 03 21:04:27.391298 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:27.390858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" event={"ID":"90f7833f-e303-45a0-a057-7521d9153ba3","Type":"ContainerStarted","Data":"876bd26e654b264c6c0776a3f28ac94f9706b0c05ba29a9acc37626961e1ec82"} Jun 03 21:04:27.391298 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:27.391034 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:04:27.393726 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:27.393693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wgmqq" event={"ID":"4a29ca40-5f62-4e6a-9d30-f3275493d903","Type":"ContainerStarted","Data":"c113120eaa29e036e6b78c2862d3f0ce8df6952e6a9c3221a96c95e0acbc6f4a"} Jun 03 21:04:27.414463 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:27.414396 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" podStartSLOduration=2.392576595 podStartE2EDuration="5.414375595s" totalImagesPullingTime="3.021799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:04:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:27.412628413 +0000 UTC m=+69.820391930" watchObservedRunningTime="2026-06-03 21:04:27.414375595 +0000 UTC m=+69.822139090" Jun 03 21:04:27.427632 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:27.427570 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wgmqq" podStartSLOduration=68.204626036 podStartE2EDuration="1m9.427546226s" totalImagesPullingTime="1.22292019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:27.426797757 +0000 UTC m=+69.834561247" watchObservedRunningTime="2026-06-03 21:04:27.427546226 +0000 UTC m=+69.835309722" Jun 03 21:04:29.253007 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:29.252977 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-859c8d746b-fsw9g" Jun 03 21:04:30.407094 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:30.407051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lwc6" event={"ID":"27ae1d4c-1470-49b6-89d6-bfb8fd70dac8","Type":"ContainerStarted","Data":"526c0cf691182578932c0f9c010b94b4e021368e4d57181ddc2391b6a0068fdd"} Jun 03 21:04:30.407537 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:30.407211 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:04:30.408458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:30.408434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7lph" event={"ID":"8358b910-e09f-41bb-9158-0e65bf49e711","Type":"ContainerStarted","Data":"e375248a3bc1115e19497293d207e733e027013e93a3382a5f5e0f222e078bc3"} Jun 03 21:04:30.422825 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:30.422772 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5lwc6" podStartSLOduration=67.657979984 podStartE2EDuration="1m12.422727789s" totalImagesPullingTime="4.764747805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:30.422659694 +0000 UTC m=+72.830423189" watchObservedRunningTime="2026-06-03 21:04:30.422727789 +0000 UTC m=+72.830491287" Jun 03 21:04:30.441292 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:30.441236 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n7lph" podStartSLOduration=67.640807779 podStartE2EDuration="1m12.441221896s" totalImagesPullingTime="4.800414117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:04:30.440447247 +0000 UTC m=+72.848210741" watchObservedRunningTime="2026-06-03 21:04:30.441221896 +0000 UTC m=+72.848985391" Jun 03 21:04:33.403835 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:04:33.403703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86b6d4648f-6tdqm" Jun 03 21:05:01.414926 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:01.414895 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5lwc6" Jun 03 21:05:43.369698 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.369665 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7485f945f8-p6gvv"] Jun 03 21:05:43.371977 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.371960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.374595 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.374570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-65gqn\"" Jun 03 21:05:43.374728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.374571 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 21:05:43.374728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.374571 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 21:05:43.374871 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.374773 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 21:05:43.374871 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.374815 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 21:05:43.374981 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.374960 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 21:05:43.379279 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.379252 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 21:05:43.384351 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.384325 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7485f945f8-p6gvv"] Jun 03 21:05:43.502291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-secret-telemeter-client\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-federate-client-tls\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502510 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502510 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-telemeter-client-tls\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502510 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502510 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7ld7\" (UniqueName: \"kubernetes.io/projected/0440cae2-beff-497a-830e-52367e451783-kube-api-access-s7ld7\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502632 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-serving-certs-ca-bundle\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.502632 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.502569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-metrics-client-ca\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.603973 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.603940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-serving-certs-ca-bundle\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604054 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.603978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-metrics-client-ca\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604054 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-secret-telemeter-client\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604054 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-federate-client-tls\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604171 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604171 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-telemeter-client-tls\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604171 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604171 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7ld7\" (UniqueName: \"kubernetes.io/projected/0440cae2-beff-497a-830e-52367e451783-kube-api-access-s7ld7\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.604810 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604780 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-metrics-client-ca\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.605041 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.604986 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-serving-certs-ca-bundle\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.605354 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.605285 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0440cae2-beff-497a-830e-52367e451783-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.606840 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.606815 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-federate-client-tls\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.606944 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.606885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-secret-telemeter-client\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.606983 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.606964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.607017 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.606991 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0440cae2-beff-497a-830e-52367e451783-telemeter-client-tls\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.612905 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.612879 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7ld7\" (UniqueName: \"kubernetes.io/projected/0440cae2-beff-497a-830e-52367e451783-kube-api-access-s7ld7\") pod \"telemeter-client-7485f945f8-p6gvv\" (UID: \"0440cae2-beff-497a-830e-52367e451783\") " pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.682254 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.682155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" Jun 03 21:05:43.830854 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:43.828923 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7485f945f8-p6gvv"] Jun 03 21:05:43.832791 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:05:43.832754 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0440cae2_beff_497a_830e_52367e451783.slice/crio-00ae6ae2198a98b779328198d4185bc39153d494dcb05318e842a090eb232f2a WatchSource:0}: Error finding container 00ae6ae2198a98b779328198d4185bc39153d494dcb05318e842a090eb232f2a: Status 404 returned error can't find the container with id 00ae6ae2198a98b779328198d4185bc39153d494dcb05318e842a090eb232f2a Jun 03 21:05:44.668793 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:44.668756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" event={"ID":"0440cae2-beff-497a-830e-52367e451783","Type":"ContainerStarted","Data":"00ae6ae2198a98b779328198d4185bc39153d494dcb05318e842a090eb232f2a"} Jun 03 21:05:46.682357 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:46.682322 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" event={"ID":"0440cae2-beff-497a-830e-52367e451783","Type":"ContainerStarted","Data":"b83b33a84cfc559ee3a92c0e7473739e4bf934c0d46aafc5e03e55f47eaaf352"} Jun 03 21:05:46.682878 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:46.682393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" event={"ID":"0440cae2-beff-497a-830e-52367e451783","Type":"ContainerStarted","Data":"f80f7f823f9b8f32e170c6961fcc3b118a04912324fb9c6e4cb8f13eb1a0a993"} Jun 03 21:05:46.682878 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:46.682419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" event={"ID":"0440cae2-beff-497a-830e-52367e451783","Type":"ContainerStarted","Data":"6f4acbb77481f7f50ddc93d309466f20c767d17586667d3f19a035e49369480e"} Jun 03 21:05:46.704384 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:05:46.704323 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7485f945f8-p6gvv" podStartSLOduration=1.8689132590000002 podStartE2EDuration="3.704305213s" totalImagesPullingTime="1.835391954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:05:46.702150212 +0000 UTC m=+149.109913706" watchObservedRunningTime="2026-06-03 21:05:46.704305213 +0000 UTC m=+149.112068708" Jun 03 21:06:50.954871 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:50.954826 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps"] Jun 03 21:06:50.957402 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:50.957382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:50.959975 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:50.959944 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 21:06:50.960139 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:50.959948 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ns9wx\"" Jun 03 21:06:50.960953 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:50.960920 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 21:06:50.967532 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:50.967479 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps"] Jun 03 21:06:51.038033 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.038001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.038033 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.038036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztgv9\" (UniqueName: \"kubernetes.io/projected/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-kube-api-access-ztgv9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.038249 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.038059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.139210 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.139157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.139418 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.139295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.139418 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.139314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztgv9\" (UniqueName: \"kubernetes.io/projected/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-kube-api-access-ztgv9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.139678 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.139654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.139723 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.139687 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.147521 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.147496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztgv9\" (UniqueName: \"kubernetes.io/projected/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-kube-api-access-ztgv9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.267292 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.267208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:06:51.403689 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.403523 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps"] Jun 03 21:06:51.406159 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:06:51.406133 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5c7c33_bc14_45f1_9f69_1b6ba8683f15.slice/crio-1203a82a3247bec6da8a90cb4c1329c904c103eabc691bf8512e5dbd78adffc9 WatchSource:0}: Error finding container 1203a82a3247bec6da8a90cb4c1329c904c103eabc691bf8512e5dbd78adffc9: Status 404 returned error can't find the container with id 1203a82a3247bec6da8a90cb4c1329c904c103eabc691bf8512e5dbd78adffc9 Jun 03 21:06:51.910148 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:51.910111 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" event={"ID":"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15","Type":"ContainerStarted","Data":"1203a82a3247bec6da8a90cb4c1329c904c103eabc691bf8512e5dbd78adffc9"} Jun 03 21:06:57.937191 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:57.937159 2579 generic.go:356] "Generic (PLEG): container finished" podID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerID="ef9ead2d7f450edcdc910ae8d3d327a4b79876fbf5f78e947de4b54fe90b72bd" exitCode=0 Jun 03 21:06:57.937615 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:57.937201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" event={"ID":"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15","Type":"ContainerDied","Data":"ef9ead2d7f450edcdc910ae8d3d327a4b79876fbf5f78e947de4b54fe90b72bd"} Jun 03 21:06:59.947224 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:06:59.947178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" event={"ID":"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15","Type":"ContainerStarted","Data":"0ab5e72631844588db8f89252202be15fcdf7418e4bcf61bc3d3043914bfe987"} Jun 03 21:07:00.952959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:00.952917 2579 generic.go:356] "Generic (PLEG): container finished" podID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerID="0ab5e72631844588db8f89252202be15fcdf7418e4bcf61bc3d3043914bfe987" exitCode=0 Jun 03 21:07:00.953327 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:00.952963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" event={"ID":"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15","Type":"ContainerDied","Data":"0ab5e72631844588db8f89252202be15fcdf7418e4bcf61bc3d3043914bfe987"} Jun 03 21:07:08.985082 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:08.985039 2579 generic.go:356] "Generic (PLEG): container finished" podID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerID="0944b2e9381243fce0af1964cce0fb2709e6f5aa1305b2e30f41b9e1780cc7f3" exitCode=0 Jun 03 21:07:08.985082 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:08.985083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" event={"ID":"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15","Type":"ContainerDied","Data":"0944b2e9381243fce0af1964cce0fb2709e6f5aa1305b2e30f41b9e1780cc7f3"} Jun 03 21:07:10.115081 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.115055 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:07:10.211899 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.211858 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztgv9\" (UniqueName: \"kubernetes.io/projected/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-kube-api-access-ztgv9\") pod \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " Jun 03 21:07:10.212107 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.211919 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-bundle\") pod \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " Jun 03 21:07:10.212107 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.212020 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-util\") pod \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\" (UID: \"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15\") " Jun 03 21:07:10.212617 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.212590 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-bundle" (OuterVolumeSpecName: "bundle") pod "ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" (UID: "ec5c7c33-bc14-45f1-9f69-1b6ba8683f15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:07:10.214282 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.214265 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-kube-api-access-ztgv9" (OuterVolumeSpecName: "kube-api-access-ztgv9") pod "ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" (UID: "ec5c7c33-bc14-45f1-9f69-1b6ba8683f15"). InnerVolumeSpecName "kube-api-access-ztgv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:07:10.216506 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.216484 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-util" (OuterVolumeSpecName: "util") pod "ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" (UID: "ec5c7c33-bc14-45f1-9f69-1b6ba8683f15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:07:10.312771 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.312654 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:10.312771 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.312693 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztgv9\" (UniqueName: \"kubernetes.io/projected/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-kube-api-access-ztgv9\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:10.312771 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.312705 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec5c7c33-bc14-45f1-9f69-1b6ba8683f15-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:10.994270 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.994240 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" Jun 03 21:07:10.994270 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.994265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhn7ps" event={"ID":"ec5c7c33-bc14-45f1-9f69-1b6ba8683f15","Type":"ContainerDied","Data":"1203a82a3247bec6da8a90cb4c1329c904c103eabc691bf8512e5dbd78adffc9"} Jun 03 21:07:10.994490 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:10.994310 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1203a82a3247bec6da8a90cb4c1329c904c103eabc691bf8512e5dbd78adffc9" Jun 03 21:07:18.685006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.684965 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8"] Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685249 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="pull" Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685260 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="pull" Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685269 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="util" Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685274 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="util" Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685281 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="extract" Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685287 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="extract" Jun 03 21:07:18.685466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.685329 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5c7c33-bc14-45f1-9f69-1b6ba8683f15" containerName="extract" Jun 03 21:07:18.687168 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.687151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.689982 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.689955 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6ft7p\"" Jun 03 21:07:18.689982 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.689978 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 21:07:18.690207 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.689960 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:07:18.702597 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.702555 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8"] Jun 03 21:07:18.779856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.779811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkd4p\" (UniqueName: \"kubernetes.io/projected/243a7837-0708-44dc-a68b-6cf54de2099e-kube-api-access-xkd4p\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bp5l8\" (UID: \"243a7837-0708-44dc-a68b-6cf54de2099e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.779856 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.779856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/243a7837-0708-44dc-a68b-6cf54de2099e-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bp5l8\" (UID: \"243a7837-0708-44dc-a68b-6cf54de2099e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.880786 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.880719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkd4p\" (UniqueName: \"kubernetes.io/projected/243a7837-0708-44dc-a68b-6cf54de2099e-kube-api-access-xkd4p\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bp5l8\" (UID: \"243a7837-0708-44dc-a68b-6cf54de2099e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.880786 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.880784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/243a7837-0708-44dc-a68b-6cf54de2099e-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bp5l8\" (UID: \"243a7837-0708-44dc-a68b-6cf54de2099e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.881140 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.881125 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/243a7837-0708-44dc-a68b-6cf54de2099e-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bp5l8\" (UID: \"243a7837-0708-44dc-a68b-6cf54de2099e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.889251 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.889213 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkd4p\" (UniqueName: \"kubernetes.io/projected/243a7837-0708-44dc-a68b-6cf54de2099e-kube-api-access-xkd4p\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bp5l8\" (UID: \"243a7837-0708-44dc-a68b-6cf54de2099e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:18.996686 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:18.996579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" Jun 03 21:07:19.131878 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:19.131850 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8"] Jun 03 21:07:19.134453 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:19.134424 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243a7837_0708_44dc_a68b_6cf54de2099e.slice/crio-aa944e718e6e1d713dd087fa6cbde64dbd7786026219e7956f1a5bd16c544707 WatchSource:0}: Error finding container aa944e718e6e1d713dd087fa6cbde64dbd7786026219e7956f1a5bd16c544707: Status 404 returned error can't find the container with id aa944e718e6e1d713dd087fa6cbde64dbd7786026219e7956f1a5bd16c544707 Jun 03 21:07:20.028945 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:20.028906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" event={"ID":"243a7837-0708-44dc-a68b-6cf54de2099e","Type":"ContainerStarted","Data":"aa944e718e6e1d713dd087fa6cbde64dbd7786026219e7956f1a5bd16c544707"} Jun 03 21:07:23.042141 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.042109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" event={"ID":"243a7837-0708-44dc-a68b-6cf54de2099e","Type":"ContainerStarted","Data":"e2349c9a1dbc5019a0e0d86e01e5f7bd7429cab905cd12cfee0a1c3ba64cfefd"} Jun 03 21:07:23.063315 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.063255 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bp5l8" podStartSLOduration=1.580624014 podStartE2EDuration="5.063237668s" totalImagesPullingTime="3.482613654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:23.062526998 +0000 UTC m=+245.470290495" watchObservedRunningTime="2026-06-03 21:07:23.063237668 +0000 UTC m=+245.471001162" Jun 03 21:07:23.767808 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.767774 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm"] Jun 03 21:07:23.770150 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.770130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.772816 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.772791 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 21:07:23.774281 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.774261 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 21:07:23.774385 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.774294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ns9wx\"" Jun 03 21:07:23.782284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.781129 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm"] Jun 03 21:07:23.823651 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.823603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.823651 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.823654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsvj\" (UniqueName: \"kubernetes.io/projected/3355a4e4-cd10-44b5-b293-64b5361cc249-kube-api-access-qdsvj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.823893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.823729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.924705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.924665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.924705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.924713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.924925 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.924755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsvj\" (UniqueName: \"kubernetes.io/projected/3355a4e4-cd10-44b5-b293-64b5361cc249-kube-api-access-qdsvj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.925145 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.925123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.925180 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.925129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:23.934311 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:23.934283 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsvj\" (UniqueName: \"kubernetes.io/projected/3355a4e4-cd10-44b5-b293-64b5361cc249-kube-api-access-qdsvj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:24.085225 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:24.085127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:24.217481 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:24.217449 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm"] Jun 03 21:07:24.220326 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:24.220292 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3355a4e4_cd10_44b5_b293_64b5361cc249.slice/crio-00a3602ba649301b90458edf5d99056d60635d06f28c58563dd30805174e4043 WatchSource:0}: Error finding container 00a3602ba649301b90458edf5d99056d60635d06f28c58563dd30805174e4043: Status 404 returned error can't find the container with id 00a3602ba649301b90458edf5d99056d60635d06f28c58563dd30805174e4043 Jun 03 21:07:25.051231 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.051188 2579 generic.go:356] "Generic (PLEG): container finished" podID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerID="6020241817aa899a3707ce47ba6fc5d54ca536524a04ee8ad1d465e1567c0bb8" exitCode=0 Jun 03 21:07:25.051405 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.051270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" event={"ID":"3355a4e4-cd10-44b5-b293-64b5361cc249","Type":"ContainerDied","Data":"6020241817aa899a3707ce47ba6fc5d54ca536524a04ee8ad1d465e1567c0bb8"} Jun 03 21:07:25.051405 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.051324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" event={"ID":"3355a4e4-cd10-44b5-b293-64b5361cc249","Type":"ContainerStarted","Data":"00a3602ba649301b90458edf5d99056d60635d06f28c58563dd30805174e4043"} Jun 03 21:07:25.112780 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.112721 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs"] Jun 03 21:07:25.115456 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.115428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.118060 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.118025 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4rphr\"" Jun 03 21:07:25.118060 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.118040 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 21:07:25.118292 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.118127 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 21:07:25.126990 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.126957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs"] Jun 03 21:07:25.135015 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.134977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tth2\" (UniqueName: \"kubernetes.io/projected/4378a97c-6ef8-45a6-bac6-9e2812fa45b7-kube-api-access-5tth2\") pod \"cert-manager-webhook-7dc76cbb94-gvfrs\" (UID: \"4378a97c-6ef8-45a6-bac6-9e2812fa45b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.135150 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.135034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4378a97c-6ef8-45a6-bac6-9e2812fa45b7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-gvfrs\" (UID: \"4378a97c-6ef8-45a6-bac6-9e2812fa45b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.235874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.235773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4378a97c-6ef8-45a6-bac6-9e2812fa45b7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-gvfrs\" (UID: \"4378a97c-6ef8-45a6-bac6-9e2812fa45b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.235874 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.235855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tth2\" (UniqueName: \"kubernetes.io/projected/4378a97c-6ef8-45a6-bac6-9e2812fa45b7-kube-api-access-5tth2\") pod \"cert-manager-webhook-7dc76cbb94-gvfrs\" (UID: \"4378a97c-6ef8-45a6-bac6-9e2812fa45b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.244231 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.244195 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4378a97c-6ef8-45a6-bac6-9e2812fa45b7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-gvfrs\" (UID: \"4378a97c-6ef8-45a6-bac6-9e2812fa45b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.244524 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.244505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tth2\" (UniqueName: \"kubernetes.io/projected/4378a97c-6ef8-45a6-bac6-9e2812fa45b7-kube-api-access-5tth2\") pod \"cert-manager-webhook-7dc76cbb94-gvfrs\" (UID: \"4378a97c-6ef8-45a6-bac6-9e2812fa45b7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.433993 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.433955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:25.567267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:25.567097 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs"] Jun 03 21:07:25.569751 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:25.569702 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4378a97c_6ef8_45a6_bac6_9e2812fa45b7.slice/crio-afc4a03139eb2b5f355128d26b61cc9cf43766a2c9af40826fe2000ff42f8009 WatchSource:0}: Error finding container afc4a03139eb2b5f355128d26b61cc9cf43766a2c9af40826fe2000ff42f8009: Status 404 returned error can't find the container with id afc4a03139eb2b5f355128d26b61cc9cf43766a2c9af40826fe2000ff42f8009 Jun 03 21:07:26.056027 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:26.055989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" event={"ID":"4378a97c-6ef8-45a6-bac6-9e2812fa45b7","Type":"ContainerStarted","Data":"afc4a03139eb2b5f355128d26b61cc9cf43766a2c9af40826fe2000ff42f8009"} Jun 03 21:07:30.078622 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:30.078579 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" event={"ID":"4378a97c-6ef8-45a6-bac6-9e2812fa45b7","Type":"ContainerStarted","Data":"6f96444bd5b11bc8b9f8213229f3a2887758dad8bb0e381ba7bb6ebc6280aca7"} Jun 03 21:07:30.079122 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:30.078639 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:30.080660 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:30.080632 2579 generic.go:356] "Generic (PLEG): container finished" podID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerID="18515d7c513e943b356c3b160b12b89d08c4de8ab4a7d32bb08662b6c4112e86" exitCode=0 Jun 03 21:07:30.080823 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:30.080720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" event={"ID":"3355a4e4-cd10-44b5-b293-64b5361cc249","Type":"ContainerDied","Data":"18515d7c513e943b356c3b160b12b89d08c4de8ab4a7d32bb08662b6c4112e86"} Jun 03 21:07:30.094539 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:30.094474 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" podStartSLOduration=1.3537042289999999 podStartE2EDuration="5.094453257s" totalImagesPullingTime="3.740749028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:30.093784073 +0000 UTC m=+252.501547571" watchObservedRunningTime="2026-06-03 21:07:30.094453257 +0000 UTC m=+252.502216754" Jun 03 21:07:31.087430 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.087393 2579 generic.go:356] "Generic (PLEG): container finished" podID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerID="a2ca1d0cbf7cb249f74e745238c1e04af78e093097e7f4573f0d3454da8dc417" exitCode=0 Jun 03 21:07:31.087851 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.087470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" event={"ID":"3355a4e4-cd10-44b5-b293-64b5361cc249","Type":"ContainerDied","Data":"a2ca1d0cbf7cb249f74e745238c1e04af78e093097e7f4573f0d3454da8dc417"} Jun 03 21:07:31.449375 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.449342 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f"] Jun 03 21:07:31.452521 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.452500 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.454883 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.454857 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f9khj\"" Jun 03 21:07:31.459999 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.459974 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f"] Jun 03 21:07:31.487527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.487483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b444ba85-0291-46c7-be09-ccb78138916e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-p7j8f\" (UID: \"b444ba85-0291-46c7-be09-ccb78138916e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.487719 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.487588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5m76\" (UniqueName: \"kubernetes.io/projected/b444ba85-0291-46c7-be09-ccb78138916e-kube-api-access-j5m76\") pod \"cert-manager-cainjector-5d99449ffd-p7j8f\" (UID: \"b444ba85-0291-46c7-be09-ccb78138916e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.588116 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.588078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b444ba85-0291-46c7-be09-ccb78138916e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-p7j8f\" (UID: \"b444ba85-0291-46c7-be09-ccb78138916e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.588286 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.588172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5m76\" (UniqueName: \"kubernetes.io/projected/b444ba85-0291-46c7-be09-ccb78138916e-kube-api-access-j5m76\") pod \"cert-manager-cainjector-5d99449ffd-p7j8f\" (UID: \"b444ba85-0291-46c7-be09-ccb78138916e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.596309 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.596267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b444ba85-0291-46c7-be09-ccb78138916e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-p7j8f\" (UID: \"b444ba85-0291-46c7-be09-ccb78138916e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.596466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.596372 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5m76\" (UniqueName: \"kubernetes.io/projected/b444ba85-0291-46c7-be09-ccb78138916e-kube-api-access-j5m76\") pod \"cert-manager-cainjector-5d99449ffd-p7j8f\" (UID: \"b444ba85-0291-46c7-be09-ccb78138916e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.761667 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.761562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" Jun 03 21:07:31.895556 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:31.895518 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f"] Jun 03 21:07:31.898419 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:31.898388 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb444ba85_0291_46c7_be09_ccb78138916e.slice/crio-4b942b17f0486943bb7229d461ea5cdcc48519dd2b3ecf53a3f141112d523ccd WatchSource:0}: Error finding container 4b942b17f0486943bb7229d461ea5cdcc48519dd2b3ecf53a3f141112d523ccd: Status 404 returned error can't find the container with id 4b942b17f0486943bb7229d461ea5cdcc48519dd2b3ecf53a3f141112d523ccd Jun 03 21:07:32.094263 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.094149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" event={"ID":"b444ba85-0291-46c7-be09-ccb78138916e","Type":"ContainerStarted","Data":"d5a7abeb3d0839540aa6093d1140e27254bc81b269f05200be2a39c48f126184"} Jun 03 21:07:32.094263 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.094211 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" event={"ID":"b444ba85-0291-46c7-be09-ccb78138916e","Type":"ContainerStarted","Data":"4b942b17f0486943bb7229d461ea5cdcc48519dd2b3ecf53a3f141112d523ccd"} Jun 03 21:07:32.109900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.109843 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-p7j8f" podStartSLOduration=1.109827393 podStartE2EDuration="1.109827393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:32.108667002 +0000 UTC m=+254.516430496" watchObservedRunningTime="2026-06-03 21:07:32.109827393 +0000 UTC m=+254.517590888" Jun 03 21:07:32.231135 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.231103 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:32.294238 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.294200 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-util\") pod \"3355a4e4-cd10-44b5-b293-64b5361cc249\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " Jun 03 21:07:32.294423 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.294285 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-bundle\") pod \"3355a4e4-cd10-44b5-b293-64b5361cc249\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " Jun 03 21:07:32.294423 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.294343 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdsvj\" (UniqueName: \"kubernetes.io/projected/3355a4e4-cd10-44b5-b293-64b5361cc249-kube-api-access-qdsvj\") pod \"3355a4e4-cd10-44b5-b293-64b5361cc249\" (UID: \"3355a4e4-cd10-44b5-b293-64b5361cc249\") " Jun 03 21:07:32.294800 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.294769 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-bundle" (OuterVolumeSpecName: "bundle") pod "3355a4e4-cd10-44b5-b293-64b5361cc249" (UID: "3355a4e4-cd10-44b5-b293-64b5361cc249"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:07:32.296708 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.296669 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3355a4e4-cd10-44b5-b293-64b5361cc249-kube-api-access-qdsvj" (OuterVolumeSpecName: "kube-api-access-qdsvj") pod "3355a4e4-cd10-44b5-b293-64b5361cc249" (UID: "3355a4e4-cd10-44b5-b293-64b5361cc249"). InnerVolumeSpecName "kube-api-access-qdsvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:07:32.298811 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.298776 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-util" (OuterVolumeSpecName: "util") pod "3355a4e4-cd10-44b5-b293-64b5361cc249" (UID: "3355a4e4-cd10-44b5-b293-64b5361cc249"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:07:32.395967 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.395885 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsvj\" (UniqueName: \"kubernetes.io/projected/3355a4e4-cd10-44b5-b293-64b5361cc249-kube-api-access-qdsvj\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:32.395967 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.395911 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:32.395967 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:32.395920 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3355a4e4-cd10-44b5-b293-64b5361cc249-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:33.100622 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:33.100593 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" Jun 03 21:07:33.101056 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:33.100628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxnmtm" event={"ID":"3355a4e4-cd10-44b5-b293-64b5361cc249","Type":"ContainerDied","Data":"00a3602ba649301b90458edf5d99056d60635d06f28c58563dd30805174e4043"} Jun 03 21:07:33.101056 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:33.100669 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00a3602ba649301b90458edf5d99056d60635d06f28c58563dd30805174e4043" Jun 03 21:07:36.089840 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:36.089804 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gvfrs" Jun 03 21:07:42.826646 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826605 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl"] Jun 03 21:07:42.827037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826938 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="pull" Jun 03 21:07:42.827037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826950 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="pull" Jun 03 21:07:42.827037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826959 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="extract" Jun 03 21:07:42.827037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826964 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="extract" Jun 03 21:07:42.827037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826977 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="util" Jun 03 21:07:42.827037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.826983 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="util" Jun 03 21:07:42.827218 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.827047 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3355a4e4-cd10-44b5-b293-64b5361cc249" containerName="extract" Jun 03 21:07:42.852387 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.852356 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl"] Jun 03 21:07:42.852549 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.852467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:42.855227 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.855202 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 21:07:42.855346 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.855252 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 21:07:42.856259 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.856232 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ns9wx\"" Jun 03 21:07:42.987844 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.987801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wtwn\" (UniqueName: \"kubernetes.io/projected/20983905-e5db-491b-90f7-b7890818ddf6-kube-api-access-9wtwn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:42.988033 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.987874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:42.988097 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:42.988033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.088773 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.088647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.088773 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.088701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.089014 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.088792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wtwn\" (UniqueName: \"kubernetes.io/projected/20983905-e5db-491b-90f7-b7890818ddf6-kube-api-access-9wtwn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.089094 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.089074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.089133 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.089104 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.097051 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.097022 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wtwn\" (UniqueName: \"kubernetes.io/projected/20983905-e5db-491b-90f7-b7890818ddf6-kube-api-access-9wtwn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.161887 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.161853 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:43.317779 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:43.317732 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl"] Jun 03 21:07:43.319854 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:43.319823 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20983905_e5db_491b_90f7_b7890818ddf6.slice/crio-9c12c151a7d81a195ea3f4958d4b6d43513a8ede5d892ad5bda17308b4a80e21 WatchSource:0}: Error finding container 9c12c151a7d81a195ea3f4958d4b6d43513a8ede5d892ad5bda17308b4a80e21: Status 404 returned error can't find the container with id 9c12c151a7d81a195ea3f4958d4b6d43513a8ede5d892ad5bda17308b4a80e21 Jun 03 21:07:44.014824 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.014784 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-26bl7"] Jun 03 21:07:44.033412 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.033375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.036122 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.036093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fm7fl\"" Jun 03 21:07:44.040184 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.040155 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-26bl7"] Jun 03 21:07:44.097673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.097636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrwv\" (UniqueName: \"kubernetes.io/projected/ccf42f82-6867-45ba-8cb6-2853890813cd-kube-api-access-qrrwv\") pod \"cert-manager-59c77684cc-26bl7\" (UID: \"ccf42f82-6867-45ba-8cb6-2853890813cd\") " pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.097673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.097674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccf42f82-6867-45ba-8cb6-2853890813cd-bound-sa-token\") pod \"cert-manager-59c77684cc-26bl7\" (UID: \"ccf42f82-6867-45ba-8cb6-2853890813cd\") " pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.156071 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.156034 2579 generic.go:356] "Generic (PLEG): container finished" podID="20983905-e5db-491b-90f7-b7890818ddf6" containerID="4fb2f61c233d34211fe9b3aa128f7a8b57ac7cd7bafa4b5f4f0b09628ab49c78" exitCode=0 Jun 03 21:07:44.156274 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.156094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" event={"ID":"20983905-e5db-491b-90f7-b7890818ddf6","Type":"ContainerDied","Data":"4fb2f61c233d34211fe9b3aa128f7a8b57ac7cd7bafa4b5f4f0b09628ab49c78"} Jun 03 21:07:44.156274 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.156137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" event={"ID":"20983905-e5db-491b-90f7-b7890818ddf6","Type":"ContainerStarted","Data":"9c12c151a7d81a195ea3f4958d4b6d43513a8ede5d892ad5bda17308b4a80e21"} Jun 03 21:07:44.198564 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.198523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrwv\" (UniqueName: \"kubernetes.io/projected/ccf42f82-6867-45ba-8cb6-2853890813cd-kube-api-access-qrrwv\") pod \"cert-manager-59c77684cc-26bl7\" (UID: \"ccf42f82-6867-45ba-8cb6-2853890813cd\") " pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.198564 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.198569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccf42f82-6867-45ba-8cb6-2853890813cd-bound-sa-token\") pod \"cert-manager-59c77684cc-26bl7\" (UID: \"ccf42f82-6867-45ba-8cb6-2853890813cd\") " pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.206408 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.206373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccf42f82-6867-45ba-8cb6-2853890813cd-bound-sa-token\") pod \"cert-manager-59c77684cc-26bl7\" (UID: \"ccf42f82-6867-45ba-8cb6-2853890813cd\") " pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.206539 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.206469 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrwv\" (UniqueName: \"kubernetes.io/projected/ccf42f82-6867-45ba-8cb6-2853890813cd-kube-api-access-qrrwv\") pod \"cert-manager-59c77684cc-26bl7\" (UID: \"ccf42f82-6867-45ba-8cb6-2853890813cd\") " pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.344212 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.344119 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-26bl7" Jun 03 21:07:44.512986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:44.512941 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-26bl7"] Jun 03 21:07:44.515720 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:44.515691 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccf42f82_6867_45ba_8cb6_2853890813cd.slice/crio-0f436451d23bfa80017b2cacb5c5e938718076ef2695e9eeb8a116aa7a3851ed WatchSource:0}: Error finding container 0f436451d23bfa80017b2cacb5c5e938718076ef2695e9eeb8a116aa7a3851ed: Status 404 returned error can't find the container with id 0f436451d23bfa80017b2cacb5c5e938718076ef2695e9eeb8a116aa7a3851ed Jun 03 21:07:45.162242 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:45.162202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-26bl7" event={"ID":"ccf42f82-6867-45ba-8cb6-2853890813cd","Type":"ContainerStarted","Data":"b9402d01cce8714b556dca566f059996dcf2296d7c08b9740d52355b0c802e82"} Jun 03 21:07:45.162661 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:45.162251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-26bl7" event={"ID":"ccf42f82-6867-45ba-8cb6-2853890813cd","Type":"ContainerStarted","Data":"0f436451d23bfa80017b2cacb5c5e938718076ef2695e9eeb8a116aa7a3851ed"} Jun 03 21:07:45.164279 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:45.164253 2579 generic.go:356] "Generic (PLEG): container finished" podID="20983905-e5db-491b-90f7-b7890818ddf6" containerID="6e350a5f0a0c320798452698fd1c6d63bc7d859a82e39b483970778f90d7e4b8" exitCode=0 Jun 03 21:07:45.164403 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:45.164289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" event={"ID":"20983905-e5db-491b-90f7-b7890818ddf6","Type":"ContainerDied","Data":"6e350a5f0a0c320798452698fd1c6d63bc7d859a82e39b483970778f90d7e4b8"} Jun 03 21:07:45.177654 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:45.177593 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-26bl7" podStartSLOduration=2.177572803 podStartE2EDuration="2.177572803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:45.177075451 +0000 UTC m=+267.584838959" watchObservedRunningTime="2026-06-03 21:07:45.177572803 +0000 UTC m=+267.585336299" Jun 03 21:07:46.170520 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:46.170484 2579 generic.go:356] "Generic (PLEG): container finished" podID="20983905-e5db-491b-90f7-b7890818ddf6" containerID="b02ff73b6bf309cc5b3d2f76e71ca1531e9c33c60583d96cdfa0f793e7b2edb5" exitCode=0 Jun 03 21:07:46.170922 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:46.170567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" event={"ID":"20983905-e5db-491b-90f7-b7890818ddf6","Type":"ContainerDied","Data":"b02ff73b6bf309cc5b3d2f76e71ca1531e9c33c60583d96cdfa0f793e7b2edb5"} Jun 03 21:07:47.306623 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.306593 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:47.422691 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.422650 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wtwn\" (UniqueName: \"kubernetes.io/projected/20983905-e5db-491b-90f7-b7890818ddf6-kube-api-access-9wtwn\") pod \"20983905-e5db-491b-90f7-b7890818ddf6\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " Jun 03 21:07:47.422895 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.422733 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-bundle\") pod \"20983905-e5db-491b-90f7-b7890818ddf6\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " Jun 03 21:07:47.422895 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.422792 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-util\") pod \"20983905-e5db-491b-90f7-b7890818ddf6\" (UID: \"20983905-e5db-491b-90f7-b7890818ddf6\") " Jun 03 21:07:47.423477 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.423446 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-bundle" (OuterVolumeSpecName: "bundle") pod "20983905-e5db-491b-90f7-b7890818ddf6" (UID: "20983905-e5db-491b-90f7-b7890818ddf6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:07:47.425010 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.424982 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20983905-e5db-491b-90f7-b7890818ddf6-kube-api-access-9wtwn" (OuterVolumeSpecName: "kube-api-access-9wtwn") pod "20983905-e5db-491b-90f7-b7890818ddf6" (UID: "20983905-e5db-491b-90f7-b7890818ddf6"). InnerVolumeSpecName "kube-api-access-9wtwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:07:47.428571 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.428506 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-util" (OuterVolumeSpecName: "util") pod "20983905-e5db-491b-90f7-b7890818ddf6" (UID: "20983905-e5db-491b-90f7-b7890818ddf6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:07:47.524216 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.524183 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:47.524216 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.524212 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20983905-e5db-491b-90f7-b7890818ddf6-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:47.524216 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:47.524222 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wtwn\" (UniqueName: \"kubernetes.io/projected/20983905-e5db-491b-90f7-b7890818ddf6-kube-api-access-9wtwn\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:07:48.180848 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:48.180816 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" Jun 03 21:07:48.180848 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:48.180835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdgxxnl" event={"ID":"20983905-e5db-491b-90f7-b7890818ddf6","Type":"ContainerDied","Data":"9c12c151a7d81a195ea3f4958d4b6d43513a8ede5d892ad5bda17308b4a80e21"} Jun 03 21:07:48.181047 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:48.180880 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c12c151a7d81a195ea3f4958d4b6d43513a8ede5d892ad5bda17308b4a80e21" Jun 03 21:07:56.503022 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.502984 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl"] Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503292 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="util" Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503304 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="util" Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503321 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="extract" Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503330 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="extract" Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503343 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="pull" Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503349 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="pull" Jun 03 21:07:56.503437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.503402 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="20983905-e5db-491b-90f7-b7890818ddf6" containerName="extract" Jun 03 21:07:56.510782 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.510717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.514202 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.514179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rqw9t\"" Jun 03 21:07:56.514650 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.514627 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 21:07:56.514846 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.514643 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 21:07:56.514846 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.514643 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 21:07:56.515101 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.515081 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 21:07:56.519643 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.519619 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl"] Jun 03 21:07:56.610091 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.610052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f556742f-7162-4831-a0ee-034a121b949f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.610267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.610113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f556742f-7162-4831-a0ee-034a121b949f-tmp\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.610267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.610160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f556742f-7162-4831-a0ee-034a121b949f-manifests\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.610267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.610178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f556742f-7162-4831-a0ee-034a121b949f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.610267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.610209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d25zz\" (UniqueName: \"kubernetes.io/projected/f556742f-7162-4831-a0ee-034a121b949f-kube-api-access-d25zz\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.711414 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.711365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f556742f-7162-4831-a0ee-034a121b949f-tmp\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.711414 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.711417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f556742f-7162-4831-a0ee-034a121b949f-manifests\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.711647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.711434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f556742f-7162-4831-a0ee-034a121b949f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.711647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.711467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d25zz\" (UniqueName: \"kubernetes.io/projected/f556742f-7162-4831-a0ee-034a121b949f-kube-api-access-d25zz\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.711647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.711497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f556742f-7162-4831-a0ee-034a121b949f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.711880 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.711857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f556742f-7162-4831-a0ee-034a121b949f-manifests\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.714102 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.714067 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f556742f-7162-4831-a0ee-034a121b949f-tmp\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.714238 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.714176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f556742f-7162-4831-a0ee-034a121b949f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.714294 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.714278 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f556742f-7162-4831-a0ee-034a121b949f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.720157 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.720124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d25zz\" (UniqueName: \"kubernetes.io/projected/f556742f-7162-4831-a0ee-034a121b949f-kube-api-access-d25zz\") pod \"opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl\" (UID: \"f556742f-7162-4831-a0ee-034a121b949f\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.822465 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.822370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:07:56.967831 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:56.967782 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl"] Jun 03 21:07:56.970272 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:07:56.970237 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf556742f_7162_4831_a0ee_034a121b949f.slice/crio-2d4774c1b674ab5d94d85c70f163f0d8a97ad59254158a40cab98c98754f5331 WatchSource:0}: Error finding container 2d4774c1b674ab5d94d85c70f163f0d8a97ad59254158a40cab98c98754f5331: Status 404 returned error can't find the container with id 2d4774c1b674ab5d94d85c70f163f0d8a97ad59254158a40cab98c98754f5331 Jun 03 21:07:57.220683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:07:57.220651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" event={"ID":"f556742f-7162-4831-a0ee-034a121b949f","Type":"ContainerStarted","Data":"2d4774c1b674ab5d94d85c70f163f0d8a97ad59254158a40cab98c98754f5331"} Jun 03 21:08:00.237596 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:00.237556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" event={"ID":"f556742f-7162-4831-a0ee-034a121b949f","Type":"ContainerStarted","Data":"c5285153417a25dbe8620c443b6be05eeac90cecd96d2fe5fd055318e3e36a7b"} Jun 03 21:08:01.243882 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:01.243845 2579 generic.go:356] "Generic (PLEG): container finished" podID="f556742f-7162-4831-a0ee-034a121b949f" containerID="c5285153417a25dbe8620c443b6be05eeac90cecd96d2fe5fd055318e3e36a7b" exitCode=0 Jun 03 21:08:01.244298 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:01.243922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" event={"ID":"f556742f-7162-4831-a0ee-034a121b949f","Type":"ContainerDied","Data":"c5285153417a25dbe8620c443b6be05eeac90cecd96d2fe5fd055318e3e36a7b"} Jun 03 21:08:02.250914 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:02.250876 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" event={"ID":"f556742f-7162-4831-a0ee-034a121b949f","Type":"ContainerStarted","Data":"c12d8591ab913244a995e709e546b30a5443e3e9a4f00a89454c01dbb2255620"} Jun 03 21:08:02.251298 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:02.251046 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:08:02.274036 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:02.273982 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" podStartSLOduration=2.088845012 podStartE2EDuration="6.273966173s" totalImagesPullingTime="3.151591136s" totalInitContainerRuntime="1.033530025s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:02.271314682 +0000 UTC m=+284.679078176" watchObservedRunningTime="2026-06-03 21:08:02.273966173 +0000 UTC m=+284.681729667" Jun 03 21:08:13.258318 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:13.258286 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl" Jun 03 21:08:15.771619 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.771583 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-5xmjh"] Jun 03 21:08:15.779513 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.779473 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82"] Jun 03 21:08:15.779683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.779607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:15.782352 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.782325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 21:08:15.782489 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.782351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lncp7\"" Jun 03 21:08:15.782669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.782654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.785604 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.785584 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6zkcd\"" Jun 03 21:08:15.785797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.785625 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:08:15.785871 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.785675 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 21:08:15.786006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.785985 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-5xmjh"] Jun 03 21:08:15.786366 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.786174 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 21:08:15.786463 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.786367 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 21:08:15.786463 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.786390 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 21:08:15.789841 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.789819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82"] Jun 03 21:08:15.873796 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.873761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/290ac81a-9d78-416a-a91c-aaa15b6b6a23-cert\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:15.873796 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.873809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-manager-config\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.874006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.873828 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-metrics-cert\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.874006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.873940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-cert\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.874006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.873971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbwgz\" (UniqueName: \"kubernetes.io/projected/290ac81a-9d78-416a-a91c-aaa15b6b6a23-kube-api-access-hbwgz\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:15.874006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.873999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlstd\" (UniqueName: \"kubernetes.io/projected/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-kube-api-access-xlstd\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.975099 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/290ac81a-9d78-416a-a91c-aaa15b6b6a23-cert\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:15.975276 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-manager-config\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.975276 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:08:15.975209 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 21:08:15.975344 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-metrics-cert\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.975344 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:08:15.975295 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290ac81a-9d78-416a-a91c-aaa15b6b6a23-cert podName:290ac81a-9d78-416a-a91c-aaa15b6b6a23 nodeName:}" failed. No retries permitted until 2026-06-03 21:08:16.475269756 +0000 UTC m=+298.883033240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/290ac81a-9d78-416a-a91c-aaa15b6b6a23-cert") pod "odh-model-controller-6dc94f689f-5xmjh" (UID: "290ac81a-9d78-416a-a91c-aaa15b6b6a23") : secret "odh-model-controller-webhook-cert" not found Jun 03 21:08:15.975451 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-cert\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.975451 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbwgz\" (UniqueName: \"kubernetes.io/projected/290ac81a-9d78-416a-a91c-aaa15b6b6a23-kube-api-access-hbwgz\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:15.975451 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlstd\" (UniqueName: \"kubernetes.io/projected/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-kube-api-access-xlstd\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.975846 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.975824 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-manager-config\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.977793 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.977755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-metrics-cert\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.978019 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.977999 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-cert\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:15.986438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.986406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbwgz\" (UniqueName: \"kubernetes.io/projected/290ac81a-9d78-416a-a91c-aaa15b6b6a23-kube-api-access-hbwgz\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:15.986600 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:15.986415 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlstd\" (UniqueName: \"kubernetes.io/projected/f5406f3e-3b49-4e8b-a337-b16b45d1f03a-kube-api-access-xlstd\") pod \"lws-controller-manager-57c88bd5b4-fzk82\" (UID: \"f5406f3e-3b49-4e8b-a337-b16b45d1f03a\") " pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:16.102855 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.102757 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:16.241683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.241658 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82"] Jun 03 21:08:16.243571 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:16.243541 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5406f3e_3b49_4e8b_a337_b16b45d1f03a.slice/crio-8595a9e9711c05aed8e1a8d0b1f8614e3b33a08c511b85c76510226f83600c2d WatchSource:0}: Error finding container 8595a9e9711c05aed8e1a8d0b1f8614e3b33a08c511b85c76510226f83600c2d: Status 404 returned error can't find the container with id 8595a9e9711c05aed8e1a8d0b1f8614e3b33a08c511b85c76510226f83600c2d Jun 03 21:08:16.318154 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.318114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" event={"ID":"f5406f3e-3b49-4e8b-a337-b16b45d1f03a","Type":"ContainerStarted","Data":"8595a9e9711c05aed8e1a8d0b1f8614e3b33a08c511b85c76510226f83600c2d"} Jun 03 21:08:16.478943 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.478901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/290ac81a-9d78-416a-a91c-aaa15b6b6a23-cert\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:16.481495 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.481470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/290ac81a-9d78-416a-a91c-aaa15b6b6a23-cert\") pod \"odh-model-controller-6dc94f689f-5xmjh\" (UID: \"290ac81a-9d78-416a-a91c-aaa15b6b6a23\") " pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:16.699563 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.699524 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:16.855246 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:16.855219 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-5xmjh"] Jun 03 21:08:16.856990 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:16.856961 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290ac81a_9d78_416a_a91c_aaa15b6b6a23.slice/crio-139d860ec4a31eeb76f179967d8125036487279bf12341af080d2455bf4416f8 WatchSource:0}: Error finding container 139d860ec4a31eeb76f179967d8125036487279bf12341af080d2455bf4416f8: Status 404 returned error can't find the container with id 139d860ec4a31eeb76f179967d8125036487279bf12341af080d2455bf4416f8 Jun 03 21:08:17.325538 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:17.325500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" event={"ID":"290ac81a-9d78-416a-a91c-aaa15b6b6a23","Type":"ContainerStarted","Data":"139d860ec4a31eeb76f179967d8125036487279bf12341af080d2455bf4416f8"} Jun 03 21:08:18.033912 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.033720 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:08:18.034869 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.034011 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:08:18.045341 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.045308 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 21:08:18.884758 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.884699 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj"] Jun 03 21:08:18.894535 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.894366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:18.897494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.897212 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj"] Jun 03 21:08:18.897494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.897303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 21:08:18.897494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.897352 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ns9wx\"" Jun 03 21:08:18.898433 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:18.898407 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 21:08:19.005336 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.005290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prn6x\" (UniqueName: \"kubernetes.io/projected/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-kube-api-access-prn6x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.005512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.005396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.005512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.005435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.106324 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.106274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.106324 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.106324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.106908 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.106416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prn6x\" (UniqueName: \"kubernetes.io/projected/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-kube-api-access-prn6x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.106908 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.106717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.106908 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.106776 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.114861 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.114823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prn6x\" (UniqueName: \"kubernetes.io/projected/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-kube-api-access-prn6x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:19.208534 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:19.208490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:20.029278 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.029247 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj"] Jun 03 21:08:20.031175 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:20.031142 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e58ecfa_549d_48dc_a3b9_793cc9187d7c.slice/crio-e7ce0222847a65ef57e4225998e236cfbc1feeec98b0c7a7836693d988449de5 WatchSource:0}: Error finding container e7ce0222847a65ef57e4225998e236cfbc1feeec98b0c7a7836693d988449de5: Status 404 returned error can't find the container with id e7ce0222847a65ef57e4225998e236cfbc1feeec98b0c7a7836693d988449de5 Jun 03 21:08:20.343189 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.343153 2579 generic.go:356] "Generic (PLEG): container finished" podID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerID="1dd71a8584608c6800a4bfe5de4b2409736e5be8c88294c9299123db391bcc87" exitCode=0 Jun 03 21:08:20.343642 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.343255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" event={"ID":"5e58ecfa-549d-48dc-a3b9-793cc9187d7c","Type":"ContainerDied","Data":"1dd71a8584608c6800a4bfe5de4b2409736e5be8c88294c9299123db391bcc87"} Jun 03 21:08:20.343642 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.343313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" event={"ID":"5e58ecfa-549d-48dc-a3b9-793cc9187d7c","Type":"ContainerStarted","Data":"e7ce0222847a65ef57e4225998e236cfbc1feeec98b0c7a7836693d988449de5"} Jun 03 21:08:20.344350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.344314 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:08:20.345127 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.345101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" event={"ID":"f5406f3e-3b49-4e8b-a337-b16b45d1f03a","Type":"ContainerStarted","Data":"f6bdbc83a1a895e2485ba2fba5691748a1619e00844db11b31c83f4ab96a8027"} Jun 03 21:08:20.345297 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.345167 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:20.346606 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.346586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" event={"ID":"290ac81a-9d78-416a-a91c-aaa15b6b6a23","Type":"ContainerStarted","Data":"baf014d8059f8e5487fd1bd92c897082c679dc3b48f1927fc370fc3b603e01b5"} Jun 03 21:08:20.346749 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.346726 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:20.374572 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.374521 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" podStartSLOduration=2.332181204 podStartE2EDuration="5.374503325s" totalImagesPullingTime="3.042322121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:20.37408291 +0000 UTC m=+302.781846404" watchObservedRunningTime="2026-06-03 21:08:20.374503325 +0000 UTC m=+302.782266886" Jun 03 21:08:20.393617 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:20.393490 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" podStartSLOduration=1.781026244 podStartE2EDuration="5.393472795s" totalImagesPullingTime="3.612446551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:20.392823062 +0000 UTC m=+302.800586557" watchObservedRunningTime="2026-06-03 21:08:20.393472795 +0000 UTC m=+302.801236320" Jun 03 21:08:22.358859 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:22.358815 2579 generic.go:356] "Generic (PLEG): container finished" podID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerID="23b9e62ba5c4fc1ff9149ff64d80a4d098985ddd91434eb1943dd5a29b12bc12" exitCode=0 Jun 03 21:08:22.359238 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:22.358958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" event={"ID":"5e58ecfa-549d-48dc-a3b9-793cc9187d7c","Type":"ContainerDied","Data":"23b9e62ba5c4fc1ff9149ff64d80a4d098985ddd91434eb1943dd5a29b12bc12"} Jun 03 21:08:23.366271 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:23.366233 2579 generic.go:356] "Generic (PLEG): container finished" podID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerID="7cc96b785ac954d1580b0820761967c2147c0fbcbf098ef05e6636b385784119" exitCode=0 Jun 03 21:08:23.366941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:23.366321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" event={"ID":"5e58ecfa-549d-48dc-a3b9-793cc9187d7c","Type":"ContainerDied","Data":"7cc96b785ac954d1580b0820761967c2147c0fbcbf098ef05e6636b385784119"} Jun 03 21:08:24.502699 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.502673 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:24.559315 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.559276 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prn6x\" (UniqueName: \"kubernetes.io/projected/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-kube-api-access-prn6x\") pod \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " Jun 03 21:08:24.559469 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.559341 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-bundle\") pod \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " Jun 03 21:08:24.559469 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.559373 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-util\") pod \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\" (UID: \"5e58ecfa-549d-48dc-a3b9-793cc9187d7c\") " Jun 03 21:08:24.560315 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.560280 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-bundle" (OuterVolumeSpecName: "bundle") pod "5e58ecfa-549d-48dc-a3b9-793cc9187d7c" (UID: "5e58ecfa-549d-48dc-a3b9-793cc9187d7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:24.561581 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.561550 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-kube-api-access-prn6x" (OuterVolumeSpecName: "kube-api-access-prn6x") pod "5e58ecfa-549d-48dc-a3b9-793cc9187d7c" (UID: "5e58ecfa-549d-48dc-a3b9-793cc9187d7c"). InnerVolumeSpecName "kube-api-access-prn6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:24.565139 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.565107 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-util" (OuterVolumeSpecName: "util") pod "5e58ecfa-549d-48dc-a3b9-793cc9187d7c" (UID: "5e58ecfa-549d-48dc-a3b9-793cc9187d7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:24.661126 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.661027 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:08:24.661126 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.661070 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prn6x\" (UniqueName: \"kubernetes.io/projected/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-kube-api-access-prn6x\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:08:24.661126 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:24.661085 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e58ecfa-549d-48dc-a3b9-793cc9187d7c-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:08:25.377401 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:25.377362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" event={"ID":"5e58ecfa-549d-48dc-a3b9-793cc9187d7c","Type":"ContainerDied","Data":"e7ce0222847a65ef57e4225998e236cfbc1feeec98b0c7a7836693d988449de5"} Jun 03 21:08:25.377401 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:25.377387 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z88zj" Jun 03 21:08:25.377610 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:25.377421 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7ce0222847a65ef57e4225998e236cfbc1feeec98b0c7a7836693d988449de5" Jun 03 21:08:31.354189 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:31.354157 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57c88bd5b4-fzk82" Jun 03 21:08:31.354603 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:31.354223 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-5xmjh" Jun 03 21:08:34.010939 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.010900 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw"] Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011220 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="extract" Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011232 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="extract" Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011244 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="util" Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011249 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="util" Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011268 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="pull" Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011273 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="pull" Jun 03 21:08:34.011438 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.011326 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e58ecfa-549d-48dc-a3b9-793cc9187d7c" containerName="extract" Jun 03 21:08:34.073188 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.073141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.075827 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.075802 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 21:08:34.077066 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.077042 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ns9wx\"" Jun 03 21:08:34.077183 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.077071 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 21:08:34.080248 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.080227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw"] Jun 03 21:08:34.150492 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.150446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.150681 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.150514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n249s\" (UniqueName: \"kubernetes.io/projected/d2cc0f08-4f5d-4174-b859-95223f767f1a-kube-api-access-n249s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.150681 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.150591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.251593 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.251548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n249s\" (UniqueName: \"kubernetes.io/projected/d2cc0f08-4f5d-4174-b859-95223f767f1a-kube-api-access-n249s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.251803 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.251653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.251803 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.251693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.252104 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.252078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.252142 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.252121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.272712 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.272649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n249s\" (UniqueName: \"kubernetes.io/projected/d2cc0f08-4f5d-4174-b859-95223f767f1a-kube-api-access-n249s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.384496 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.384453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:34.535193 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:34.535165 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw"] Jun 03 21:08:34.537050 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:34.537018 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cc0f08_4f5d_4174_b859_95223f767f1a.slice/crio-27a395698ee0d83b848d0346e2f56609dbd16f9fd1ee01564a357a61392b810b WatchSource:0}: Error finding container 27a395698ee0d83b848d0346e2f56609dbd16f9fd1ee01564a357a61392b810b: Status 404 returned error can't find the container with id 27a395698ee0d83b848d0346e2f56609dbd16f9fd1ee01564a357a61392b810b Jun 03 21:08:35.429356 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:35.429315 2579 generic.go:356] "Generic (PLEG): container finished" podID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerID="ef144cffe0363adb7cd50c1ca3dba840421a92a23fcba3196cea5c9390940993" exitCode=0 Jun 03 21:08:35.429760 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:35.429393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" event={"ID":"d2cc0f08-4f5d-4174-b859-95223f767f1a","Type":"ContainerDied","Data":"ef144cffe0363adb7cd50c1ca3dba840421a92a23fcba3196cea5c9390940993"} Jun 03 21:08:35.429760 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:35.429469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" event={"ID":"d2cc0f08-4f5d-4174-b859-95223f767f1a","Type":"ContainerStarted","Data":"27a395698ee0d83b848d0346e2f56609dbd16f9fd1ee01564a357a61392b810b"} Jun 03 21:08:36.083716 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.083675 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gckn5"] Jun 03 21:08:36.086087 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.086067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.088900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.088879 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-x5wnt\"" Jun 03 21:08:36.089034 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.089016 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 21:08:36.089100 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.089053 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 21:08:36.102146 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.102116 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gckn5"] Jun 03 21:08:36.169786 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.169723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hb77\" (UniqueName: \"kubernetes.io/projected/a786f092-1aa1-4564-8113-3578c0b58c43-kube-api-access-5hb77\") pod \"servicemesh-operator3-57f65f65fb-gckn5\" (UID: \"a786f092-1aa1-4564-8113-3578c0b58c43\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.170009 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.169982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a786f092-1aa1-4564-8113-3578c0b58c43-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gckn5\" (UID: \"a786f092-1aa1-4564-8113-3578c0b58c43\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.271383 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.271342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hb77\" (UniqueName: \"kubernetes.io/projected/a786f092-1aa1-4564-8113-3578c0b58c43-kube-api-access-5hb77\") pod \"servicemesh-operator3-57f65f65fb-gckn5\" (UID: \"a786f092-1aa1-4564-8113-3578c0b58c43\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.271383 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.271388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a786f092-1aa1-4564-8113-3578c0b58c43-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gckn5\" (UID: \"a786f092-1aa1-4564-8113-3578c0b58c43\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.274052 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.274020 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a786f092-1aa1-4564-8113-3578c0b58c43-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gckn5\" (UID: \"a786f092-1aa1-4564-8113-3578c0b58c43\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.279461 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.279430 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hb77\" (UniqueName: \"kubernetes.io/projected/a786f092-1aa1-4564-8113-3578c0b58c43-kube-api-access-5hb77\") pod \"servicemesh-operator3-57f65f65fb-gckn5\" (UID: \"a786f092-1aa1-4564-8113-3578c0b58c43\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.395593 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.395489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:36.557371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:36.557342 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gckn5"] Jun 03 21:08:36.559458 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:36.559425 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda786f092_1aa1_4564_8113_3578c0b58c43.slice/crio-a7bb4f843878e6f62c123834fb26be540e6237199f4a798fd40a6e68c53d88a8 WatchSource:0}: Error finding container a7bb4f843878e6f62c123834fb26be540e6237199f4a798fd40a6e68c53d88a8: Status 404 returned error can't find the container with id a7bb4f843878e6f62c123834fb26be540e6237199f4a798fd40a6e68c53d88a8 Jun 03 21:08:37.442491 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:37.442453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" event={"ID":"a786f092-1aa1-4564-8113-3578c0b58c43","Type":"ContainerStarted","Data":"a7bb4f843878e6f62c123834fb26be540e6237199f4a798fd40a6e68c53d88a8"} Jun 03 21:08:39.466399 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:39.466280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" event={"ID":"a786f092-1aa1-4564-8113-3578c0b58c43","Type":"ContainerStarted","Data":"ff4206008206a5e9047ea66da7a8c89cb8c99fefc58936daef5c9073bd3a12a4"} Jun 03 21:08:39.466801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:39.466406 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:39.490502 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:39.490434 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" podStartSLOduration=0.84382318 podStartE2EDuration="3.490413197s" totalImagesPullingTime="2.646590017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:39.487244861 +0000 UTC m=+321.895008355" watchObservedRunningTime="2026-06-03 21:08:39.490413197 +0000 UTC m=+321.898176693" Jun 03 21:08:40.473868 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:40.473830 2579 generic.go:356] "Generic (PLEG): container finished" podID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerID="9b1dcc470b900828e19aa2db111a49276c5da83c90f71ed4b56d522c90e82217" exitCode=0 Jun 03 21:08:40.474294 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:40.473912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" event={"ID":"d2cc0f08-4f5d-4174-b859-95223f767f1a","Type":"ContainerDied","Data":"9b1dcc470b900828e19aa2db111a49276c5da83c90f71ed4b56d522c90e82217"} Jun 03 21:08:41.481471 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:41.481438 2579 generic.go:356] "Generic (PLEG): container finished" podID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerID="5255bebae8fed82faf3d3b775c93aeb4bca47cf5f58aa97b8547787d06081dc0" exitCode=0 Jun 03 21:08:41.481900 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:41.481526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" event={"ID":"d2cc0f08-4f5d-4174-b859-95223f767f1a","Type":"ContainerDied","Data":"5255bebae8fed82faf3d3b775c93aeb4bca47cf5f58aa97b8547787d06081dc0"} Jun 03 21:08:42.629979 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.629949 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:42.733153 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.733113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n249s\" (UniqueName: \"kubernetes.io/projected/d2cc0f08-4f5d-4174-b859-95223f767f1a-kube-api-access-n249s\") pod \"d2cc0f08-4f5d-4174-b859-95223f767f1a\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " Jun 03 21:08:42.733340 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.733168 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-util\") pod \"d2cc0f08-4f5d-4174-b859-95223f767f1a\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " Jun 03 21:08:42.733340 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.733223 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-bundle\") pod \"d2cc0f08-4f5d-4174-b859-95223f767f1a\" (UID: \"d2cc0f08-4f5d-4174-b859-95223f767f1a\") " Jun 03 21:08:42.734155 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.734127 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-bundle" (OuterVolumeSpecName: "bundle") pod "d2cc0f08-4f5d-4174-b859-95223f767f1a" (UID: "d2cc0f08-4f5d-4174-b859-95223f767f1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:42.735479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.735453 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2cc0f08-4f5d-4174-b859-95223f767f1a-kube-api-access-n249s" (OuterVolumeSpecName: "kube-api-access-n249s") pod "d2cc0f08-4f5d-4174-b859-95223f767f1a" (UID: "d2cc0f08-4f5d-4174-b859-95223f767f1a"). InnerVolumeSpecName "kube-api-access-n249s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:42.738098 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.738046 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-util" (OuterVolumeSpecName: "util") pod "d2cc0f08-4f5d-4174-b859-95223f767f1a" (UID: "d2cc0f08-4f5d-4174-b859-95223f767f1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:42.834683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.834634 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n249s\" (UniqueName: \"kubernetes.io/projected/d2cc0f08-4f5d-4174-b859-95223f767f1a-kube-api-access-n249s\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:08:42.834683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.834672 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:08:42.834683 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:42.834683 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2cc0f08-4f5d-4174-b859-95223f767f1a-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:08:43.493893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:43.493856 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" Jun 03 21:08:43.493893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:43.493882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762algblw" event={"ID":"d2cc0f08-4f5d-4174-b859-95223f767f1a","Type":"ContainerDied","Data":"27a395698ee0d83b848d0346e2f56609dbd16f9fd1ee01564a357a61392b810b"} Jun 03 21:08:43.494106 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:43.493928 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27a395698ee0d83b848d0346e2f56609dbd16f9fd1ee01564a357a61392b810b" Jun 03 21:08:47.436341 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436294 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64d8cdd79c-6xqgm"] Jun 03 21:08:47.436828 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436811 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="util" Jun 03 21:08:47.436888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436833 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="util" Jun 03 21:08:47.436888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436849 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="pull" Jun 03 21:08:47.436888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436858 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="pull" Jun 03 21:08:47.436888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436872 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="extract" Jun 03 21:08:47.436888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436881 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="extract" Jun 03 21:08:47.437029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.436972 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cc0f08-4f5d-4174-b859-95223f767f1a" containerName="extract" Jun 03 21:08:47.440531 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.440506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.443308 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.443282 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ldjt6\"" Jun 03 21:08:47.443449 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.443414 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 21:08:47.447074 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.447048 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64d8cdd79c-6xqgm"] Jun 03 21:08:47.470707 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.470672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swsmm\" (UniqueName: \"kubernetes.io/projected/4e993961-2eca-4856-aa8d-5a17d0780ac9-kube-api-access-swsmm\") pod \"dashboard-redirect-64d8cdd79c-6xqgm\" (UID: \"4e993961-2eca-4856-aa8d-5a17d0780ac9\") " pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.470910 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.470794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4e993961-2eca-4856-aa8d-5a17d0780ac9-redirect-config\") pod \"dashboard-redirect-64d8cdd79c-6xqgm\" (UID: \"4e993961-2eca-4856-aa8d-5a17d0780ac9\") " pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.572101 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.572067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4e993961-2eca-4856-aa8d-5a17d0780ac9-redirect-config\") pod \"dashboard-redirect-64d8cdd79c-6xqgm\" (UID: \"4e993961-2eca-4856-aa8d-5a17d0780ac9\") " pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.572271 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.572160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swsmm\" (UniqueName: \"kubernetes.io/projected/4e993961-2eca-4856-aa8d-5a17d0780ac9-kube-api-access-swsmm\") pod \"dashboard-redirect-64d8cdd79c-6xqgm\" (UID: \"4e993961-2eca-4856-aa8d-5a17d0780ac9\") " pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.572788 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.572770 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4e993961-2eca-4856-aa8d-5a17d0780ac9-redirect-config\") pod \"dashboard-redirect-64d8cdd79c-6xqgm\" (UID: \"4e993961-2eca-4856-aa8d-5a17d0780ac9\") " pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.581240 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.581212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swsmm\" (UniqueName: \"kubernetes.io/projected/4e993961-2eca-4856-aa8d-5a17d0780ac9-kube-api-access-swsmm\") pod \"dashboard-redirect-64d8cdd79c-6xqgm\" (UID: \"4e993961-2eca-4856-aa8d-5a17d0780ac9\") " pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.753037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.752941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" Jun 03 21:08:47.894578 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:47.894551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64d8cdd79c-6xqgm"] Jun 03 21:08:47.897027 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:47.896990 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e993961_2eca_4856_aa8d_5a17d0780ac9.slice/crio-85a59b87c5f3522ec0820a0b328f2019fea59d810e05bc705904db3b19ae5b01 WatchSource:0}: Error finding container 85a59b87c5f3522ec0820a0b328f2019fea59d810e05bc705904db3b19ae5b01: Status 404 returned error can't find the container with id 85a59b87c5f3522ec0820a0b328f2019fea59d810e05bc705904db3b19ae5b01 Jun 03 21:08:48.522443 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:48.522407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" event={"ID":"4e993961-2eca-4856-aa8d-5a17d0780ac9","Type":"ContainerStarted","Data":"85a59b87c5f3522ec0820a0b328f2019fea59d810e05bc705904db3b19ae5b01"} Jun 03 21:08:50.477446 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:50.477407 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gckn5" Jun 03 21:08:53.552711 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:53.552668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" event={"ID":"4e993961-2eca-4856-aa8d-5a17d0780ac9","Type":"ContainerStarted","Data":"997f6a4c0030feea7c6b3876fd93bc234180b7ab1719dfc7135d085194f8b023"} Jun 03 21:08:53.570259 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:53.570201 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64d8cdd79c-6xqgm" podStartSLOduration=1.481644119 podStartE2EDuration="6.570184623s" totalImagesPullingTime="5.088540504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:53.567908322 +0000 UTC m=+335.975671816" watchObservedRunningTime="2026-06-03 21:08:53.570184623 +0000 UTC m=+335.977948117" Jun 03 21:08:56.104539 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.104501 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn"] Jun 03 21:08:56.109495 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.109469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.112051 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.112018 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 21:08:56.112203 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.112094 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 21:08:56.112203 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.112150 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 21:08:56.112203 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.112192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-t6pfn\"" Jun 03 21:08:56.118898 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.118872 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn"] Jun 03 21:08:56.143043 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143043 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47tvs\" (UniqueName: \"kubernetes.io/projected/d2431081-3a8a-4ccc-a65a-2af18cf77920-kube-api-access-47tvs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143510 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.143510 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.143387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2431081-3a8a-4ccc-a65a-2af18cf77920-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.244873 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.244832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245069 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.244880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245069 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47tvs\" (UniqueName: \"kubernetes.io/projected/d2431081-3a8a-4ccc-a65a-2af18cf77920-kube-api-access-47tvs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2431081-3a8a-4ccc-a65a-2af18cf77920-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245461 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245461 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245578 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245556 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245641 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.245871 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.245762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.246455 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.246424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2431081-3a8a-4ccc-a65a-2af18cf77920-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.247548 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.247531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.247603 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.247568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.255611 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.255581 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47tvs\" (UniqueName: \"kubernetes.io/projected/d2431081-3a8a-4ccc-a65a-2af18cf77920-kube-api-access-47tvs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.255990 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.255966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2431081-3a8a-4ccc-a65a-2af18cf77920-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795gr5kn\" (UID: \"d2431081-3a8a-4ccc-a65a-2af18cf77920\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.422509 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.422424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:08:56.574432 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:56.574407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn"] Jun 03 21:08:56.577145 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:08:56.577109 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2431081_3a8a_4ccc_a65a_2af18cf77920.slice/crio-ab0e5524b281b8133d0d96baacf9b213d913c830b385f28c3bd52811c15a27ff WatchSource:0}: Error finding container ab0e5524b281b8133d0d96baacf9b213d913c830b385f28c3bd52811c15a27ff: Status 404 returned error can't find the container with id ab0e5524b281b8133d0d96baacf9b213d913c830b385f28c3bd52811c15a27ff Jun 03 21:08:57.574112 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:57.574068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" event={"ID":"d2431081-3a8a-4ccc-a65a-2af18cf77920","Type":"ContainerStarted","Data":"ab0e5524b281b8133d0d96baacf9b213d913c830b385f28c3bd52811c15a27ff"} Jun 03 21:08:59.500939 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:59.500901 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:08:59.501185 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:59.500975 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:08:59.501185 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:59.501004 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:08:59.586981 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:59.586939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" event={"ID":"d2431081-3a8a-4ccc-a65a-2af18cf77920","Type":"ContainerStarted","Data":"408a4f0412c87b42ce74ec0eea11d17b8b4d1e5133166b0f7a13915faac55af8"} Jun 03 21:08:59.608069 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:08:59.608000 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" podStartSLOduration=0.68668759 podStartE2EDuration="3.607983799s" totalImagesPullingTime="2.921296209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:59.60536987 +0000 UTC m=+342.013133363" watchObservedRunningTime="2026-06-03 21:08:59.607983799 +0000 UTC m=+342.015747293" Jun 03 21:09:00.422929 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:00.422886 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:09:00.427955 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:00.427928 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:09:00.592435 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:00.592390 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:09:00.593367 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:00.593348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795gr5kn" Jun 03 21:09:16.994334 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:16.994293 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclmq"] Jun 03 21:09:17.002956 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.002922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:17.005530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.005503 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bf8g6\"" Jun 03 21:09:17.006027 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.005696 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclmq"] Jun 03 21:09:17.006853 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.006816 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 21:09:17.006853 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.006836 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 21:09:17.138424 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.138386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmvdb\" (UniqueName: \"kubernetes.io/projected/e46019a2-9aa5-49cb-9978-b6d3f73f9d21-kube-api-access-kmvdb\") pod \"kuadrant-operator-catalog-kclmq\" (UID: \"e46019a2-9aa5-49cb-9978-b6d3f73f9d21\") " pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:17.239096 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.239048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmvdb\" (UniqueName: \"kubernetes.io/projected/e46019a2-9aa5-49cb-9978-b6d3f73f9d21-kube-api-access-kmvdb\") pod \"kuadrant-operator-catalog-kclmq\" (UID: \"e46019a2-9aa5-49cb-9978-b6d3f73f9d21\") " pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:17.247412 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.247344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmvdb\" (UniqueName: \"kubernetes.io/projected/e46019a2-9aa5-49cb-9978-b6d3f73f9d21-kube-api-access-kmvdb\") pod \"kuadrant-operator-catalog-kclmq\" (UID: \"e46019a2-9aa5-49cb-9978-b6d3f73f9d21\") " pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:17.314784 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.314732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:17.451891 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.451866 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclmq"] Jun 03 21:09:17.453915 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:17.453883 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46019a2_9aa5_49cb_9978_b6d3f73f9d21.slice/crio-9af5aaf97664ffae5406dcb62850fc7c7567fb20d2d4f55e27c42278c44c3b39 WatchSource:0}: Error finding container 9af5aaf97664ffae5406dcb62850fc7c7567fb20d2d4f55e27c42278c44c3b39: Status 404 returned error can't find the container with id 9af5aaf97664ffae5406dcb62850fc7c7567fb20d2d4f55e27c42278c44c3b39 Jun 03 21:09:17.635166 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.635078 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclmq"] Jun 03 21:09:17.651148 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.651109 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nvsd6"] Jun 03 21:09:17.654083 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.654065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:17.661931 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.661726 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nvsd6"] Jun 03 21:09:17.678378 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.678342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" event={"ID":"e46019a2-9aa5-49cb-9978-b6d3f73f9d21","Type":"ContainerStarted","Data":"9af5aaf97664ffae5406dcb62850fc7c7567fb20d2d4f55e27c42278c44c3b39"} Jun 03 21:09:17.744115 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.744055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvdp\" (UniqueName: \"kubernetes.io/projected/290f3fa0-cfb7-40e2-8174-b66cd1285704-kube-api-access-hkvdp\") pod \"kuadrant-operator-catalog-nvsd6\" (UID: \"290f3fa0-cfb7-40e2-8174-b66cd1285704\") " pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:17.844953 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.844921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvdp\" (UniqueName: \"kubernetes.io/projected/290f3fa0-cfb7-40e2-8174-b66cd1285704-kube-api-access-hkvdp\") pod \"kuadrant-operator-catalog-nvsd6\" (UID: \"290f3fa0-cfb7-40e2-8174-b66cd1285704\") " pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:17.853387 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.853351 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvdp\" (UniqueName: \"kubernetes.io/projected/290f3fa0-cfb7-40e2-8174-b66cd1285704-kube-api-access-hkvdp\") pod \"kuadrant-operator-catalog-nvsd6\" (UID: \"290f3fa0-cfb7-40e2-8174-b66cd1285704\") " pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:17.964880 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:17.964847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:18.117763 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:18.117704 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nvsd6"] Jun 03 21:09:18.200264 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:18.200229 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290f3fa0_cfb7_40e2_8174_b66cd1285704.slice/crio-3f003121580269406495f7f7e787cf4e5681d1321f7ed9082f9b41ae0fc7bda2 WatchSource:0}: Error finding container 3f003121580269406495f7f7e787cf4e5681d1321f7ed9082f9b41ae0fc7bda2: Status 404 returned error can't find the container with id 3f003121580269406495f7f7e787cf4e5681d1321f7ed9082f9b41ae0fc7bda2 Jun 03 21:09:18.687046 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:18.686996 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" event={"ID":"290f3fa0-cfb7-40e2-8174-b66cd1285704","Type":"ContainerStarted","Data":"3f003121580269406495f7f7e787cf4e5681d1321f7ed9082f9b41ae0fc7bda2"} Jun 03 21:09:20.699162 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:20.699126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" event={"ID":"e46019a2-9aa5-49cb-9978-b6d3f73f9d21","Type":"ContainerStarted","Data":"854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a"} Jun 03 21:09:20.699594 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:20.699177 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" podUID="e46019a2-9aa5-49cb-9978-b6d3f73f9d21" containerName="registry-server" containerID="cri-o://854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a" gracePeriod=2 Jun 03 21:09:20.700660 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:20.700627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" event={"ID":"290f3fa0-cfb7-40e2-8174-b66cd1285704","Type":"ContainerStarted","Data":"dbdc77389726869d6d279a51be6b86cadfc5adc7a50337c390a9bd66d95c111d"} Jun 03 21:09:20.720326 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:20.720258 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" podStartSLOduration=2.545668596 podStartE2EDuration="4.720241409s" totalImagesPullingTime="2.174572813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:09:20.719722257 +0000 UTC m=+363.127485751" watchObservedRunningTime="2026-06-03 21:09:20.720241409 +0000 UTC m=+363.128004903" Jun 03 21:09:20.742299 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:20.742247 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" podStartSLOduration=2.311138079 podStartE2EDuration="3.742231068s" totalImagesPullingTime="1.431092989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:09:20.740588451 +0000 UTC m=+363.148351946" watchObservedRunningTime="2026-06-03 21:09:20.742231068 +0000 UTC m=+363.149994561" Jun 03 21:09:20.952274 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:20.952197 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:21.078041 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.078007 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmvdb\" (UniqueName: \"kubernetes.io/projected/e46019a2-9aa5-49cb-9978-b6d3f73f9d21-kube-api-access-kmvdb\") pod \"e46019a2-9aa5-49cb-9978-b6d3f73f9d21\" (UID: \"e46019a2-9aa5-49cb-9978-b6d3f73f9d21\") " Jun 03 21:09:21.080297 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.080269 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e46019a2-9aa5-49cb-9978-b6d3f73f9d21-kube-api-access-kmvdb" (OuterVolumeSpecName: "kube-api-access-kmvdb") pod "e46019a2-9aa5-49cb-9978-b6d3f73f9d21" (UID: "e46019a2-9aa5-49cb-9978-b6d3f73f9d21"). InnerVolumeSpecName "kube-api-access-kmvdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:09:21.179155 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.179115 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmvdb\" (UniqueName: \"kubernetes.io/projected/e46019a2-9aa5-49cb-9978-b6d3f73f9d21-kube-api-access-kmvdb\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:21.707044 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.707008 2579 generic.go:356] "Generic (PLEG): container finished" podID="e46019a2-9aa5-49cb-9978-b6d3f73f9d21" containerID="854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a" exitCode=0 Jun 03 21:09:21.707502 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.707069 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" Jun 03 21:09:21.707502 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.707101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" event={"ID":"e46019a2-9aa5-49cb-9978-b6d3f73f9d21","Type":"ContainerDied","Data":"854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a"} Jun 03 21:09:21.707502 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.707154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kclmq" event={"ID":"e46019a2-9aa5-49cb-9978-b6d3f73f9d21","Type":"ContainerDied","Data":"9af5aaf97664ffae5406dcb62850fc7c7567fb20d2d4f55e27c42278c44c3b39"} Jun 03 21:09:21.707502 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.707189 2579 scope.go:117] "RemoveContainer" containerID="854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a" Jun 03 21:09:21.718291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.718274 2579 scope.go:117] "RemoveContainer" containerID="854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a" Jun 03 21:09:21.718604 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:09:21.718584 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a\": container with ID starting with 854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a not found: ID does not exist" containerID="854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a" Jun 03 21:09:21.718689 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.718616 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a"} err="failed to get container status \"854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a\": rpc error: code = NotFound desc = could not find container \"854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a\": container with ID starting with 854a1d95119c6325aaa575f74e54585acb72c2f192b62e391611ced8687efd4a not found: ID does not exist" Jun 03 21:09:21.728571 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.728517 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclmq"] Jun 03 21:09:21.730619 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:21.730594 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kclmq"] Jun 03 21:09:22.038789 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:22.038698 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e46019a2-9aa5-49cb-9978-b6d3f73f9d21" path="/var/lib/kubelet/pods/e46019a2-9aa5-49cb-9978-b6d3f73f9d21/volumes" Jun 03 21:09:27.965350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:27.965303 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:27.965872 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:27.965388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:27.989334 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:27.989305 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:28.766129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:28.766097 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nvsd6" Jun 03 21:09:32.265917 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.265878 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd"] Jun 03 21:09:32.266301 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.266247 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e46019a2-9aa5-49cb-9978-b6d3f73f9d21" containerName="registry-server" Jun 03 21:09:32.266301 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.266259 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e46019a2-9aa5-49cb-9978-b6d3f73f9d21" containerName="registry-server" Jun 03 21:09:32.266375 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.266314 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e46019a2-9aa5-49cb-9978-b6d3f73f9d21" containerName="registry-server" Jun 03 21:09:32.269431 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.269412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.271897 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.271875 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n5bcn\"" Jun 03 21:09:32.278313 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.278283 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd"] Jun 03 21:09:32.283419 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.283395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8bzl\" (UniqueName: \"kubernetes.io/projected/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-kube-api-access-j8bzl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.283533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.283429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.283533 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.283458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.384407 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.384366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8bzl\" (UniqueName: \"kubernetes.io/projected/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-kube-api-access-j8bzl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.384407 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.384413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.384651 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.384448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.384828 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.384813 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.384888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.384840 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.392164 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.392142 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8bzl\" (UniqueName: \"kubernetes.io/projected/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-kube-api-access-j8bzl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.579880 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.579788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:32.719543 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.719515 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd"] Jun 03 21:09:32.721678 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:32.721651 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5057516d_09d5_4fcd_be80_f6e3e4dff1e1.slice/crio-48af9be432165944a9c43c8204b2cb5a7d1c49082c3ebdf34f92905c1c437672 WatchSource:0}: Error finding container 48af9be432165944a9c43c8204b2cb5a7d1c49082c3ebdf34f92905c1c437672: Status 404 returned error can't find the container with id 48af9be432165944a9c43c8204b2cb5a7d1c49082c3ebdf34f92905c1c437672 Jun 03 21:09:32.764909 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.764862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" event={"ID":"5057516d-09d5-4fcd-be80-f6e3e4dff1e1","Type":"ContainerStarted","Data":"48af9be432165944a9c43c8204b2cb5a7d1c49082c3ebdf34f92905c1c437672"} Jun 03 21:09:32.809417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.809377 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg"] Jun 03 21:09:32.813033 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.813011 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.826296 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.826252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg"] Jun 03 21:09:32.888118 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.888079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc4xf\" (UniqueName: \"kubernetes.io/projected/b3dc21b3-9f72-4262-8c82-c8c29c44a461-kube-api-access-pc4xf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.888295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.888147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.888295 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.888229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.988769 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.988697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.988769 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.988771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc4xf\" (UniqueName: \"kubernetes.io/projected/b3dc21b3-9f72-4262-8c82-c8c29c44a461-kube-api-access-pc4xf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.988964 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.988820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.989223 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.989201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.989266 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.989206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:32.998212 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:32.998177 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc4xf\" (UniqueName: \"kubernetes.io/projected/b3dc21b3-9f72-4262-8c82-c8c29c44a461-kube-api-access-pc4xf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:33.124260 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.124163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:33.260988 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.260960 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg"] Jun 03 21:09:33.262220 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:33.262188 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3dc21b3_9f72_4262_8c82_c8c29c44a461.slice/crio-1de86f3414f106d9cf73693f3bb79d48928b4504bfcc65b902f73c4356a7e03f WatchSource:0}: Error finding container 1de86f3414f106d9cf73693f3bb79d48928b4504bfcc65b902f73c4356a7e03f: Status 404 returned error can't find the container with id 1de86f3414f106d9cf73693f3bb79d48928b4504bfcc65b902f73c4356a7e03f Jun 03 21:09:33.409400 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.409363 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm"] Jun 03 21:09:33.412845 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.412826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.419656 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.419624 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm"] Jun 03 21:09:33.493624 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.493579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnmxh\" (UniqueName: \"kubernetes.io/projected/f1296c3f-641d-4920-9d83-2034daf95282-kube-api-access-bnmxh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.493624 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.493625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.493906 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.493677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.594244 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.594185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.594445 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.594269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnmxh\" (UniqueName: \"kubernetes.io/projected/f1296c3f-641d-4920-9d83-2034daf95282-kube-api-access-bnmxh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.594445 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.594302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.594588 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.594565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.594694 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.594675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.608415 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.602992 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnmxh\" (UniqueName: \"kubernetes.io/projected/f1296c3f-641d-4920-9d83-2034daf95282-kube-api-access-bnmxh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.750560 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.750520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:33.774003 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.773971 2579 generic.go:356] "Generic (PLEG): container finished" podID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerID="1d37d763076669076ba415b720df201693d6bc979962aa1e5c9add3793b1b0cf" exitCode=0 Jun 03 21:09:33.774185 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.774058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" event={"ID":"5057516d-09d5-4fcd-be80-f6e3e4dff1e1","Type":"ContainerDied","Data":"1d37d763076669076ba415b720df201693d6bc979962aa1e5c9add3793b1b0cf"} Jun 03 21:09:33.775976 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.775947 2579 generic.go:356] "Generic (PLEG): container finished" podID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerID="6fdc8222b3821c042bc20a60bf3d0e62128175386c40905575ae3358cd742c1b" exitCode=0 Jun 03 21:09:33.776333 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.776122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" event={"ID":"b3dc21b3-9f72-4262-8c82-c8c29c44a461","Type":"ContainerDied","Data":"6fdc8222b3821c042bc20a60bf3d0e62128175386c40905575ae3358cd742c1b"} Jun 03 21:09:33.776333 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.776166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" event={"ID":"b3dc21b3-9f72-4262-8c82-c8c29c44a461","Type":"ContainerStarted","Data":"1de86f3414f106d9cf73693f3bb79d48928b4504bfcc65b902f73c4356a7e03f"} Jun 03 21:09:33.818830 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.818786 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66"] Jun 03 21:09:33.823614 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.823579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.829117 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.829082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66"] Jun 03 21:09:33.897857 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.897832 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.897921 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.897888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.897959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.897938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb7hp\" (UniqueName: \"kubernetes.io/projected/55832135-e450-4d74-9c61-17fd6874a8ae-kube-api-access-pb7hp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.898077 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.898049 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm"] Jun 03 21:09:33.900017 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:33.899983 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1296c3f_641d_4920_9d83_2034daf95282.slice/crio-e69d9855f955d4c41ce2b983e951318af89de354a2353b501403c100468be2a4 WatchSource:0}: Error finding container e69d9855f955d4c41ce2b983e951318af89de354a2353b501403c100468be2a4: Status 404 returned error can't find the container with id e69d9855f955d4c41ce2b983e951318af89de354a2353b501403c100468be2a4 Jun 03 21:09:33.998392 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.998365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.998494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.998414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.998494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.998440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb7hp\" (UniqueName: \"kubernetes.io/projected/55832135-e450-4d74-9c61-17fd6874a8ae-kube-api-access-pb7hp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.998752 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.998722 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:33.998834 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:33.998814 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:34.006868 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.006796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb7hp\" (UniqueName: \"kubernetes.io/projected/55832135-e450-4d74-9c61-17fd6874a8ae-kube-api-access-pb7hp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:34.135326 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.135287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:34.269445 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.269418 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66"] Jun 03 21:09:34.271024 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:34.270998 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55832135_e450_4d74_9c61_17fd6874a8ae.slice/crio-30c140773f3ba37d85a446c81cd4b1865907ef8354a2fc56ad9c3b02088ba34f WatchSource:0}: Error finding container 30c140773f3ba37d85a446c81cd4b1865907ef8354a2fc56ad9c3b02088ba34f: Status 404 returned error can't find the container with id 30c140773f3ba37d85a446c81cd4b1865907ef8354a2fc56ad9c3b02088ba34f Jun 03 21:09:34.782890 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.782853 2579 generic.go:356] "Generic (PLEG): container finished" podID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerID="8516c430045173fdc91122e433c86e67117bcd6f194bf3654457eae16e87fbea" exitCode=0 Jun 03 21:09:34.783308 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.782934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" event={"ID":"5057516d-09d5-4fcd-be80-f6e3e4dff1e1","Type":"ContainerDied","Data":"8516c430045173fdc91122e433c86e67117bcd6f194bf3654457eae16e87fbea"} Jun 03 21:09:34.784852 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.784817 2579 generic.go:356] "Generic (PLEG): container finished" podID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerID="f01d75a2fed8573433272cac88d6c6b3530ee6e3e2e3c3ee1e1075d1d0885ba1" exitCode=0 Jun 03 21:09:34.784946 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.784865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" event={"ID":"b3dc21b3-9f72-4262-8c82-c8c29c44a461","Type":"ContainerDied","Data":"f01d75a2fed8573433272cac88d6c6b3530ee6e3e2e3c3ee1e1075d1d0885ba1"} Jun 03 21:09:34.786777 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.786729 2579 generic.go:356] "Generic (PLEG): container finished" podID="55832135-e450-4d74-9c61-17fd6874a8ae" containerID="3c808756ad0ec2f01918fd614a050d004deb531de53e79ec33d6c45c3dd2761d" exitCode=0 Jun 03 21:09:34.786883 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.786777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" event={"ID":"55832135-e450-4d74-9c61-17fd6874a8ae","Type":"ContainerDied","Data":"3c808756ad0ec2f01918fd614a050d004deb531de53e79ec33d6c45c3dd2761d"} Jun 03 21:09:34.786883 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.786819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" event={"ID":"55832135-e450-4d74-9c61-17fd6874a8ae","Type":"ContainerStarted","Data":"30c140773f3ba37d85a446c81cd4b1865907ef8354a2fc56ad9c3b02088ba34f"} Jun 03 21:09:34.788436 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.788414 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1296c3f-641d-4920-9d83-2034daf95282" containerID="5ce3f46cae059345ec415c63c03e80749272d933c99838cd01e34994c9a1d592" exitCode=0 Jun 03 21:09:34.788554 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.788444 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" event={"ID":"f1296c3f-641d-4920-9d83-2034daf95282","Type":"ContainerDied","Data":"5ce3f46cae059345ec415c63c03e80749272d933c99838cd01e34994c9a1d592"} Jun 03 21:09:34.788554 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:34.788490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" event={"ID":"f1296c3f-641d-4920-9d83-2034daf95282","Type":"ContainerStarted","Data":"e69d9855f955d4c41ce2b983e951318af89de354a2353b501403c100468be2a4"} Jun 03 21:09:35.795859 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.795825 2579 generic.go:356] "Generic (PLEG): container finished" podID="55832135-e450-4d74-9c61-17fd6874a8ae" containerID="8b4f11fa305f823dc47fda2688b0ddd06a929535c730f89fabf5a4c5fb880a88" exitCode=0 Jun 03 21:09:35.796306 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.795903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" event={"ID":"55832135-e450-4d74-9c61-17fd6874a8ae","Type":"ContainerDied","Data":"8b4f11fa305f823dc47fda2688b0ddd06a929535c730f89fabf5a4c5fb880a88"} Jun 03 21:09:35.797916 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.797892 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1296c3f-641d-4920-9d83-2034daf95282" containerID="6ebe65ef2171032940778970655167cadf4224e5d23daa26a4e174baad452747" exitCode=0 Jun 03 21:09:35.798026 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.797977 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" event={"ID":"f1296c3f-641d-4920-9d83-2034daf95282","Type":"ContainerDied","Data":"6ebe65ef2171032940778970655167cadf4224e5d23daa26a4e174baad452747"} Jun 03 21:09:35.800489 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.800464 2579 generic.go:356] "Generic (PLEG): container finished" podID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerID="a820cd11f4b54955164edc08a39fbfbe92de464b56ebf3ef03b3ed2543cca7fb" exitCode=0 Jun 03 21:09:35.800591 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.800549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" event={"ID":"5057516d-09d5-4fcd-be80-f6e3e4dff1e1","Type":"ContainerDied","Data":"a820cd11f4b54955164edc08a39fbfbe92de464b56ebf3ef03b3ed2543cca7fb"} Jun 03 21:09:35.802772 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.802726 2579 generic.go:356] "Generic (PLEG): container finished" podID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerID="c3c7c62a11c437b2a284454e79e493f317fecdc58e6f86f101ef08a89c5daffb" exitCode=0 Jun 03 21:09:35.802859 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:35.802770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" event={"ID":"b3dc21b3-9f72-4262-8c82-c8c29c44a461","Type":"ContainerDied","Data":"c3c7c62a11c437b2a284454e79e493f317fecdc58e6f86f101ef08a89c5daffb"} Jun 03 21:09:36.810641 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:36.810603 2579 generic.go:356] "Generic (PLEG): container finished" podID="55832135-e450-4d74-9c61-17fd6874a8ae" containerID="1e38a7087b25ff93d079e2082c89ab0ca639797d6c48026bd422377939671719" exitCode=0 Jun 03 21:09:36.811080 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:36.810690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" event={"ID":"55832135-e450-4d74-9c61-17fd6874a8ae","Type":"ContainerDied","Data":"1e38a7087b25ff93d079e2082c89ab0ca639797d6c48026bd422377939671719"} Jun 03 21:09:36.812813 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:36.812789 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1296c3f-641d-4920-9d83-2034daf95282" containerID="e0c1f50bfe9406d8e437b50515618cadb7cb746da1eed801eaf6aac4fbf5c8c6" exitCode=0 Jun 03 21:09:36.812930 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:36.812879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" event={"ID":"f1296c3f-641d-4920-9d83-2034daf95282","Type":"ContainerDied","Data":"e0c1f50bfe9406d8e437b50515618cadb7cb746da1eed801eaf6aac4fbf5c8c6"} Jun 03 21:09:36.977006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:36.976972 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:36.980216 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:36.980194 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:37.024000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.023956 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-bundle\") pod \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " Jun 03 21:09:37.024209 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.024013 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-util\") pod \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " Jun 03 21:09:37.024209 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.024042 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc4xf\" (UniqueName: \"kubernetes.io/projected/b3dc21b3-9f72-4262-8c82-c8c29c44a461-kube-api-access-pc4xf\") pod \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " Jun 03 21:09:37.024209 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.024101 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8bzl\" (UniqueName: \"kubernetes.io/projected/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-kube-api-access-j8bzl\") pod \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " Jun 03 21:09:37.024209 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.024144 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-util\") pod \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\" (UID: \"b3dc21b3-9f72-4262-8c82-c8c29c44a461\") " Jun 03 21:09:37.024448 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.024229 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-bundle\") pod \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\" (UID: \"5057516d-09d5-4fcd-be80-f6e3e4dff1e1\") " Jun 03 21:09:37.024758 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.024634 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-bundle" (OuterVolumeSpecName: "bundle") pod "b3dc21b3-9f72-4262-8c82-c8c29c44a461" (UID: "b3dc21b3-9f72-4262-8c82-c8c29c44a461"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:37.026617 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.026577 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3dc21b3-9f72-4262-8c82-c8c29c44a461-kube-api-access-pc4xf" (OuterVolumeSpecName: "kube-api-access-pc4xf") pod "b3dc21b3-9f72-4262-8c82-c8c29c44a461" (UID: "b3dc21b3-9f72-4262-8c82-c8c29c44a461"). InnerVolumeSpecName "kube-api-access-pc4xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:09:37.027187 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.027138 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-bundle" (OuterVolumeSpecName: "bundle") pod "5057516d-09d5-4fcd-be80-f6e3e4dff1e1" (UID: "5057516d-09d5-4fcd-be80-f6e3e4dff1e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:37.027629 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.027599 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-kube-api-access-j8bzl" (OuterVolumeSpecName: "kube-api-access-j8bzl") pod "5057516d-09d5-4fcd-be80-f6e3e4dff1e1" (UID: "5057516d-09d5-4fcd-be80-f6e3e4dff1e1"). InnerVolumeSpecName "kube-api-access-j8bzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:09:37.031211 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.031160 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-util" (OuterVolumeSpecName: "util") pod "b3dc21b3-9f72-4262-8c82-c8c29c44a461" (UID: "b3dc21b3-9f72-4262-8c82-c8c29c44a461"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:37.032306 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.032275 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-util" (OuterVolumeSpecName: "util") pod "5057516d-09d5-4fcd-be80-f6e3e4dff1e1" (UID: "5057516d-09d5-4fcd-be80-f6e3e4dff1e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:37.125444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.125332 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:37.125444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.125381 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:37.125444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.125393 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3dc21b3-9f72-4262-8c82-c8c29c44a461-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:37.125444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.125400 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:37.125444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.125410 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc4xf\" (UniqueName: \"kubernetes.io/projected/b3dc21b3-9f72-4262-8c82-c8c29c44a461-kube-api-access-pc4xf\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:37.125444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.125420 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8bzl\" (UniqueName: \"kubernetes.io/projected/5057516d-09d5-4fcd-be80-f6e3e4dff1e1-kube-api-access-j8bzl\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:37.823297 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.823265 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" Jun 03 21:09:37.823760 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.823255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd" event={"ID":"5057516d-09d5-4fcd-be80-f6e3e4dff1e1","Type":"ContainerDied","Data":"48af9be432165944a9c43c8204b2cb5a7d1c49082c3ebdf34f92905c1c437672"} Jun 03 21:09:37.823760 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.823391 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48af9be432165944a9c43c8204b2cb5a7d1c49082c3ebdf34f92905c1c437672" Jun 03 21:09:37.825419 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.825383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" event={"ID":"b3dc21b3-9f72-4262-8c82-c8c29c44a461","Type":"ContainerDied","Data":"1de86f3414f106d9cf73693f3bb79d48928b4504bfcc65b902f73c4356a7e03f"} Jun 03 21:09:37.825419 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.825411 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg" Jun 03 21:09:37.825560 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.825441 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1de86f3414f106d9cf73693f3bb79d48928b4504bfcc65b902f73c4356a7e03f" Jun 03 21:09:37.997823 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.997799 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:37.999861 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:37.999842 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:38.032627 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.032587 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-bundle\") pod \"55832135-e450-4d74-9c61-17fd6874a8ae\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " Jun 03 21:09:38.032822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.032637 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb7hp\" (UniqueName: \"kubernetes.io/projected/55832135-e450-4d74-9c61-17fd6874a8ae-kube-api-access-pb7hp\") pod \"55832135-e450-4d74-9c61-17fd6874a8ae\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " Jun 03 21:09:38.032822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.032671 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnmxh\" (UniqueName: \"kubernetes.io/projected/f1296c3f-641d-4920-9d83-2034daf95282-kube-api-access-bnmxh\") pod \"f1296c3f-641d-4920-9d83-2034daf95282\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " Jun 03 21:09:38.032822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.032692 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-util\") pod \"f1296c3f-641d-4920-9d83-2034daf95282\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " Jun 03 21:09:38.032822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.032724 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-bundle\") pod \"f1296c3f-641d-4920-9d83-2034daf95282\" (UID: \"f1296c3f-641d-4920-9d83-2034daf95282\") " Jun 03 21:09:38.033041 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.032935 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-util\") pod \"55832135-e450-4d74-9c61-17fd6874a8ae\" (UID: \"55832135-e450-4d74-9c61-17fd6874a8ae\") " Jun 03 21:09:38.033368 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.033328 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-bundle" (OuterVolumeSpecName: "bundle") pod "55832135-e450-4d74-9c61-17fd6874a8ae" (UID: "55832135-e450-4d74-9c61-17fd6874a8ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:38.036466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.035873 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-bundle" (OuterVolumeSpecName: "bundle") pod "f1296c3f-641d-4920-9d83-2034daf95282" (UID: "f1296c3f-641d-4920-9d83-2034daf95282"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:38.040928 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.038138 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55832135-e450-4d74-9c61-17fd6874a8ae-kube-api-access-pb7hp" (OuterVolumeSpecName: "kube-api-access-pb7hp") pod "55832135-e450-4d74-9c61-17fd6874a8ae" (UID: "55832135-e450-4d74-9c61-17fd6874a8ae"). InnerVolumeSpecName "kube-api-access-pb7hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:09:38.040928 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.040910 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1296c3f-641d-4920-9d83-2034daf95282-kube-api-access-bnmxh" (OuterVolumeSpecName: "kube-api-access-bnmxh") pod "f1296c3f-641d-4920-9d83-2034daf95282" (UID: "f1296c3f-641d-4920-9d83-2034daf95282"). InnerVolumeSpecName "kube-api-access-bnmxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:09:38.045285 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.045242 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-util" (OuterVolumeSpecName: "util") pod "55832135-e450-4d74-9c61-17fd6874a8ae" (UID: "55832135-e450-4d74-9c61-17fd6874a8ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:38.046030 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.045996 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-util" (OuterVolumeSpecName: "util") pod "f1296c3f-641d-4920-9d83-2034daf95282" (UID: "f1296c3f-641d-4920-9d83-2034daf95282"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:09:38.133941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.133840 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb7hp\" (UniqueName: \"kubernetes.io/projected/55832135-e450-4d74-9c61-17fd6874a8ae-kube-api-access-pb7hp\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:38.133941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.133872 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnmxh\" (UniqueName: \"kubernetes.io/projected/f1296c3f-641d-4920-9d83-2034daf95282-kube-api-access-bnmxh\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:38.133941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.133888 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:38.133941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.133905 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1296c3f-641d-4920-9d83-2034daf95282-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:38.133941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.133917 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:38.133941 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.133928 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55832135-e450-4d74-9c61-17fd6874a8ae-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:09:38.837882 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.837837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" event={"ID":"55832135-e450-4d74-9c61-17fd6874a8ae","Type":"ContainerDied","Data":"30c140773f3ba37d85a446c81cd4b1865907ef8354a2fc56ad9c3b02088ba34f"} Jun 03 21:09:38.838401 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.837890 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66" Jun 03 21:09:38.838401 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.837928 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30c140773f3ba37d85a446c81cd4b1865907ef8354a2fc56ad9c3b02088ba34f" Jun 03 21:09:38.840019 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.839989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" event={"ID":"f1296c3f-641d-4920-9d83-2034daf95282","Type":"ContainerDied","Data":"e69d9855f955d4c41ce2b983e951318af89de354a2353b501403c100468be2a4"} Jun 03 21:09:38.840173 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.840039 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e69d9855f955d4c41ce2b983e951318af89de354a2353b501403c100468be2a4" Jun 03 21:09:38.840173 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:38.840039 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm" Jun 03 21:09:47.909638 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909599 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p"] Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909942 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="util" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909953 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="util" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909963 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="extract" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909969 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="extract" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909976 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="extract" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909981 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="extract" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909987 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="extract" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.909991 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="extract" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910000 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="pull" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910004 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="pull" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910014 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="util" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910018 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="util" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910025 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="pull" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910030 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="pull" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910035 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="pull" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910039 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="pull" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910045 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="util" Jun 03 21:09:47.910048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910050 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="util" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910059 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="extract" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910065 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="extract" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910077 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="pull" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910082 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="pull" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910088 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="util" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910093 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="util" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910144 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="55832135-e450-4d74-9c61-17fd6874a8ae" containerName="extract" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910152 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1296c3f-641d-4920-9d83-2034daf95282" containerName="extract" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910159 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5057516d-09d5-4fcd-be80-f6e3e4dff1e1" containerName="extract" Jun 03 21:09:47.910690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.910165 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3dc21b3-9f72-4262-8c82-c8c29c44a461" containerName="extract" Jun 03 21:09:47.914860 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.914836 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:09:47.917574 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.917554 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 21:09:47.917658 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.917624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7vgm2\"" Jun 03 21:09:47.923952 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:47.923919 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p"] Jun 03 21:09:48.026870 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:48.026812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87jnb\" (UniqueName: \"kubernetes.io/projected/20e4d955-83f7-46f7-be36-62b4218436ab-kube-api-access-87jnb\") pod \"dns-operator-controller-manager-864dd78c4c-cr28p\" (UID: \"20e4d955-83f7-46f7-be36-62b4218436ab\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:09:48.128020 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:48.127970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87jnb\" (UniqueName: \"kubernetes.io/projected/20e4d955-83f7-46f7-be36-62b4218436ab-kube-api-access-87jnb\") pod \"dns-operator-controller-manager-864dd78c4c-cr28p\" (UID: \"20e4d955-83f7-46f7-be36-62b4218436ab\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:09:48.144588 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:48.144554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87jnb\" (UniqueName: \"kubernetes.io/projected/20e4d955-83f7-46f7-be36-62b4218436ab-kube-api-access-87jnb\") pod \"dns-operator-controller-manager-864dd78c4c-cr28p\" (UID: \"20e4d955-83f7-46f7-be36-62b4218436ab\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:09:48.227686 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:48.227653 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:09:48.371591 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:48.371557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p"] Jun 03 21:09:48.373614 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:48.373578 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e4d955_83f7_46f7_be36_62b4218436ab.slice/crio-cdf0bd55852cd915bc4071f39417d37c85e51eaab0012a11fb0a85087b256f75 WatchSource:0}: Error finding container cdf0bd55852cd915bc4071f39417d37c85e51eaab0012a11fb0a85087b256f75: Status 404 returned error can't find the container with id cdf0bd55852cd915bc4071f39417d37c85e51eaab0012a11fb0a85087b256f75 Jun 03 21:09:48.895924 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:48.895888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" event={"ID":"20e4d955-83f7-46f7-be36-62b4218436ab","Type":"ContainerStarted","Data":"cdf0bd55852cd915bc4071f39417d37c85e51eaab0012a11fb0a85087b256f75"} Jun 03 21:09:50.908444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:50.908405 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" event={"ID":"20e4d955-83f7-46f7-be36-62b4218436ab","Type":"ContainerStarted","Data":"71a90320d7ddad09cb7ba721f77606063a59419f97cd61ade5bd61dc02325aa3"} Jun 03 21:09:50.908914 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:50.908670 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:09:50.947819 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:50.947764 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" podStartSLOduration=1.494881902 podStartE2EDuration="3.947731279s" totalImagesPullingTime="2.452849377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:09:50.944763794 +0000 UTC m=+393.352527280" watchObservedRunningTime="2026-06-03 21:09:50.947731279 +0000 UTC m=+393.355494774" Jun 03 21:09:53.026555 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.026518 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r"] Jun 03 21:09:53.030624 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.030606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:09:53.033850 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.033825 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9gr2g\"" Jun 03 21:09:53.042467 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.042440 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r"] Jun 03 21:09:53.176514 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.176465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5b29\" (UniqueName: \"kubernetes.io/projected/241902c4-9063-444f-ae75-afc9a0d9b6f0-kube-api-access-f5b29\") pod \"authorino-operator-75cc8d5cb7-j7f4r\" (UID: \"241902c4-9063-444f-ae75-afc9a0d9b6f0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:09:53.277907 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.277800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5b29\" (UniqueName: \"kubernetes.io/projected/241902c4-9063-444f-ae75-afc9a0d9b6f0-kube-api-access-f5b29\") pod \"authorino-operator-75cc8d5cb7-j7f4r\" (UID: \"241902c4-9063-444f-ae75-afc9a0d9b6f0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:09:53.286179 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.286149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5b29\" (UniqueName: \"kubernetes.io/projected/241902c4-9063-444f-ae75-afc9a0d9b6f0-kube-api-access-f5b29\") pod \"authorino-operator-75cc8d5cb7-j7f4r\" (UID: \"241902c4-9063-444f-ae75-afc9a0d9b6f0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:09:53.341395 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.341349 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:09:53.519213 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.519185 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r"] Jun 03 21:09:53.521001 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:09:53.520977 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241902c4_9063_444f_ae75_afc9a0d9b6f0.slice/crio-92242ad3149c9c2c7699c573d36ce8e5aaff977d96d06a303d08089408640c5a WatchSource:0}: Error finding container 92242ad3149c9c2c7699c573d36ce8e5aaff977d96d06a303d08089408640c5a: Status 404 returned error can't find the container with id 92242ad3149c9c2c7699c573d36ce8e5aaff977d96d06a303d08089408640c5a Jun 03 21:09:53.926861 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:53.926765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" event={"ID":"241902c4-9063-444f-ae75-afc9a0d9b6f0","Type":"ContainerStarted","Data":"92242ad3149c9c2c7699c573d36ce8e5aaff977d96d06a303d08089408640c5a"} Jun 03 21:09:55.941691 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:55.941658 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" event={"ID":"241902c4-9063-444f-ae75-afc9a0d9b6f0","Type":"ContainerStarted","Data":"bcbd62a1df4b4c9ac242aa858083a91b184d87034136e33ba550f628d5aaccd4"} Jun 03 21:09:55.942095 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:55.941798 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:09:55.960556 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:09:55.960447 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" podStartSLOduration=0.784087815 podStartE2EDuration="2.960427996s" totalImagesPullingTime="2.176340181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:09:55.957827521 +0000 UTC m=+398.365591016" watchObservedRunningTime="2026-06-03 21:09:55.960427996 +0000 UTC m=+398.368191493" Jun 03 21:10:01.917047 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:01.917008 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cr28p" Jun 03 21:10:02.459808 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.459765 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5"] Jun 03 21:10:02.463042 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.463019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.466176 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.466147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ch2nl\"" Jun 03 21:10:02.478068 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.478029 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5"] Jun 03 21:10:02.564531 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.564493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76139453-8979-46ff-bc4a-572b7cf7b2eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.564531 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.564534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9rt5\" (UniqueName: \"kubernetes.io/projected/76139453-8979-46ff-bc4a-572b7cf7b2eb-kube-api-access-l9rt5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.665878 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.665836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76139453-8979-46ff-bc4a-572b7cf7b2eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.665878 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.665881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9rt5\" (UniqueName: \"kubernetes.io/projected/76139453-8979-46ff-bc4a-572b7cf7b2eb-kube-api-access-l9rt5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.666242 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.666222 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76139453-8979-46ff-bc4a-572b7cf7b2eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.680169 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.680138 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9rt5\" (UniqueName: \"kubernetes.io/projected/76139453-8979-46ff-bc4a-572b7cf7b2eb-kube-api-access-l9rt5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.775017 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.774921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:02.919720 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.919689 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5"] Jun 03 21:10:02.921159 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:10:02.921130 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76139453_8979_46ff_bc4a_572b7cf7b2eb.slice/crio-b3b7f0a996b350227b6ae18d10b7114f7f2083fd22ff0322cb1405be874d3287 WatchSource:0}: Error finding container b3b7f0a996b350227b6ae18d10b7114f7f2083fd22ff0322cb1405be874d3287: Status 404 returned error can't find the container with id b3b7f0a996b350227b6ae18d10b7114f7f2083fd22ff0322cb1405be874d3287 Jun 03 21:10:02.989601 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:02.989558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" event={"ID":"76139453-8979-46ff-bc4a-572b7cf7b2eb","Type":"ContainerStarted","Data":"b3b7f0a996b350227b6ae18d10b7114f7f2083fd22ff0322cb1405be874d3287"} Jun 03 21:10:06.950325 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:06.950291 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7f4r" Jun 03 21:10:09.027066 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:09.027026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" event={"ID":"76139453-8979-46ff-bc4a-572b7cf7b2eb","Type":"ContainerStarted","Data":"75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873"} Jun 03 21:10:09.027573 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:09.027178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:09.047500 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:09.047443 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" podStartSLOduration=1.385425226 podStartE2EDuration="7.047425542s" totalImagesPullingTime="5.662000316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:10:09.045963278 +0000 UTC m=+411.453726773" watchObservedRunningTime="2026-06-03 21:10:09.047425542 +0000 UTC m=+411.455189036" Jun 03 21:10:20.039582 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:20.039553 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:21.783558 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.783523 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5"] Jun 03 21:10:21.783986 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.783702 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" podUID="76139453-8979-46ff-bc4a-572b7cf7b2eb" containerName="manager" containerID="cri-o://75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873" gracePeriod=2 Jun 03 21:10:21.795269 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.795235 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5"] Jun 03 21:10:21.796499 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:10:21.796460 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"76139453-8979-46ff-bc4a-572b7cf7b2eb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:21.808174 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.808144 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7"] Jun 03 21:10:21.808523 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.808511 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76139453-8979-46ff-bc4a-572b7cf7b2eb" containerName="manager" Jun 03 21:10:21.808566 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.808525 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="76139453-8979-46ff-bc4a-572b7cf7b2eb" containerName="manager" Jun 03 21:10:21.808605 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.808597 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="76139453-8979-46ff-bc4a-572b7cf7b2eb" containerName="manager" Jun 03 21:10:21.811672 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.811645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:21.814203 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:10:21.814163 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcbw5\" is forbidden: User \"system:node:ip-10-0-135-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-120.ec2.internal' and this object" podUID="76139453-8979-46ff-bc4a-572b7cf7b2eb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:21.827105 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.827059 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7"] Jun 03 21:10:21.827350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.827214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m76vc\" (UniqueName: \"kubernetes.io/projected/9cc2c354-236c-4def-bf2a-0e48bf6939b1-kube-api-access-m76vc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x87w7\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:21.827512 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.827490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc2c354-236c-4def-bf2a-0e48bf6939b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x87w7\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:21.928707 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.928664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc2c354-236c-4def-bf2a-0e48bf6939b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x87w7\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:21.928707 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.928717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m76vc\" (UniqueName: \"kubernetes.io/projected/9cc2c354-236c-4def-bf2a-0e48bf6939b1-kube-api-access-m76vc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x87w7\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:21.929087 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.929067 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc2c354-236c-4def-bf2a-0e48bf6939b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x87w7\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:21.945827 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:21.945725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76vc\" (UniqueName: \"kubernetes.io/projected/9cc2c354-236c-4def-bf2a-0e48bf6939b1-kube-api-access-m76vc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x87w7\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:22.041820 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.039575 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:22.099795 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.099726 2579 generic.go:356] "Generic (PLEG): container finished" podID="76139453-8979-46ff-bc4a-572b7cf7b2eb" containerID="75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873" exitCode=0 Jun 03 21:10:22.099958 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.099804 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcbw5" Jun 03 21:10:22.099958 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.099861 2579 scope.go:117] "RemoveContainer" containerID="75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873" Jun 03 21:10:22.108656 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.108636 2579 scope.go:117] "RemoveContainer" containerID="75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873" Jun 03 21:10:22.108936 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:10:22.108915 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873\": container with ID starting with 75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873 not found: ID does not exist" containerID="75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873" Jun 03 21:10:22.109001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.108944 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873"} err="failed to get container status \"75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873\": rpc error: code = NotFound desc = could not find container \"75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873\": container with ID starting with 75793f22213b2222acc346de69f7d3fefc16a3a15e3c2fb676647559db516873 not found: ID does not exist" Jun 03 21:10:22.130779 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.130728 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76139453-8979-46ff-bc4a-572b7cf7b2eb-extensions-socket-volume\") pod \"76139453-8979-46ff-bc4a-572b7cf7b2eb\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " Jun 03 21:10:22.130959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.130793 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9rt5\" (UniqueName: \"kubernetes.io/projected/76139453-8979-46ff-bc4a-572b7cf7b2eb-kube-api-access-l9rt5\") pod \"76139453-8979-46ff-bc4a-572b7cf7b2eb\" (UID: \"76139453-8979-46ff-bc4a-572b7cf7b2eb\") " Jun 03 21:10:22.131102 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.131078 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76139453-8979-46ff-bc4a-572b7cf7b2eb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "76139453-8979-46ff-bc4a-572b7cf7b2eb" (UID: "76139453-8979-46ff-bc4a-572b7cf7b2eb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:10:22.133128 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.133106 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76139453-8979-46ff-bc4a-572b7cf7b2eb-kube-api-access-l9rt5" (OuterVolumeSpecName: "kube-api-access-l9rt5") pod "76139453-8979-46ff-bc4a-572b7cf7b2eb" (UID: "76139453-8979-46ff-bc4a-572b7cf7b2eb"). InnerVolumeSpecName "kube-api-access-l9rt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:10:22.162926 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.162889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:22.232472 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.232439 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76139453-8979-46ff-bc4a-572b7cf7b2eb-extensions-socket-volume\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:10:22.232472 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.232468 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9rt5\" (UniqueName: \"kubernetes.io/projected/76139453-8979-46ff-bc4a-572b7cf7b2eb-kube-api-access-l9rt5\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:10:22.304554 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:22.304515 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7"] Jun 03 21:10:22.306025 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:10:22.306000 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc2c354_236c_4def_bf2a_0e48bf6939b1.slice/crio-8595f9c2b159a9e8c99d36002152b34738de56be97d7258b4a9ea0d1bf8ae425 WatchSource:0}: Error finding container 8595f9c2b159a9e8c99d36002152b34738de56be97d7258b4a9ea0d1bf8ae425: Status 404 returned error can't find the container with id 8595f9c2b159a9e8c99d36002152b34738de56be97d7258b4a9ea0d1bf8ae425 Jun 03 21:10:23.108420 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:23.108386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" event={"ID":"9cc2c354-236c-4def-bf2a-0e48bf6939b1","Type":"ContainerStarted","Data":"49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2"} Jun 03 21:10:23.108854 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:23.108439 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" event={"ID":"9cc2c354-236c-4def-bf2a-0e48bf6939b1","Type":"ContainerStarted","Data":"8595f9c2b159a9e8c99d36002152b34738de56be97d7258b4a9ea0d1bf8ae425"} Jun 03 21:10:23.108854 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:23.108531 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:23.135307 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:23.135247 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" podStartSLOduration=2.135230656 podStartE2EDuration="2.135230656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:10:23.132810701 +0000 UTC m=+425.540574197" watchObservedRunningTime="2026-06-03 21:10:23.135230656 +0000 UTC m=+425.542994150" Jun 03 21:10:24.039663 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:24.039627 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76139453-8979-46ff-bc4a-572b7cf7b2eb" path="/var/lib/kubelet/pods/76139453-8979-46ff-bc4a-572b7cf7b2eb/volumes" Jun 03 21:10:34.115950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:34.115868 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:37.149390 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.149346 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7"] Jun 03 21:10:37.149885 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.149575 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" podUID="9cc2c354-236c-4def-bf2a-0e48bf6939b1" containerName="manager" containerID="cri-o://49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2" gracePeriod=10 Jun 03 21:10:37.395807 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.395781 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:37.412643 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.412567 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz"] Jun 03 21:10:37.413017 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.412998 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc2c354-236c-4def-bf2a-0e48bf6939b1" containerName="manager" Jun 03 21:10:37.413109 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.413019 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc2c354-236c-4def-bf2a-0e48bf6939b1" containerName="manager" Jun 03 21:10:37.413163 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.413113 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc2c354-236c-4def-bf2a-0e48bf6939b1" containerName="manager" Jun 03 21:10:37.415967 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.415947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.430836 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.430806 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz"] Jun 03 21:10:37.473437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.473404 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m76vc\" (UniqueName: \"kubernetes.io/projected/9cc2c354-236c-4def-bf2a-0e48bf6939b1-kube-api-access-m76vc\") pod \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " Jun 03 21:10:37.473437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.473448 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc2c354-236c-4def-bf2a-0e48bf6939b1-extensions-socket-volume\") pod \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\" (UID: \"9cc2c354-236c-4def-bf2a-0e48bf6939b1\") " Jun 03 21:10:37.473724 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.473702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f22dc5-8e29-4429-94e8-3c7eb26bc074-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r2tbz\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.473815 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.473765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pft4\" (UniqueName: \"kubernetes.io/projected/95f22dc5-8e29-4429-94e8-3c7eb26bc074-kube-api-access-7pft4\") pod \"kuadrant-operator-controller-manager-86878c769f-r2tbz\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.473889 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.473867 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc2c354-236c-4def-bf2a-0e48bf6939b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9cc2c354-236c-4def-bf2a-0e48bf6939b1" (UID: "9cc2c354-236c-4def-bf2a-0e48bf6939b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:10:37.475676 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.475646 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc2c354-236c-4def-bf2a-0e48bf6939b1-kube-api-access-m76vc" (OuterVolumeSpecName: "kube-api-access-m76vc") pod "9cc2c354-236c-4def-bf2a-0e48bf6939b1" (UID: "9cc2c354-236c-4def-bf2a-0e48bf6939b1"). InnerVolumeSpecName "kube-api-access-m76vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:10:37.575038 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.575000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f22dc5-8e29-4429-94e8-3c7eb26bc074-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r2tbz\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.575038 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.575039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pft4\" (UniqueName: \"kubernetes.io/projected/95f22dc5-8e29-4429-94e8-3c7eb26bc074-kube-api-access-7pft4\") pod \"kuadrant-operator-controller-manager-86878c769f-r2tbz\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.575243 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.575069 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m76vc\" (UniqueName: \"kubernetes.io/projected/9cc2c354-236c-4def-bf2a-0e48bf6939b1-kube-api-access-m76vc\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:10:37.575243 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.575079 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc2c354-236c-4def-bf2a-0e48bf6939b1-extensions-socket-volume\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:10:37.575407 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.575386 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f22dc5-8e29-4429-94e8-3c7eb26bc074-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r2tbz\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.587075 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.587044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pft4\" (UniqueName: \"kubernetes.io/projected/95f22dc5-8e29-4429-94e8-3c7eb26bc074-kube-api-access-7pft4\") pod \"kuadrant-operator-controller-manager-86878c769f-r2tbz\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.727289 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.727248 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:37.868481 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:37.868451 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz"] Jun 03 21:10:37.870062 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:10:37.870029 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f22dc5_8e29_4429_94e8_3c7eb26bc074.slice/crio-dfa435d8cdfc0128470bfbe93a0391ea012b5cda8925d3ca5127b0c6838894aa WatchSource:0}: Error finding container dfa435d8cdfc0128470bfbe93a0391ea012b5cda8925d3ca5127b0c6838894aa: Status 404 returned error can't find the container with id dfa435d8cdfc0128470bfbe93a0391ea012b5cda8925d3ca5127b0c6838894aa Jun 03 21:10:38.193283 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.193249 2579 generic.go:356] "Generic (PLEG): container finished" podID="9cc2c354-236c-4def-bf2a-0e48bf6939b1" containerID="49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2" exitCode=0 Jun 03 21:10:38.193696 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.193312 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" Jun 03 21:10:38.193696 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.193334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" event={"ID":"9cc2c354-236c-4def-bf2a-0e48bf6939b1","Type":"ContainerDied","Data":"49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2"} Jun 03 21:10:38.193696 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.193415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7" event={"ID":"9cc2c354-236c-4def-bf2a-0e48bf6939b1","Type":"ContainerDied","Data":"8595f9c2b159a9e8c99d36002152b34738de56be97d7258b4a9ea0d1bf8ae425"} Jun 03 21:10:38.193696 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.193438 2579 scope.go:117] "RemoveContainer" containerID="49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2" Jun 03 21:10:38.195371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.195346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" event={"ID":"95f22dc5-8e29-4429-94e8-3c7eb26bc074","Type":"ContainerStarted","Data":"c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25"} Jun 03 21:10:38.195496 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.195434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" event={"ID":"95f22dc5-8e29-4429-94e8-3c7eb26bc074","Type":"ContainerStarted","Data":"dfa435d8cdfc0128470bfbe93a0391ea012b5cda8925d3ca5127b0c6838894aa"} Jun 03 21:10:38.195561 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.195494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:38.203416 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.203394 2579 scope.go:117] "RemoveContainer" containerID="49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2" Jun 03 21:10:38.203701 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:10:38.203680 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2\": container with ID starting with 49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2 not found: ID does not exist" containerID="49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2" Jun 03 21:10:38.203808 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.203709 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2"} err="failed to get container status \"49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2\": rpc error: code = NotFound desc = could not find container \"49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2\": container with ID starting with 49a6f9fb6fb8536a151eead121be1a6135c2178769476f3c265c4acd3b3446f2 not found: ID does not exist" Jun 03 21:10:38.218065 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.218033 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7"] Jun 03 21:10:38.224534 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.224501 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x87w7"] Jun 03 21:10:38.242393 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:38.242337 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" podStartSLOduration=1.242320967 podStartE2EDuration="1.242320967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:10:38.239818211 +0000 UTC m=+440.647581709" watchObservedRunningTime="2026-06-03 21:10:38.242320967 +0000 UTC m=+440.650084462" Jun 03 21:10:40.039371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:40.039335 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc2c354-236c-4def-bf2a-0e48bf6939b1" path="/var/lib/kubelet/pods/9cc2c354-236c-4def-bf2a-0e48bf6939b1/volumes" Jun 03 21:10:49.207095 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:49.207056 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:10:53.491004 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.490966 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm"] Jun 03 21:10:53.500682 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.500651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.504342 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.504309 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-95jzq\"" Jun 03 21:10:53.505503 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.505473 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm"] Jun 03 21:10:53.623182 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623182 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65tv6\" (UniqueName: \"kubernetes.io/projected/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-kube-api-access-65tv6\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623417 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623604 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.623640 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.623626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724477 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.724647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65tv6\" (UniqueName: \"kubernetes.io/projected/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-kube-api-access-65tv6\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724950 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.724967 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725198 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.725173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725307 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.725286 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.725522 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.725487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.727181 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.727157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.727376 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.727360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.733350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.733325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.733561 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.733544 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65tv6\" (UniqueName: \"kubernetes.io/projected/7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf-kube-api-access-65tv6\") pod \"maas-default-gateway-openshift-default-687ff6996-lgktm\" (UID: \"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.815312 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.815219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:53.963089 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.963058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm"] Jun 03 21:10:53.964525 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:10:53.964486 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3cf22d_12d2_4eb2_91cf_5e4bbe9d53cf.slice/crio-e46ca7cd3c78100404c9212b474f3cd6ad02403ff3e35b2c417ab41ec00ba63f WatchSource:0}: Error finding container e46ca7cd3c78100404c9212b474f3cd6ad02403ff3e35b2c417ab41ec00ba63f: Status 404 returned error can't find the container with id e46ca7cd3c78100404c9212b474f3cd6ad02403ff3e35b2c417ab41ec00ba63f Jun 03 21:10:53.966882 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.966845 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:10:53.966978 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.966937 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:10:53.967018 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:53.966978 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:10:54.291250 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:54.291214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" event={"ID":"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf","Type":"ContainerStarted","Data":"b003066b0ded491db3e6e2e7f3256e59e208c8694d8890881588229e78a65a27"} Jun 03 21:10:54.291437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:54.291268 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" event={"ID":"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf","Type":"ContainerStarted","Data":"e46ca7cd3c78100404c9212b474f3cd6ad02403ff3e35b2c417ab41ec00ba63f"} Jun 03 21:10:54.311226 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:54.311164 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" podStartSLOduration=1.311147714 podStartE2EDuration="1.311147714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:10:54.308637769 +0000 UTC m=+456.716401266" watchObservedRunningTime="2026-06-03 21:10:54.311147714 +0000 UTC m=+456.718911209" Jun 03 21:10:54.815922 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:54.815882 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:55.820339 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:55.820309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:56.303332 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:56.303299 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:10:56.304447 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:10:56.304429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:11:05.705662 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.705623 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-f8wnt"] Jun 03 21:11:05.709506 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.709484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:05.712001 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.711982 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ss47\"" Jun 03 21:11:05.715616 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.715564 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8wnt"] Jun 03 21:11:05.736539 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.736498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5clmq\" (UniqueName: \"kubernetes.io/projected/8d9864af-6226-497b-bcdd-b6b39bf1e00b-kube-api-access-5clmq\") pod \"authorino-58cd955675-f8wnt\" (UID: \"8d9864af-6226-497b-bcdd-b6b39bf1e00b\") " pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:05.837709 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.837665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clmq\" (UniqueName: \"kubernetes.io/projected/8d9864af-6226-497b-bcdd-b6b39bf1e00b-kube-api-access-5clmq\") pod \"authorino-58cd955675-f8wnt\" (UID: \"8d9864af-6226-497b-bcdd-b6b39bf1e00b\") " pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:05.846081 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.846056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5clmq\" (UniqueName: \"kubernetes.io/projected/8d9864af-6226-497b-bcdd-b6b39bf1e00b-kube-api-access-5clmq\") pod \"authorino-58cd955675-f8wnt\" (UID: \"8d9864af-6226-497b-bcdd-b6b39bf1e00b\") " pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:05.954436 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.954396 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jldwn"] Jun 03 21:11:05.958018 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.957973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:11:05.966128 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:05.966100 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jldwn"] Jun 03 21:11:06.020954 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.020907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:06.040011 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.039986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dm67\" (UniqueName: \"kubernetes.io/projected/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2-kube-api-access-9dm67\") pod \"authorino-75d556bd77-jldwn\" (UID: \"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2\") " pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:11:06.140905 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.140861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dm67\" (UniqueName: \"kubernetes.io/projected/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2-kube-api-access-9dm67\") pod \"authorino-75d556bd77-jldwn\" (UID: \"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2\") " pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:11:06.148705 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.148678 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dm67\" (UniqueName: \"kubernetes.io/projected/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2-kube-api-access-9dm67\") pod \"authorino-75d556bd77-jldwn\" (UID: \"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2\") " pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:11:06.162347 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.162319 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8wnt"] Jun 03 21:11:06.163949 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:11:06.163920 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d9864af_6226_497b_bcdd_b6b39bf1e00b.slice/crio-be50f1247c39a64fcd133fd182452a6eb57337d670c66cd18a3e5b75c07bec04 WatchSource:0}: Error finding container be50f1247c39a64fcd133fd182452a6eb57337d670c66cd18a3e5b75c07bec04: Status 404 returned error can't find the container with id be50f1247c39a64fcd133fd182452a6eb57337d670c66cd18a3e5b75c07bec04 Jun 03 21:11:06.268662 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.268560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:11:06.360883 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.360849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8wnt" event={"ID":"8d9864af-6226-497b-bcdd-b6b39bf1e00b","Type":"ContainerStarted","Data":"be50f1247c39a64fcd133fd182452a6eb57337d670c66cd18a3e5b75c07bec04"} Jun 03 21:11:06.407534 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:06.407498 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jldwn"] Jun 03 21:11:06.409084 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:11:06.409057 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7bb4a28_a074_4e53_94cb_3b8fa5c3ccc2.slice/crio-5680c8ab32297dd74490b886349beba084fb86cd62a2a9bc0eb42b5eae1c37e5 WatchSource:0}: Error finding container 5680c8ab32297dd74490b886349beba084fb86cd62a2a9bc0eb42b5eae1c37e5: Status 404 returned error can't find the container with id 5680c8ab32297dd74490b886349beba084fb86cd62a2a9bc0eb42b5eae1c37e5 Jun 03 21:11:07.375756 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:07.375700 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jldwn" event={"ID":"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2","Type":"ContainerStarted","Data":"5680c8ab32297dd74490b886349beba084fb86cd62a2a9bc0eb42b5eae1c37e5"} Jun 03 21:11:10.396538 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:10.396498 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jldwn" event={"ID":"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2","Type":"ContainerStarted","Data":"4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada"} Jun 03 21:11:10.398037 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:10.398010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8wnt" event={"ID":"8d9864af-6226-497b-bcdd-b6b39bf1e00b","Type":"ContainerStarted","Data":"3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3"} Jun 03 21:11:10.413610 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:10.413563 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jldwn" podStartSLOduration=2.049477864 podStartE2EDuration="5.41354779s" totalImagesPullingTime="3.364069926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:11:10.412085287 +0000 UTC m=+472.819848760" watchObservedRunningTime="2026-06-03 21:11:10.41354779 +0000 UTC m=+472.821311284" Jun 03 21:11:10.428048 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:10.427971 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-f8wnt" podStartSLOduration=1.8312440639999998 podStartE2EDuration="5.427955596s" totalImagesPullingTime="3.596711532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:11:10.427207245 +0000 UTC m=+472.834970780" watchObservedRunningTime="2026-06-03 21:11:10.427955596 +0000 UTC m=+472.835719089" Jun 03 21:11:10.450875 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:10.450841 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8wnt"] Jun 03 21:11:12.409566 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:12.409523 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-f8wnt" podUID="8d9864af-6226-497b-bcdd-b6b39bf1e00b" containerName="authorino" containerID="cri-o://3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3" gracePeriod=30 Jun 03 21:11:12.659750 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:12.659674 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:12.701604 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:12.701562 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5clmq\" (UniqueName: \"kubernetes.io/projected/8d9864af-6226-497b-bcdd-b6b39bf1e00b-kube-api-access-5clmq\") pod \"8d9864af-6226-497b-bcdd-b6b39bf1e00b\" (UID: \"8d9864af-6226-497b-bcdd-b6b39bf1e00b\") " Jun 03 21:11:12.703722 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:12.703691 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d9864af-6226-497b-bcdd-b6b39bf1e00b-kube-api-access-5clmq" (OuterVolumeSpecName: "kube-api-access-5clmq") pod "8d9864af-6226-497b-bcdd-b6b39bf1e00b" (UID: "8d9864af-6226-497b-bcdd-b6b39bf1e00b"). InnerVolumeSpecName "kube-api-access-5clmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:11:12.802606 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:12.802558 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5clmq\" (UniqueName: \"kubernetes.io/projected/8d9864af-6226-497b-bcdd-b6b39bf1e00b-kube-api-access-5clmq\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:11:13.415974 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.415939 2579 generic.go:356] "Generic (PLEG): container finished" podID="8d9864af-6226-497b-bcdd-b6b39bf1e00b" containerID="3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3" exitCode=0 Jun 03 21:11:13.415974 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.415976 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8wnt" Jun 03 21:11:13.416493 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.416022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8wnt" event={"ID":"8d9864af-6226-497b-bcdd-b6b39bf1e00b","Type":"ContainerDied","Data":"3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3"} Jun 03 21:11:13.416493 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.416070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8wnt" event={"ID":"8d9864af-6226-497b-bcdd-b6b39bf1e00b","Type":"ContainerDied","Data":"be50f1247c39a64fcd133fd182452a6eb57337d670c66cd18a3e5b75c07bec04"} Jun 03 21:11:13.416493 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.416102 2579 scope.go:117] "RemoveContainer" containerID="3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3" Jun 03 21:11:13.428563 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.428544 2579 scope.go:117] "RemoveContainer" containerID="3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3" Jun 03 21:11:13.428902 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:11:13.428878 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3\": container with ID starting with 3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3 not found: ID does not exist" containerID="3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3" Jun 03 21:11:13.429006 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.428909 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3"} err="failed to get container status \"3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3\": rpc error: code = NotFound desc = could not find container \"3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3\": container with ID starting with 3f9667ff7684dfbd8772df5f9f7dbe4348f7a5a7045e873569e0a92030ffbcd3 not found: ID does not exist" Jun 03 21:11:13.438194 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.438172 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8wnt"] Jun 03 21:11:13.440454 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:13.440434 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8wnt"] Jun 03 21:11:14.039328 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:14.039291 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d9864af-6226-497b-bcdd-b6b39bf1e00b" path="/var/lib/kubelet/pods/8d9864af-6226-497b-bcdd-b6b39bf1e00b/volumes" Jun 03 21:11:33.818703 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.818666 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr"] Jun 03 21:11:33.819349 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.819070 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d9864af-6226-497b-bcdd-b6b39bf1e00b" containerName="authorino" Jun 03 21:11:33.819349 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.819081 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d9864af-6226-497b-bcdd-b6b39bf1e00b" containerName="authorino" Jun 03 21:11:33.819349 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.819157 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d9864af-6226-497b-bcdd-b6b39bf1e00b" containerName="authorino" Jun 03 21:11:33.821317 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.821301 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:33.824143 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.824120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 21:11:33.825250 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.825228 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 21:11:33.825350 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.825270 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ns9wx\"" Jun 03 21:11:33.830462 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.830437 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr"] Jun 03 21:11:33.901920 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.901880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvk2\" (UniqueName: \"kubernetes.io/projected/579f92f3-31b5-4eb3-8d27-da128814e9c5-kube-api-access-bdvk2\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:33.902122 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.901966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:33.902122 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:33.901996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.002894 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.002851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvk2\" (UniqueName: \"kubernetes.io/projected/579f92f3-31b5-4eb3-8d27-da128814e9c5-kube-api-access-bdvk2\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.003091 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.002923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.003091 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.002945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.003344 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.003326 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.003426 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.003363 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.011325 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.011303 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvk2\" (UniqueName: \"kubernetes.io/projected/579f92f3-31b5-4eb3-8d27-da128814e9c5-kube-api-access-bdvk2\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.132069 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.131972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:34.270297 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.270266 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr"] Jun 03 21:11:34.271247 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:11:34.271224 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579f92f3_31b5_4eb3_8d27_da128814e9c5.slice/crio-f85f637b27367d08f2c61a4240c88240b9a76303ab2624d59266979e2172688c WatchSource:0}: Error finding container f85f637b27367d08f2c61a4240c88240b9a76303ab2624d59266979e2172688c: Status 404 returned error can't find the container with id f85f637b27367d08f2c61a4240c88240b9a76303ab2624d59266979e2172688c Jun 03 21:11:34.546231 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.546194 2579 generic.go:356] "Generic (PLEG): container finished" podID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerID="18a0184bc96739ebc71982bd7b533deb2a47827b66a0b446489ec5197469b83d" exitCode=0 Jun 03 21:11:34.546401 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.546271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" event={"ID":"579f92f3-31b5-4eb3-8d27-da128814e9c5","Type":"ContainerDied","Data":"18a0184bc96739ebc71982bd7b533deb2a47827b66a0b446489ec5197469b83d"} Jun 03 21:11:34.546401 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:34.546313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" event={"ID":"579f92f3-31b5-4eb3-8d27-da128814e9c5","Type":"ContainerStarted","Data":"f85f637b27367d08f2c61a4240c88240b9a76303ab2624d59266979e2172688c"} Jun 03 21:11:35.553494 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:35.553457 2579 generic.go:356] "Generic (PLEG): container finished" podID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerID="99ad7a0839cb45f94fff8578ca37c33ad67d4d63fe156f67ea192e29a2dd657e" exitCode=0 Jun 03 21:11:35.553960 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:35.553512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" event={"ID":"579f92f3-31b5-4eb3-8d27-da128814e9c5","Type":"ContainerDied","Data":"99ad7a0839cb45f94fff8578ca37c33ad67d4d63fe156f67ea192e29a2dd657e"} Jun 03 21:11:36.561129 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:36.561093 2579 generic.go:356] "Generic (PLEG): container finished" podID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerID="c8b2af58955d6fb5c9b968ea97c87bad0cb0810a3271f4edff9b5948d33ebf30" exitCode=0 Jun 03 21:11:36.561499 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:36.561175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" event={"ID":"579f92f3-31b5-4eb3-8d27-da128814e9c5","Type":"ContainerDied","Data":"c8b2af58955d6fb5c9b968ea97c87bad0cb0810a3271f4edff9b5948d33ebf30"} Jun 03 21:11:37.700725 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.700701 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:37.840045 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.839954 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-bundle\") pod \"579f92f3-31b5-4eb3-8d27-da128814e9c5\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " Jun 03 21:11:37.840045 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.840002 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-util\") pod \"579f92f3-31b5-4eb3-8d27-da128814e9c5\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " Jun 03 21:11:37.840291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.840140 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdvk2\" (UniqueName: \"kubernetes.io/projected/579f92f3-31b5-4eb3-8d27-da128814e9c5-kube-api-access-bdvk2\") pod \"579f92f3-31b5-4eb3-8d27-da128814e9c5\" (UID: \"579f92f3-31b5-4eb3-8d27-da128814e9c5\") " Jun 03 21:11:37.840525 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.840502 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-bundle" (OuterVolumeSpecName: "bundle") pod "579f92f3-31b5-4eb3-8d27-da128814e9c5" (UID: "579f92f3-31b5-4eb3-8d27-da128814e9c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:11:37.842382 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.842353 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579f92f3-31b5-4eb3-8d27-da128814e9c5-kube-api-access-bdvk2" (OuterVolumeSpecName: "kube-api-access-bdvk2") pod "579f92f3-31b5-4eb3-8d27-da128814e9c5" (UID: "579f92f3-31b5-4eb3-8d27-da128814e9c5"). InnerVolumeSpecName "kube-api-access-bdvk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:11:37.848212 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.848180 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-util" (OuterVolumeSpecName: "util") pod "579f92f3-31b5-4eb3-8d27-da128814e9c5" (UID: "579f92f3-31b5-4eb3-8d27-da128814e9c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:11:37.941195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.941152 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-bundle\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:11:37.941195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.941179 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/579f92f3-31b5-4eb3-8d27-da128814e9c5-util\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:11:37.941195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:37.941189 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdvk2\" (UniqueName: \"kubernetes.io/projected/579f92f3-31b5-4eb3-8d27-da128814e9c5-kube-api-access-bdvk2\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:11:38.573537 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:38.573507 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" Jun 03 21:11:38.573537 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:38.573516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70dxkmr" event={"ID":"579f92f3-31b5-4eb3-8d27-da128814e9c5","Type":"ContainerDied","Data":"f85f637b27367d08f2c61a4240c88240b9a76303ab2624d59266979e2172688c"} Jun 03 21:11:38.573784 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:38.573566 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f85f637b27367d08f2c61a4240c88240b9a76303ab2624d59266979e2172688c" Jun 03 21:11:56.569101 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569061 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569446 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="pull" Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569458 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="pull" Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569477 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="extract" Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569482 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="extract" Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569491 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="util" Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569496 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="util" Jun 03 21:11:56.569592 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.569554 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="579f92f3-31b5-4eb3-8d27-da128814e9c5" containerName="extract" Jun 03 21:11:56.573000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.572982 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:11:56.575527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.575500 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 21:11:56.575527 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.575516 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 21:11:56.575690 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.575533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 21:11:56.576467 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.576453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-g5qvl\"" Jun 03 21:11:56.581815 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.581792 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:11:56.605729 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.605697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbd45\" (UniqueName: \"kubernetes.io/projected/6dc0aa44-c059-40a6-918b-1a39536e23fb-kube-api-access-bbd45\") pod \"maas-keycloak-0\" (UID: \"6dc0aa44-c059-40a6-918b-1a39536e23fb\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:11:56.706687 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.706644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbd45\" (UniqueName: \"kubernetes.io/projected/6dc0aa44-c059-40a6-918b-1a39536e23fb-kube-api-access-bbd45\") pod \"maas-keycloak-0\" (UID: \"6dc0aa44-c059-40a6-918b-1a39536e23fb\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:11:56.714792 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.714755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbd45\" (UniqueName: \"kubernetes.io/projected/6dc0aa44-c059-40a6-918b-1a39536e23fb-kube-api-access-bbd45\") pod \"maas-keycloak-0\" (UID: \"6dc0aa44-c059-40a6-918b-1a39536e23fb\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:11:56.884338 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:56.884228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:11:57.044382 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:57.044351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:11:57.046024 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:11:57.045984 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc0aa44_c059_40a6_918b_1a39536e23fb.slice/crio-2d94beffd6e6eeec24367c2ecba0eedcabbbbde24c4d9ca06057aa0f24b829bc WatchSource:0}: Error finding container 2d94beffd6e6eeec24367c2ecba0eedcabbbbde24c4d9ca06057aa0f24b829bc: Status 404 returned error can't find the container with id 2d94beffd6e6eeec24367c2ecba0eedcabbbbde24c4d9ca06057aa0f24b829bc Jun 03 21:11:57.681910 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:11:57.681836 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6dc0aa44-c059-40a6-918b-1a39536e23fb","Type":"ContainerStarted","Data":"2d94beffd6e6eeec24367c2ecba0eedcabbbbde24c4d9ca06057aa0f24b829bc"} Jun 03 21:12:01.712615 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:01.712571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6dc0aa44-c059-40a6-918b-1a39536e23fb","Type":"ContainerStarted","Data":"f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36"} Jun 03 21:12:01.731583 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:01.731522 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.272071068 podStartE2EDuration="5.731503627s" totalImagesPullingTime="4.459432559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:01.728943376 +0000 UTC m=+524.136706871" watchObservedRunningTime="2026-06-03 21:12:01.731503627 +0000 UTC m=+524.139267127" Jun 03 21:12:01.884921 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:01.884813 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 21:12:01.886408 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:01.886368 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:02.884785 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:02.884705 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:03.885267 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:03.885209 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:04.885637 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:04.885581 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:05.885583 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:05.885158 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:06.884917 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:06.884874 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:12:06.885515 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:06.885355 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:07.885108 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:07.885058 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:08.885549 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:08.885132 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:09.884892 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:09.884844 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:10.884614 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:10.884568 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:11.884819 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:11.884774 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:12.885467 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:12.885415 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:13.885326 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:13.885270 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 21:12:14.979624 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:14.979584 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 21:12:15.000480 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:15.000430 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 21:12:24.993179 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:24.993141 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:12:25.905453 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:25.905420 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wl4wc"] Jun 03 21:12:25.976825 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:25.976785 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wl4wc"] Jun 03 21:12:25.976996 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:25.976908 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:26.010175 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.010140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkbb\" (UniqueName: \"kubernetes.io/projected/ffa8cc03-1774-44c6-862e-800de88cec61-kube-api-access-czkbb\") pod \"authorino-5d4b67c446-wl4wc\" (UID: \"ffa8cc03-1774-44c6-862e-800de88cec61\") " pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:26.111447 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.111411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czkbb\" (UniqueName: \"kubernetes.io/projected/ffa8cc03-1774-44c6-862e-800de88cec61-kube-api-access-czkbb\") pod \"authorino-5d4b67c446-wl4wc\" (UID: \"ffa8cc03-1774-44c6-862e-800de88cec61\") " pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:26.119285 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.119258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkbb\" (UniqueName: \"kubernetes.io/projected/ffa8cc03-1774-44c6-862e-800de88cec61-kube-api-access-czkbb\") pod \"authorino-5d4b67c446-wl4wc\" (UID: \"ffa8cc03-1774-44c6-862e-800de88cec61\") " pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:26.157500 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.157418 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wl4wc"] Jun 03 21:12:26.157710 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.157696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:26.185660 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.185630 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-db7b7f7bd-92kxp"] Jun 03 21:12:26.204754 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.204677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-db7b7f7bd-92kxp"] Jun 03 21:12:26.204921 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.204829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:26.212150 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.212120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rcd\" (UniqueName: \"kubernetes.io/projected/f29d9339-0c3f-43fe-9fd3-a433f173ffa9-kube-api-access-d6rcd\") pod \"authorino-db7b7f7bd-92kxp\" (UID: \"f29d9339-0c3f-43fe-9fd3-a433f173ffa9\") " pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:26.313285 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.313256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rcd\" (UniqueName: \"kubernetes.io/projected/f29d9339-0c3f-43fe-9fd3-a433f173ffa9-kube-api-access-d6rcd\") pod \"authorino-db7b7f7bd-92kxp\" (UID: \"f29d9339-0c3f-43fe-9fd3-a433f173ffa9\") " pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:26.322697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.322671 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wl4wc"] Jun 03 21:12:26.323836 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.323812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rcd\" (UniqueName: \"kubernetes.io/projected/f29d9339-0c3f-43fe-9fd3-a433f173ffa9-kube-api-access-d6rcd\") pod \"authorino-db7b7f7bd-92kxp\" (UID: \"f29d9339-0c3f-43fe-9fd3-a433f173ffa9\") " pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:26.324387 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:12:26.324365 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa8cc03_1774_44c6_862e_800de88cec61.slice/crio-e44d7c7aa3625f28b175e8fe1f57e249aebcc6cf0e120d602939c76c701cb25f WatchSource:0}: Error finding container e44d7c7aa3625f28b175e8fe1f57e249aebcc6cf0e120d602939c76c701cb25f: Status 404 returned error can't find the container with id e44d7c7aa3625f28b175e8fe1f57e249aebcc6cf0e120d602939c76c701cb25f Jun 03 21:12:26.448644 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.448605 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db7b7f7bd-92kxp"] Jun 03 21:12:26.448925 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.448909 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:26.472217 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.472184 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c4b6b9b4-8b86z"] Jun 03 21:12:26.486364 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.486333 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c4b6b9b4-8b86z"] Jun 03 21:12:26.486545 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.486447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.489017 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.488920 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 21:12:26.514279 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.514237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-tls-cert\") pod \"authorino-56c4b6b9b4-8b86z\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.514464 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.514286 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbm8f\" (UniqueName: \"kubernetes.io/projected/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-kube-api-access-qbm8f\") pod \"authorino-56c4b6b9b4-8b86z\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.603053 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.603024 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db7b7f7bd-92kxp"] Jun 03 21:12:26.604398 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:12:26.604366 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf29d9339_0c3f_43fe_9fd3_a433f173ffa9.slice/crio-ef7fabed62e984ad07481dc9259c26decb55922e3bc6079752b62ca81a513ad3 WatchSource:0}: Error finding container ef7fabed62e984ad07481dc9259c26decb55922e3bc6079752b62ca81a513ad3: Status 404 returned error can't find the container with id ef7fabed62e984ad07481dc9259c26decb55922e3bc6079752b62ca81a513ad3 Jun 03 21:12:26.615619 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.615591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-tls-cert\") pod \"authorino-56c4b6b9b4-8b86z\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.615731 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.615632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbm8f\" (UniqueName: \"kubernetes.io/projected/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-kube-api-access-qbm8f\") pod \"authorino-56c4b6b9b4-8b86z\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.618189 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.618164 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-tls-cert\") pod \"authorino-56c4b6b9b4-8b86z\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.623136 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.623111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbm8f\" (UniqueName: \"kubernetes.io/projected/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-kube-api-access-qbm8f\") pod \"authorino-56c4b6b9b4-8b86z\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.798959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.798868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:12:26.892066 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.892031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" event={"ID":"f29d9339-0c3f-43fe-9fd3-a433f173ffa9","Type":"ContainerStarted","Data":"ef7fabed62e984ad07481dc9259c26decb55922e3bc6079752b62ca81a513ad3"} Jun 03 21:12:26.893308 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:26.893278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" event={"ID":"ffa8cc03-1774-44c6-862e-800de88cec61","Type":"ContainerStarted","Data":"e44d7c7aa3625f28b175e8fe1f57e249aebcc6cf0e120d602939c76c701cb25f"} Jun 03 21:12:27.005257 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.005227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c4b6b9b4-8b86z"] Jun 03 21:12:27.007103 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:12:27.007061 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49d1dfe0_7fc6_4b0a_9479_1bbf435cdf9f.slice/crio-9db91e445daeb3f34e685077df537650c553285627b1237a4abc1293244fa41e WatchSource:0}: Error finding container 9db91e445daeb3f34e685077df537650c553285627b1237a4abc1293244fa41e: Status 404 returned error can't find the container with id 9db91e445daeb3f34e685077df537650c553285627b1237a4abc1293244fa41e Jun 03 21:12:27.900616 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.900504 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" event={"ID":"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f","Type":"ContainerStarted","Data":"3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247"} Jun 03 21:12:27.900616 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.900554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" event={"ID":"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f","Type":"ContainerStarted","Data":"9db91e445daeb3f34e685077df537650c553285627b1237a4abc1293244fa41e"} Jun 03 21:12:27.902093 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.902068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" event={"ID":"f29d9339-0c3f-43fe-9fd3-a433f173ffa9","Type":"ContainerStarted","Data":"5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd"} Jun 03 21:12:27.902199 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.902116 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" podUID="f29d9339-0c3f-43fe-9fd3-a433f173ffa9" containerName="authorino" containerID="cri-o://5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd" gracePeriod=30 Jun 03 21:12:27.903777 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.903750 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" event={"ID":"ffa8cc03-1774-44c6-862e-800de88cec61","Type":"ContainerStarted","Data":"4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08"} Jun 03 21:12:27.903777 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.903763 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" podUID="ffa8cc03-1774-44c6-862e-800de88cec61" containerName="authorino" containerID="cri-o://4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08" gracePeriod=30 Jun 03 21:12:27.916190 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.916147 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" podStartSLOduration=1.341692985 podStartE2EDuration="1.916131652s" totalImagesPullingTime="574.438667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:27.915065666 +0000 UTC m=+550.322829154" watchObservedRunningTime="2026-06-03 21:12:27.916131652 +0000 UTC m=+550.323895146" Jun 03 21:12:27.929650 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.929600 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" podStartSLOduration=2.384680091 podStartE2EDuration="2.929583204s" totalImagesPullingTime="544.903113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:27.928022697 +0000 UTC m=+550.335786193" watchObservedRunningTime="2026-06-03 21:12:27.929583204 +0000 UTC m=+550.337346700" Jun 03 21:12:27.942829 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.942791 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jldwn"] Jun 03 21:12:27.943058 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.943031 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jldwn" podUID="f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" containerName="authorino" containerID="cri-o://4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada" gracePeriod=30 Jun 03 21:12:27.954552 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:27.954491 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" podStartSLOduration=1.404070576 podStartE2EDuration="1.954467981s" totalImagesPullingTime="550.397405ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:27.946223146 +0000 UTC m=+550.353986643" watchObservedRunningTime="2026-06-03 21:12:27.954467981 +0000 UTC m=+550.362231471" Jun 03 21:12:28.222721 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.222684 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:28.233838 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.233812 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czkbb\" (UniqueName: \"kubernetes.io/projected/ffa8cc03-1774-44c6-862e-800de88cec61-kube-api-access-czkbb\") pod \"ffa8cc03-1774-44c6-862e-800de88cec61\" (UID: \"ffa8cc03-1774-44c6-862e-800de88cec61\") " Jun 03 21:12:28.236082 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.236047 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa8cc03-1774-44c6-862e-800de88cec61-kube-api-access-czkbb" (OuterVolumeSpecName: "kube-api-access-czkbb") pod "ffa8cc03-1774-44c6-862e-800de88cec61" (UID: "ffa8cc03-1774-44c6-862e-800de88cec61"). InnerVolumeSpecName "kube-api-access-czkbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:12:28.261050 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.261026 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:28.264213 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.264194 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:12:28.334958 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.334922 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6rcd\" (UniqueName: \"kubernetes.io/projected/f29d9339-0c3f-43fe-9fd3-a433f173ffa9-kube-api-access-d6rcd\") pod \"f29d9339-0c3f-43fe-9fd3-a433f173ffa9\" (UID: \"f29d9339-0c3f-43fe-9fd3-a433f173ffa9\") " Jun 03 21:12:28.335144 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.334992 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dm67\" (UniqueName: \"kubernetes.io/projected/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2-kube-api-access-9dm67\") pod \"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2\" (UID: \"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2\") " Jun 03 21:12:28.335231 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.335168 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czkbb\" (UniqueName: \"kubernetes.io/projected/ffa8cc03-1774-44c6-862e-800de88cec61-kube-api-access-czkbb\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:12:28.337210 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.337183 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2-kube-api-access-9dm67" (OuterVolumeSpecName: "kube-api-access-9dm67") pod "f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" (UID: "f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2"). InnerVolumeSpecName "kube-api-access-9dm67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:12:28.337210 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.337192 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f29d9339-0c3f-43fe-9fd3-a433f173ffa9-kube-api-access-d6rcd" (OuterVolumeSpecName: "kube-api-access-d6rcd") pod "f29d9339-0c3f-43fe-9fd3-a433f173ffa9" (UID: "f29d9339-0c3f-43fe-9fd3-a433f173ffa9"). InnerVolumeSpecName "kube-api-access-d6rcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:12:28.436017 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.435979 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6rcd\" (UniqueName: \"kubernetes.io/projected/f29d9339-0c3f-43fe-9fd3-a433f173ffa9-kube-api-access-d6rcd\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:12:28.436017 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.436010 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dm67\" (UniqueName: \"kubernetes.io/projected/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2-kube-api-access-9dm67\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:12:28.910458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.910371 2579 generic.go:356] "Generic (PLEG): container finished" podID="f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" containerID="4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada" exitCode=0 Jun 03 21:12:28.910458 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.910413 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jldwn" Jun 03 21:12:28.910981 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.910463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jldwn" event={"ID":"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2","Type":"ContainerDied","Data":"4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada"} Jun 03 21:12:28.910981 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.910511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jldwn" event={"ID":"f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2","Type":"ContainerDied","Data":"5680c8ab32297dd74490b886349beba084fb86cd62a2a9bc0eb42b5eae1c37e5"} Jun 03 21:12:28.910981 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.910535 2579 scope.go:117] "RemoveContainer" containerID="4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada" Jun 03 21:12:28.911963 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.911941 2579 generic.go:356] "Generic (PLEG): container finished" podID="f29d9339-0c3f-43fe-9fd3-a433f173ffa9" containerID="5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd" exitCode=0 Jun 03 21:12:28.912063 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.911984 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" Jun 03 21:12:28.912063 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.911994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" event={"ID":"f29d9339-0c3f-43fe-9fd3-a433f173ffa9","Type":"ContainerDied","Data":"5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd"} Jun 03 21:12:28.912063 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.912031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db7b7f7bd-92kxp" event={"ID":"f29d9339-0c3f-43fe-9fd3-a433f173ffa9","Type":"ContainerDied","Data":"ef7fabed62e984ad07481dc9259c26decb55922e3bc6079752b62ca81a513ad3"} Jun 03 21:12:28.913508 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.913485 2579 generic.go:356] "Generic (PLEG): container finished" podID="ffa8cc03-1774-44c6-862e-800de88cec61" containerID="4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08" exitCode=0 Jun 03 21:12:28.913680 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.913520 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" Jun 03 21:12:28.913680 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.913546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" event={"ID":"ffa8cc03-1774-44c6-862e-800de88cec61","Type":"ContainerDied","Data":"4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08"} Jun 03 21:12:28.913680 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.913571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wl4wc" event={"ID":"ffa8cc03-1774-44c6-862e-800de88cec61","Type":"ContainerDied","Data":"e44d7c7aa3625f28b175e8fe1f57e249aebcc6cf0e120d602939c76c701cb25f"} Jun 03 21:12:28.921781 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.921731 2579 scope.go:117] "RemoveContainer" containerID="4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada" Jun 03 21:12:28.922057 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:12:28.922040 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada\": container with ID starting with 4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada not found: ID does not exist" containerID="4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada" Jun 03 21:12:28.922116 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.922063 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada"} err="failed to get container status \"4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada\": rpc error: code = NotFound desc = could not find container \"4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada\": container with ID starting with 4efba726854a48e1c3ce23ac979dce382d1a079f1d4d428cf35fb225e4e00ada not found: ID does not exist" Jun 03 21:12:28.922116 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.922078 2579 scope.go:117] "RemoveContainer" containerID="5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd" Jun 03 21:12:28.930400 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.930384 2579 scope.go:117] "RemoveContainer" containerID="5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd" Jun 03 21:12:28.930651 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:12:28.930632 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd\": container with ID starting with 5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd not found: ID does not exist" containerID="5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd" Jun 03 21:12:28.930710 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.930659 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd"} err="failed to get container status \"5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd\": rpc error: code = NotFound desc = could not find container \"5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd\": container with ID starting with 5aa612654f3cc2b650b60ccd1c12b2139995efae8186115af33b5afbe20c35cd not found: ID does not exist" Jun 03 21:12:28.930710 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.930675 2579 scope.go:117] "RemoveContainer" containerID="4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08" Jun 03 21:12:28.934291 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.934271 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jldwn"] Jun 03 21:12:28.939160 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.939137 2579 scope.go:117] "RemoveContainer" containerID="4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08" Jun 03 21:12:28.939461 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:12:28.939440 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08\": container with ID starting with 4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08 not found: ID does not exist" containerID="4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08" Jun 03 21:12:28.939523 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.939469 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08"} err="failed to get container status \"4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08\": rpc error: code = NotFound desc = could not find container \"4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08\": container with ID starting with 4ba837c8aeee64c64de144e656fe4f47a9122aeeb8336c36f7410efdebba1f08 not found: ID does not exist" Jun 03 21:12:28.940156 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.940136 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jldwn"] Jun 03 21:12:28.950572 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.950501 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db7b7f7bd-92kxp"] Jun 03 21:12:28.954241 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.954217 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-db7b7f7bd-92kxp"] Jun 03 21:12:28.964159 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.964133 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wl4wc"] Jun 03 21:12:28.966405 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:28.966387 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wl4wc"] Jun 03 21:12:30.040314 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:30.040274 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f29d9339-0c3f-43fe-9fd3-a433f173ffa9" path="/var/lib/kubelet/pods/f29d9339-0c3f-43fe-9fd3-a433f173ffa9/volumes" Jun 03 21:12:30.040807 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:30.040782 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" path="/var/lib/kubelet/pods/f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2/volumes" Jun 03 21:12:30.041144 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:30.041123 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa8cc03-1774-44c6-862e-800de88cec61" path="/var/lib/kubelet/pods/ffa8cc03-1774-44c6-862e-800de88cec61/volumes" Jun 03 21:12:31.111954 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.111913 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dc66d7b5c-vpc74"] Jun 03 21:12:31.112363 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112349 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" containerName="authorino" Jun 03 21:12:31.112363 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112361 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" containerName="authorino" Jun 03 21:12:31.112452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112377 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f29d9339-0c3f-43fe-9fd3-a433f173ffa9" containerName="authorino" Jun 03 21:12:31.112452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112382 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f29d9339-0c3f-43fe-9fd3-a433f173ffa9" containerName="authorino" Jun 03 21:12:31.112452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112398 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa8cc03-1774-44c6-862e-800de88cec61" containerName="authorino" Jun 03 21:12:31.112452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112403 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa8cc03-1774-44c6-862e-800de88cec61" containerName="authorino" Jun 03 21:12:31.112586 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112461 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f29d9339-0c3f-43fe-9fd3-a433f173ffa9" containerName="authorino" Jun 03 21:12:31.112586 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112470 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7bb4a28-a074-4e53-94cb-3b8fa5c3ccc2" containerName="authorino" Jun 03 21:12:31.112586 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.112477 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa8cc03-1774-44c6-862e-800de88cec61" containerName="authorino" Jun 03 21:12:31.115388 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.115371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:31.117915 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.117887 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4xpfx\"" Jun 03 21:12:31.118029 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.117887 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 21:12:31.125786 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.125759 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc66d7b5c-vpc74"] Jun 03 21:12:31.158823 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.158784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r4rn\" (UniqueName: \"kubernetes.io/projected/83ca10b3-bbaf-45e2-8704-7d0abe937d58-kube-api-access-9r4rn\") pod \"maas-controller-7dc66d7b5c-vpc74\" (UID: \"83ca10b3-bbaf-45e2-8704-7d0abe937d58\") " pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:31.260067 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.260021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r4rn\" (UniqueName: \"kubernetes.io/projected/83ca10b3-bbaf-45e2-8704-7d0abe937d58-kube-api-access-9r4rn\") pod \"maas-controller-7dc66d7b5c-vpc74\" (UID: \"83ca10b3-bbaf-45e2-8704-7d0abe937d58\") " pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:31.273150 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.273118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r4rn\" (UniqueName: \"kubernetes.io/projected/83ca10b3-bbaf-45e2-8704-7d0abe937d58-kube-api-access-9r4rn\") pod \"maas-controller-7dc66d7b5c-vpc74\" (UID: \"83ca10b3-bbaf-45e2-8704-7d0abe937d58\") " pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:31.427049 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.426955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:31.564659 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.564630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc66d7b5c-vpc74"] Jun 03 21:12:31.564998 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:12:31.564971 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ca10b3_bbaf_45e2_8704_7d0abe937d58.slice/crio-fbc191db706219702ef96624e41de525f718c0350210d80aba9877197413314b WatchSource:0}: Error finding container fbc191db706219702ef96624e41de525f718c0350210d80aba9877197413314b: Status 404 returned error can't find the container with id fbc191db706219702ef96624e41de525f718c0350210d80aba9877197413314b Jun 03 21:12:31.934334 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:31.934297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" event={"ID":"83ca10b3-bbaf-45e2-8704-7d0abe937d58","Type":"ContainerStarted","Data":"fbc191db706219702ef96624e41de525f718c0350210d80aba9877197413314b"} Jun 03 21:12:34.958950 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:34.958900 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" event={"ID":"83ca10b3-bbaf-45e2-8704-7d0abe937d58","Type":"ContainerStarted","Data":"b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8"} Jun 03 21:12:34.959374 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:34.958970 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:34.975912 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:34.975853 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" podStartSLOduration=1.389032557 podStartE2EDuration="3.975837702s" totalImagesPullingTime="2.586805145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:34.9736952 +0000 UTC m=+557.381458696" watchObservedRunningTime="2026-06-03 21:12:34.975837702 +0000 UTC m=+557.383601197" Jun 03 21:12:45.725337 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:45.725297 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc66d7b5c-vpc74"] Jun 03 21:12:45.725810 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:45.725510 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" podUID="83ca10b3-bbaf-45e2-8704-7d0abe937d58" containerName="manager" containerID="cri-o://b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8" gracePeriod=30 Jun 03 21:12:45.730263 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:45.730240 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:45.976822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:45.976757 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:46.023590 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.023555 2579 generic.go:356] "Generic (PLEG): container finished" podID="83ca10b3-bbaf-45e2-8704-7d0abe937d58" containerID="b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8" exitCode=0 Jun 03 21:12:46.023797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.023601 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" Jun 03 21:12:46.023797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.023641 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" event={"ID":"83ca10b3-bbaf-45e2-8704-7d0abe937d58","Type":"ContainerDied","Data":"b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8"} Jun 03 21:12:46.023797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.023698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc66d7b5c-vpc74" event={"ID":"83ca10b3-bbaf-45e2-8704-7d0abe937d58","Type":"ContainerDied","Data":"fbc191db706219702ef96624e41de525f718c0350210d80aba9877197413314b"} Jun 03 21:12:46.023797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.023724 2579 scope.go:117] "RemoveContainer" containerID="b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8" Jun 03 21:12:46.032814 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.032796 2579 scope.go:117] "RemoveContainer" containerID="b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8" Jun 03 21:12:46.033095 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:12:46.033072 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8\": container with ID starting with b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8 not found: ID does not exist" containerID="b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8" Jun 03 21:12:46.033141 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.033113 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8"} err="failed to get container status \"b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8\": rpc error: code = NotFound desc = could not find container \"b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8\": container with ID starting with b4198401395db4cbd0e2d461a20701184593a47c833dcc00d4d3d79c220717a8 not found: ID does not exist" Jun 03 21:12:46.096735 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.096701 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r4rn\" (UniqueName: \"kubernetes.io/projected/83ca10b3-bbaf-45e2-8704-7d0abe937d58-kube-api-access-9r4rn\") pod \"83ca10b3-bbaf-45e2-8704-7d0abe937d58\" (UID: \"83ca10b3-bbaf-45e2-8704-7d0abe937d58\") " Jun 03 21:12:46.099074 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.099050 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ca10b3-bbaf-45e2-8704-7d0abe937d58-kube-api-access-9r4rn" (OuterVolumeSpecName: "kube-api-access-9r4rn") pod "83ca10b3-bbaf-45e2-8704-7d0abe937d58" (UID: "83ca10b3-bbaf-45e2-8704-7d0abe937d58"). InnerVolumeSpecName "kube-api-access-9r4rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:12:46.198034 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.197991 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r4rn\" (UniqueName: \"kubernetes.io/projected/83ca10b3-bbaf-45e2-8704-7d0abe937d58-kube-api-access-9r4rn\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:12:46.345908 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.345875 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc66d7b5c-vpc74"] Jun 03 21:12:46.348162 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:46.348142 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dc66d7b5c-vpc74"] Jun 03 21:12:48.040126 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:12:48.040096 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ca10b3-bbaf-45e2-8704-7d0abe937d58" path="/var/lib/kubelet/pods/83ca10b3-bbaf-45e2-8704-7d0abe937d58/volumes" Jun 03 21:13:08.226317 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.226283 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5f75d9d46c-kdfsw"] Jun 03 21:13:08.226801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.226646 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ca10b3-bbaf-45e2-8704-7d0abe937d58" containerName="manager" Jun 03 21:13:08.226801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.226657 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ca10b3-bbaf-45e2-8704-7d0abe937d58" containerName="manager" Jun 03 21:13:08.226801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.226731 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ca10b3-bbaf-45e2-8704-7d0abe937d58" containerName="manager" Jun 03 21:13:08.231214 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.231193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.234200 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.234176 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 21:13:08.242308 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.242277 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f75d9d46c-kdfsw"] Jun 03 21:13:08.301243 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.301194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v48lz\" (UniqueName: \"kubernetes.io/projected/5be38bbd-7135-4af8-8c7f-79221dec326a-kube-api-access-v48lz\") pod \"maas-api-5f75d9d46c-kdfsw\" (UID: \"5be38bbd-7135-4af8-8c7f-79221dec326a\") " pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.301427 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.301336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be38bbd-7135-4af8-8c7f-79221dec326a-maas-api-tls\") pod \"maas-api-5f75d9d46c-kdfsw\" (UID: \"5be38bbd-7135-4af8-8c7f-79221dec326a\") " pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.401800 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.401732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be38bbd-7135-4af8-8c7f-79221dec326a-maas-api-tls\") pod \"maas-api-5f75d9d46c-kdfsw\" (UID: \"5be38bbd-7135-4af8-8c7f-79221dec326a\") " pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.402004 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.401826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v48lz\" (UniqueName: \"kubernetes.io/projected/5be38bbd-7135-4af8-8c7f-79221dec326a-kube-api-access-v48lz\") pod \"maas-api-5f75d9d46c-kdfsw\" (UID: \"5be38bbd-7135-4af8-8c7f-79221dec326a\") " pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.404622 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.404596 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be38bbd-7135-4af8-8c7f-79221dec326a-maas-api-tls\") pod \"maas-api-5f75d9d46c-kdfsw\" (UID: \"5be38bbd-7135-4af8-8c7f-79221dec326a\") " pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.410200 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.410171 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v48lz\" (UniqueName: \"kubernetes.io/projected/5be38bbd-7135-4af8-8c7f-79221dec326a-kube-api-access-v48lz\") pod \"maas-api-5f75d9d46c-kdfsw\" (UID: \"5be38bbd-7135-4af8-8c7f-79221dec326a\") " pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.546089 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.545982 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:08.695481 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:08.695442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f75d9d46c-kdfsw"] Jun 03 21:13:08.696842 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:13:08.696816 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be38bbd_7135_4af8_8c7f_79221dec326a.slice/crio-402ed29c97cdd6b124717dde86596844978ece03ef43bdfeb96698d70c58c53c WatchSource:0}: Error finding container 402ed29c97cdd6b124717dde86596844978ece03ef43bdfeb96698d70c58c53c: Status 404 returned error can't find the container with id 402ed29c97cdd6b124717dde86596844978ece03ef43bdfeb96698d70c58c53c Jun 03 21:13:09.165970 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:09.165927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" event={"ID":"5be38bbd-7135-4af8-8c7f-79221dec326a","Type":"ContainerStarted","Data":"402ed29c97cdd6b124717dde86596844978ece03ef43bdfeb96698d70c58c53c"} Jun 03 21:13:12.211978 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:12.211943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" event={"ID":"5be38bbd-7135-4af8-8c7f-79221dec326a","Type":"ContainerStarted","Data":"9933b66aea05a3536175a876c91701681ba943e61bcec8839beb332ec47327ac"} Jun 03 21:13:12.212428 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:12.212007 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:17.245445 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.245411 2579 generic.go:356] "Generic (PLEG): container finished" podID="7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf" containerID="b003066b0ded491db3e6e2e7f3256e59e208c8694d8890881588229e78a65a27" exitCode=0 Jun 03 21:13:17.245893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.245459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" event={"ID":"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf","Type":"ContainerDied","Data":"b003066b0ded491db3e6e2e7f3256e59e208c8694d8890881588229e78a65a27"} Jun 03 21:13:17.245893 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.245888 2579 scope.go:117] "RemoveContainer" containerID="b003066b0ded491db3e6e2e7f3256e59e208c8694d8890881588229e78a65a27" Jun 03 21:13:17.246915 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.246882 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:13:17.246994 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.246976 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:13:17.247080 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.247027 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 21:13:17.266178 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:17.266123 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" podStartSLOduration=6.559998152 podStartE2EDuration="9.266101334s" totalImagesPullingTime="2.706103182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:13:12.227510014 +0000 UTC m=+594.635273562" watchObservedRunningTime="2026-06-03 21:13:17.266101334 +0000 UTC m=+599.673864831" Jun 03 21:13:18.086077 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.086049 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:13:18.089185 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.089169 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:13:18.228584 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.228544 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5f75d9d46c-kdfsw" Jun 03 21:13:18.254764 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.254716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" event={"ID":"7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf","Type":"ContainerStarted","Data":"4f96c2cc2858825654c2c27dc7e0bad33520fb6afe04bab8c964b779bd07c7e3"} Jun 03 21:13:18.815725 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.815682 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:13:18.816010 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.815985 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lgktm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:13:18.816113 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:18.816068 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" podUID="7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 03 21:13:19.815761 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:19.815694 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lgktm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:13:19.816223 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:19.815969 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" podUID="7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 03 21:13:20.161927 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:20.161838 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:13:20.162086 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:20.162041 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" containerID="cri-o://f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36" gracePeriod=30 Jun 03 21:13:20.816136 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:20.816093 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lgktm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:13:20.816563 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:20.816157 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" podUID="7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 03 21:13:21.816540 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:21.816507 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lgktm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 03 21:13:21.817056 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:21.816569 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" podUID="7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 03 21:13:21.859903 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:21.859875 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:21.937090 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:21.937057 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbd45\" (UniqueName: \"kubernetes.io/projected/6dc0aa44-c059-40a6-918b-1a39536e23fb-kube-api-access-bbd45\") pod \"6dc0aa44-c059-40a6-918b-1a39536e23fb\" (UID: \"6dc0aa44-c059-40a6-918b-1a39536e23fb\") " Jun 03 21:13:21.939443 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:21.939410 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc0aa44-c059-40a6-918b-1a39536e23fb-kube-api-access-bbd45" (OuterVolumeSpecName: "kube-api-access-bbd45") pod "6dc0aa44-c059-40a6-918b-1a39536e23fb" (UID: "6dc0aa44-c059-40a6-918b-1a39536e23fb"). InnerVolumeSpecName "kube-api-access-bbd45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:13:22.037703 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.037672 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbd45\" (UniqueName: \"kubernetes.io/projected/6dc0aa44-c059-40a6-918b-1a39536e23fb-kube-api-access-bbd45\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:13:22.283348 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.283242 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerID="f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36" exitCode=143 Jun 03 21:13:22.283531 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.283393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6dc0aa44-c059-40a6-918b-1a39536e23fb","Type":"ContainerDied","Data":"f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36"} Jun 03 21:13:22.283531 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.283463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6dc0aa44-c059-40a6-918b-1a39536e23fb","Type":"ContainerDied","Data":"2d94beffd6e6eeec24367c2ecba0eedcabbbbde24c4d9ca06057aa0f24b829bc"} Jun 03 21:13:22.283531 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.283493 2579 scope.go:117] "RemoveContainer" containerID="f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36" Jun 03 21:13:22.283728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.283709 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.294051 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.294027 2579 scope.go:117] "RemoveContainer" containerID="f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36" Jun 03 21:13:22.294339 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:13:22.294317 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36\": container with ID starting with f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36 not found: ID does not exist" containerID="f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36" Jun 03 21:13:22.294413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.294350 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36"} err="failed to get container status \"f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36\": rpc error: code = NotFound desc = could not find container \"f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36\": container with ID starting with f5e0895d075f1582c54c935bd6da492fdc4f19197433f2abbdbea573fcaeac36 not found: ID does not exist" Jun 03 21:13:22.307376 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.307338 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:13:22.307593 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.307579 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:13:22.325119 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.325081 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:13:22.325502 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.325488 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" Jun 03 21:13:22.325545 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.325503 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" Jun 03 21:13:22.325579 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.325568 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" containerName="keycloak" Jun 03 21:13:22.328287 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.328270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.331000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.330970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 21:13:22.331000 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.330970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 21:13:22.331201 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.331011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-g5qvl\"" Jun 03 21:13:22.331201 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.330971 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 21:13:22.331201 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.330970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 21:13:22.339263 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.339237 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:13:22.439828 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.439795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nwph\" (UniqueName: \"kubernetes.io/projected/89d0cf85-b15f-409a-89f8-fe80dc5ecb87-kube-api-access-7nwph\") pod \"maas-keycloak-0\" (UID: \"89d0cf85-b15f-409a-89f8-fe80dc5ecb87\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.439999 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.439927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/89d0cf85-b15f-409a-89f8-fe80dc5ecb87-test-realms\") pod \"maas-keycloak-0\" (UID: \"89d0cf85-b15f-409a-89f8-fe80dc5ecb87\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.541371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.541272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/89d0cf85-b15f-409a-89f8-fe80dc5ecb87-test-realms\") pod \"maas-keycloak-0\" (UID: \"89d0cf85-b15f-409a-89f8-fe80dc5ecb87\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.541371 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.541335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nwph\" (UniqueName: \"kubernetes.io/projected/89d0cf85-b15f-409a-89f8-fe80dc5ecb87-kube-api-access-7nwph\") pod \"maas-keycloak-0\" (UID: \"89d0cf85-b15f-409a-89f8-fe80dc5ecb87\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.542059 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.542037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/89d0cf85-b15f-409a-89f8-fe80dc5ecb87-test-realms\") pod \"maas-keycloak-0\" (UID: \"89d0cf85-b15f-409a-89f8-fe80dc5ecb87\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.549574 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.549542 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nwph\" (UniqueName: \"kubernetes.io/projected/89d0cf85-b15f-409a-89f8-fe80dc5ecb87-kube-api-access-7nwph\") pod \"maas-keycloak-0\" (UID: \"89d0cf85-b15f-409a-89f8-fe80dc5ecb87\") " pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.639550 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.639507 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:22.773334 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.773302 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 21:13:22.774181 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:13:22.774161 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d0cf85_b15f_409a_89f8_fe80dc5ecb87.slice/crio-376a3f54118aba0193a09b9a0ebf337f226334ff8569fc78cf3887bebde21815 WatchSource:0}: Error finding container 376a3f54118aba0193a09b9a0ebf337f226334ff8569fc78cf3887bebde21815: Status 404 returned error can't find the container with id 376a3f54118aba0193a09b9a0ebf337f226334ff8569fc78cf3887bebde21815 Jun 03 21:13:22.775643 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.775626 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:13:22.819500 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.819422 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:13:22.819888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.819719 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:13:22.820499 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:22.820483 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lgktm" Jun 03 21:13:23.293365 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:23.293318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"89d0cf85-b15f-409a-89f8-fe80dc5ecb87","Type":"ContainerStarted","Data":"8affdf7e8acf463326bc7613c3114ad4cd9dc2ff3f8d7130d299595539f437d7"} Jun 03 21:13:23.293561 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:23.293539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"89d0cf85-b15f-409a-89f8-fe80dc5ecb87","Type":"ContainerStarted","Data":"376a3f54118aba0193a09b9a0ebf337f226334ff8569fc78cf3887bebde21815"} Jun 03 21:13:23.312938 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:23.312873 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.024675639 podStartE2EDuration="1.312848294s" totalImagesPullingTime="288.172655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:13:23.312838674 +0000 UTC m=+605.720602170" watchObservedRunningTime="2026-06-03 21:13:23.312848294 +0000 UTC m=+605.720611791" Jun 03 21:13:23.640429 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:23.640388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:23.642164 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:23.642131 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:24.041250 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:24.041199 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc0aa44-c059-40a6-918b-1a39536e23fb" path="/var/lib/kubelet/pods/6dc0aa44-c059-40a6-918b-1a39536e23fb/volumes" Jun 03 21:13:24.640195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:24.640147 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:25.640669 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:25.640617 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:26.640166 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:26.640103 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:27.641079 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:27.641027 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:28.640558 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:28.640510 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:29.640896 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:29.640841 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:30.640676 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:30.640624 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:31.640344 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:31.640292 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:32.639931 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:32.639829 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:32.640255 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:32.640228 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:33.640569 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:33.640506 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:34.640474 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:34.640422 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:35.640176 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:35.640129 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 21:13:36.761825 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:36.761785 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:36.777520 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:36.777457 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="89d0cf85-b15f-409a-89f8-fe80dc5ecb87" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 21:13:46.768016 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:46.767981 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 21:13:57.499303 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.499265 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7567b6c4f4-8d5sn"] Jun 03 21:13:57.507266 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.507237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.509891 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.509861 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7567b6c4f4-8d5sn"] Jun 03 21:13:57.510125 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.510102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 21:13:57.598332 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.598291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w79h7\" (UniqueName: \"kubernetes.io/projected/a3eaa6f4-f603-4397-926e-001158f180d8-kube-api-access-w79h7\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.598524 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.598350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3eaa6f4-f603-4397-926e-001158f180d8-tls-cert\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.598524 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.598425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a3eaa6f4-f603-4397-926e-001158f180d8-oidc-ca\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.699147 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.699100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3eaa6f4-f603-4397-926e-001158f180d8-tls-cert\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.699359 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.699184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a3eaa6f4-f603-4397-926e-001158f180d8-oidc-ca\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.699359 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.699262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w79h7\" (UniqueName: \"kubernetes.io/projected/a3eaa6f4-f603-4397-926e-001158f180d8-kube-api-access-w79h7\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.699877 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.699851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a3eaa6f4-f603-4397-926e-001158f180d8-oidc-ca\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.701696 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.701674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3eaa6f4-f603-4397-926e-001158f180d8-tls-cert\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.707224 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.707197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w79h7\" (UniqueName: \"kubernetes.io/projected/a3eaa6f4-f603-4397-926e-001158f180d8-kube-api-access-w79h7\") pod \"authorino-7567b6c4f4-8d5sn\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.816961 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.816871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:13:57.958599 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:57.958568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7567b6c4f4-8d5sn"] Jun 03 21:13:57.960024 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:13:57.959991 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3eaa6f4_f603_4397_926e_001158f180d8.slice/crio-ded7ecdad0591376b458dee82835564fce168b9a8fefcaefe7000016bd25bd98 WatchSource:0}: Error finding container ded7ecdad0591376b458dee82835564fce168b9a8fefcaefe7000016bd25bd98: Status 404 returned error can't find the container with id ded7ecdad0591376b458dee82835564fce168b9a8fefcaefe7000016bd25bd98 Jun 03 21:13:58.545545 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:58.545474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" event={"ID":"a3eaa6f4-f603-4397-926e-001158f180d8","Type":"ContainerStarted","Data":"ded7ecdad0591376b458dee82835564fce168b9a8fefcaefe7000016bd25bd98"} Jun 03 21:13:59.554633 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.554597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" event={"ID":"a3eaa6f4-f603-4397-926e-001158f180d8","Type":"ContainerStarted","Data":"edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b"} Jun 03 21:13:59.571064 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.571006 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" podStartSLOduration=1.986570435 podStartE2EDuration="2.570990077s" totalImagesPullingTime="584.419642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:13:59.568628617 +0000 UTC m=+641.976392111" watchObservedRunningTime="2026-06-03 21:13:59.570990077 +0000 UTC m=+641.978753572" Jun 03 21:13:59.597934 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.597892 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c4b6b9b4-8b86z"] Jun 03 21:13:59.598324 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.598166 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" podUID="49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" containerName="authorino" containerID="cri-o://3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247" gracePeriod=30 Jun 03 21:13:59.876177 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.876151 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:13:59.920258 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.920227 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-tls-cert\") pod \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " Jun 03 21:13:59.920437 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.920283 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbm8f\" (UniqueName: \"kubernetes.io/projected/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-kube-api-access-qbm8f\") pod \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\" (UID: \"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f\") " Jun 03 21:13:59.922548 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.922518 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-kube-api-access-qbm8f" (OuterVolumeSpecName: "kube-api-access-qbm8f") pod "49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" (UID: "49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f"). InnerVolumeSpecName "kube-api-access-qbm8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:13:59.931489 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:13:59.931459 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" (UID: "49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:14:00.021816 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.021781 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-tls-cert\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:14:00.021816 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.021812 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbm8f\" (UniqueName: \"kubernetes.io/projected/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f-kube-api-access-qbm8f\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:14:00.561511 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.561478 2579 generic.go:356] "Generic (PLEG): container finished" podID="49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" containerID="3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247" exitCode=0 Jun 03 21:14:00.561946 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.561519 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" Jun 03 21:14:00.561946 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.561547 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" event={"ID":"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f","Type":"ContainerDied","Data":"3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247"} Jun 03 21:14:00.561946 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.561586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c4b6b9b4-8b86z" event={"ID":"49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f","Type":"ContainerDied","Data":"9db91e445daeb3f34e685077df537650c553285627b1237a4abc1293244fa41e"} Jun 03 21:14:00.561946 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.561602 2579 scope.go:117] "RemoveContainer" containerID="3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247" Jun 03 21:14:00.571203 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.571187 2579 scope.go:117] "RemoveContainer" containerID="3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247" Jun 03 21:14:00.571475 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:14:00.571455 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247\": container with ID starting with 3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247 not found: ID does not exist" containerID="3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247" Jun 03 21:14:00.571549 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.571482 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247"} err="failed to get container status \"3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247\": rpc error: code = NotFound desc = could not find container \"3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247\": container with ID starting with 3179cfab37eda12751600e9b0eb40ca37c285f8c3fa1f15c4e737674b6360247 not found: ID does not exist" Jun 03 21:14:00.579113 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.579091 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c4b6b9b4-8b86z"] Jun 03 21:14:00.581654 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:00.581629 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c4b6b9b4-8b86z"] Jun 03 21:14:02.040096 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:02.040052 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" path="/var/lib/kubelet/pods/49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f/volumes" Jun 03 21:14:06.780446 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.780407 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2"] Jun 03 21:14:06.780959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.780827 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" containerName="authorino" Jun 03 21:14:06.780959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.780839 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" containerName="authorino" Jun 03 21:14:06.780959 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.780914 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d1dfe0-7fc6-4b0a-9479-1bbf435cdf9f" containerName="authorino" Jun 03 21:14:06.783889 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.783870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.787481 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.787458 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 21:14:06.787627 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.787494 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 21:14:06.787627 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.787496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l6jj5\"" Jun 03 21:14:06.787627 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.787498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 21:14:06.793719 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.793695 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2"] Jun 03 21:14:06.887190 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.887135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.887190 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.887188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.887444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.887267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.887444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.887301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.887444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.887331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q4bm\" (UniqueName: \"kubernetes.io/projected/a7fb259d-ab3d-4044-b054-336142eb8717-kube-api-access-5q4bm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.887444 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.887407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fb259d-ab3d-4044-b054-336142eb8717-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.988747 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.988711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.988937 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.988784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.988937 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.988829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.988937 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.988856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.988937 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.988895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q4bm\" (UniqueName: \"kubernetes.io/projected/a7fb259d-ab3d-4044-b054-336142eb8717-kube-api-access-5q4bm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.988937 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.988934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fb259d-ab3d-4044-b054-336142eb8717-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.989239 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.989168 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.989310 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.989237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.989370 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.989319 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.991549 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.991517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fb259d-ab3d-4044-b054-336142eb8717-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.991922 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.991896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fb259d-ab3d-4044-b054-336142eb8717-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:06.997167 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:06.997141 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q4bm\" (UniqueName: \"kubernetes.io/projected/a7fb259d-ab3d-4044-b054-336142eb8717-kube-api-access-5q4bm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zcrl2\" (UID: \"a7fb259d-ab3d-4044-b054-336142eb8717\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:07.095518 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:07.095436 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:07.238791 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:07.238761 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2"] Jun 03 21:14:07.240979 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:14:07.240945 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fb259d_ab3d_4044_b054_336142eb8717.slice/crio-d6b7982cc5e1c050f3422bcb03d8acf9ceb0f94705bcbaad4fd06ec3ad6fc4e5 WatchSource:0}: Error finding container d6b7982cc5e1c050f3422bcb03d8acf9ceb0f94705bcbaad4fd06ec3ad6fc4e5: Status 404 returned error can't find the container with id d6b7982cc5e1c050f3422bcb03d8acf9ceb0f94705bcbaad4fd06ec3ad6fc4e5 Jun 03 21:14:07.607935 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:07.607898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" event={"ID":"a7fb259d-ab3d-4044-b054-336142eb8717","Type":"ContainerStarted","Data":"d6b7982cc5e1c050f3422bcb03d8acf9ceb0f94705bcbaad4fd06ec3ad6fc4e5"} Jun 03 21:14:11.637151 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:11.637114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" event={"ID":"a7fb259d-ab3d-4044-b054-336142eb8717","Type":"ContainerStarted","Data":"e8c640ed4bd487c590e15c59400c3f8b77e4d40817939bd2568e03cffc4b1d23"} Jun 03 21:14:12.645609 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:12.645566 2579 generic.go:356] "Generic (PLEG): container finished" podID="a7fb259d-ab3d-4044-b054-336142eb8717" containerID="e8c640ed4bd487c590e15c59400c3f8b77e4d40817939bd2568e03cffc4b1d23" exitCode=0 Jun 03 21:14:12.646044 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:12.645651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" event={"ID":"a7fb259d-ab3d-4044-b054-336142eb8717","Type":"ContainerDied","Data":"e8c640ed4bd487c590e15c59400c3f8b77e4d40817939bd2568e03cffc4b1d23"} Jun 03 21:14:14.661530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:14.661484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" event={"ID":"a7fb259d-ab3d-4044-b054-336142eb8717","Type":"ContainerStarted","Data":"878f5b4e542315117a62327f0ab675c5138912ef9d52fb0f85893d17c01c5020"} Jun 03 21:14:14.681587 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:14.681522 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" podStartSLOduration=2.6469216810000002 podStartE2EDuration="8.681498579s" totalImagesPullingTime="4.677513374s" totalInitContainerRuntime="1.357063524s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:14:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:14:14.678846403 +0000 UTC m=+657.086609898" watchObservedRunningTime="2026-06-03 21:14:14.681498579 +0000 UTC m=+657.089262075" Jun 03 21:14:17.096514 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:17.096475 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:17.097026 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:17.096543 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:17.109548 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:17.109521 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:17.695039 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:17.695011 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zcrl2" Jun 03 21:14:18.886083 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:18.886048 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t"] Jun 03 21:14:18.893961 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:18.893934 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:18.897047 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:18.897015 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 21:14:18.899277 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:18.899251 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t"] Jun 03 21:14:19.007198 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.007154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.007198 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.007200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.007452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.007246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91e0d743-4b63-4c5b-8a50-71c76996530b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.007452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.007279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.007452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.007305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.007452 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.007331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tp5p\" (UniqueName: \"kubernetes.io/projected/91e0d743-4b63-4c5b-8a50-71c76996530b-kube-api-access-4tp5p\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108236 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108236 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108504 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91e0d743-4b63-4c5b-8a50-71c76996530b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108504 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108504 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108504 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tp5p\" (UniqueName: \"kubernetes.io/projected/91e0d743-4b63-4c5b-8a50-71c76996530b-kube-api-access-4tp5p\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.108870 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.108806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.110753 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.110714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91e0d743-4b63-4c5b-8a50-71c76996530b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.111088 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.111067 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91e0d743-4b63-4c5b-8a50-71c76996530b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.116024 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.116004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tp5p\" (UniqueName: \"kubernetes.io/projected/91e0d743-4b63-4c5b-8a50-71c76996530b-kube-api-access-4tp5p\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t\" (UID: \"91e0d743-4b63-4c5b-8a50-71c76996530b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.205526 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.205484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:19.351575 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.351545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t"] Jun 03 21:14:19.353128 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:14:19.353100 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e0d743_4b63_4c5b_8a50_71c76996530b.slice/crio-9382e904f8acf19df7eda636020738e7f1258455a2bd65debff6ae5ec0ac2115 WatchSource:0}: Error finding container 9382e904f8acf19df7eda636020738e7f1258455a2bd65debff6ae5ec0ac2115: Status 404 returned error can't find the container with id 9382e904f8acf19df7eda636020738e7f1258455a2bd65debff6ae5ec0ac2115 Jun 03 21:14:19.696336 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.696300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" event={"ID":"91e0d743-4b63-4c5b-8a50-71c76996530b","Type":"ContainerStarted","Data":"1f720ff9d7971821e5b51395e906ce4cfb1935a33ef2b182b9128023c65a56a4"} Jun 03 21:14:19.696493 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:19.696362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" event={"ID":"91e0d743-4b63-4c5b-8a50-71c76996530b","Type":"ContainerStarted","Data":"9382e904f8acf19df7eda636020738e7f1258455a2bd65debff6ae5ec0ac2115"} Jun 03 21:14:21.711278 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:21.711241 2579 generic.go:356] "Generic (PLEG): container finished" podID="91e0d743-4b63-4c5b-8a50-71c76996530b" containerID="1f720ff9d7971821e5b51395e906ce4cfb1935a33ef2b182b9128023c65a56a4" exitCode=0 Jun 03 21:14:21.711728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:21.711357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" event={"ID":"91e0d743-4b63-4c5b-8a50-71c76996530b","Type":"ContainerDied","Data":"1f720ff9d7971821e5b51395e906ce4cfb1935a33ef2b182b9128023c65a56a4"} Jun 03 21:14:22.719935 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:22.719896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" event={"ID":"91e0d743-4b63-4c5b-8a50-71c76996530b","Type":"ContainerStarted","Data":"fa3fe4fa942c3adcf9b54aa558c4ac75f1259970e392c27c61b3e4770fe6f4f6"} Jun 03 21:14:22.739155 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:22.739080 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" podStartSLOduration=2.992734076 podStartE2EDuration="4.739057623s" totalImagesPullingTime="455.586115ms" totalInitContainerRuntime="1.290737432s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:14:22.73715706 +0000 UTC m=+665.144920549" watchObservedRunningTime="2026-06-03 21:14:22.739057623 +0000 UTC m=+665.146821119" Jun 03 21:14:29.205698 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:29.205656 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:29.206180 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:29.205801 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:29.218466 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:29.218435 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:29.773648 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:29.773617 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t" Jun 03 21:14:40.187558 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.187518 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5"] Jun 03 21:14:40.191315 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.191294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.193935 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.193908 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 21:14:40.200206 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.200175 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5"] Jun 03 21:14:40.203394 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.203367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.203505 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.203399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fvr\" (UniqueName: \"kubernetes.io/projected/49ed7699-b807-4548-b4f3-d6b9c26f8996-kube-api-access-g7fvr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.203505 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.203440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.203583 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.203530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49ed7699-b807-4548-b4f3-d6b9c26f8996-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.203653 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.203632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.203693 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.203684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304477 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fvr\" (UniqueName: \"kubernetes.io/projected/49ed7699-b807-4548-b4f3-d6b9c26f8996-kube-api-access-g7fvr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304673 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49ed7699-b807-4548-b4f3-d6b9c26f8996-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304996 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.304996 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.304967 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.305102 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.305009 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.307477 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.307448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49ed7699-b807-4548-b4f3-d6b9c26f8996-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.307801 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.307783 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49ed7699-b807-4548-b4f3-d6b9c26f8996-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.312447 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.312427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fvr\" (UniqueName: \"kubernetes.io/projected/49ed7699-b807-4548-b4f3-d6b9c26f8996-kube-api-access-g7fvr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jfxm5\" (UID: \"49ed7699-b807-4548-b4f3-d6b9c26f8996\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.501797 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.501669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:40.645230 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.645194 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5"] Jun 03 21:14:40.646522 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:14:40.646490 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ed7699_b807_4548_b4f3_d6b9c26f8996.slice/crio-dadc721f48726706f635d7fd6f2b5d2640d1be03414ed3122edd85928c29e063 WatchSource:0}: Error finding container dadc721f48726706f635d7fd6f2b5d2640d1be03414ed3122edd85928c29e063: Status 404 returned error can't find the container with id dadc721f48726706f635d7fd6f2b5d2640d1be03414ed3122edd85928c29e063 Jun 03 21:14:40.838449 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.838342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" event={"ID":"49ed7699-b807-4548-b4f3-d6b9c26f8996","Type":"ContainerStarted","Data":"8d03326622b3688af815038799b51b51a34f0b2b2f28bd68647bf23cc89dd856"} Jun 03 21:14:40.838449 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:40.838386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" event={"ID":"49ed7699-b807-4548-b4f3-d6b9c26f8996","Type":"ContainerStarted","Data":"dadc721f48726706f635d7fd6f2b5d2640d1be03414ed3122edd85928c29e063"} Jun 03 21:14:42.853071 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:42.853036 2579 generic.go:356] "Generic (PLEG): container finished" podID="49ed7699-b807-4548-b4f3-d6b9c26f8996" containerID="8d03326622b3688af815038799b51b51a34f0b2b2f28bd68647bf23cc89dd856" exitCode=0 Jun 03 21:14:42.853479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:42.853112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" event={"ID":"49ed7699-b807-4548-b4f3-d6b9c26f8996","Type":"ContainerDied","Data":"8d03326622b3688af815038799b51b51a34f0b2b2f28bd68647bf23cc89dd856"} Jun 03 21:14:43.861150 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:43.861104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" event={"ID":"49ed7699-b807-4548-b4f3-d6b9c26f8996","Type":"ContainerStarted","Data":"7edff1bb99b42dd0ea8fc71fc197e3787ca6af376091e6e13d9374b3bf0f9f2d"} Jun 03 21:14:43.879668 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:43.879609 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" podStartSLOduration=2.224597169 podStartE2EDuration="3.879591945s" totalImagesPullingTime="378.023005ms" totalInitContainerRuntime="1.276971771s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:14:43.87825523 +0000 UTC m=+686.286018725" watchObservedRunningTime="2026-06-03 21:14:43.879591945 +0000 UTC m=+686.287355490" Jun 03 21:14:50.502289 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:50.502232 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:50.502724 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:50.502320 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:50.515306 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:50.515276 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:14:50.915302 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:14:50.915215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jfxm5" Jun 03 21:15:39.498119 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.498080 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d5cd974f9-44l26"] Jun 03 21:15:39.501677 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.501650 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.511203 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.511171 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d5cd974f9-44l26"] Jun 03 21:15:39.600852 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.600804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-oidc-ca\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.600852 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.600849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-tls-cert\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.601089 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.600884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4msfr\" (UniqueName: \"kubernetes.io/projected/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-kube-api-access-4msfr\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.702274 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.702230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-oidc-ca\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.702274 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.702278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-tls-cert\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.702504 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.702302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4msfr\" (UniqueName: \"kubernetes.io/projected/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-kube-api-access-4msfr\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.702939 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.702917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-oidc-ca\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.704915 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.704892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-tls-cert\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.709905 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.709880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4msfr\" (UniqueName: \"kubernetes.io/projected/e7e9411c-bdbd-46a1-9670-d5d678dfbc83-kube-api-access-4msfr\") pod \"authorino-7d5cd974f9-44l26\" (UID: \"e7e9411c-bdbd-46a1-9670-d5d678dfbc83\") " pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.812668 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.812579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d5cd974f9-44l26" Jun 03 21:15:39.958727 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:39.958691 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d5cd974f9-44l26"] Jun 03 21:15:39.959815 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:15:39.959782 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7e9411c_bdbd_46a1_9670_d5d678dfbc83.slice/crio-b4d8db84094a10606b7a8c2c2f9b09c06b44cbbba10c157de1be8a3c341c05fd WatchSource:0}: Error finding container b4d8db84094a10606b7a8c2c2f9b09c06b44cbbba10c157de1be8a3c341c05fd: Status 404 returned error can't find the container with id b4d8db84094a10606b7a8c2c2f9b09c06b44cbbba10c157de1be8a3c341c05fd Jun 03 21:15:40.202846 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:40.202804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d5cd974f9-44l26" event={"ID":"e7e9411c-bdbd-46a1-9670-d5d678dfbc83","Type":"ContainerStarted","Data":"b4d8db84094a10606b7a8c2c2f9b09c06b44cbbba10c157de1be8a3c341c05fd"} Jun 03 21:15:41.211076 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.211030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d5cd974f9-44l26" event={"ID":"e7e9411c-bdbd-46a1-9670-d5d678dfbc83","Type":"ContainerStarted","Data":"b44fd53ee484437d5fb4cf63b1677c49655f842219271d02c0ce6a5d45e6f002"} Jun 03 21:15:41.230316 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.230260 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d5cd974f9-44l26" podStartSLOduration=1.9425564739999999 podStartE2EDuration="2.230241922s" totalImagesPullingTime="287.685448ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:15:41.228869525 +0000 UTC m=+743.636633025" watchObservedRunningTime="2026-06-03 21:15:41.230241922 +0000 UTC m=+743.638005417" Jun 03 21:15:41.260501 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.260464 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7567b6c4f4-8d5sn"] Jun 03 21:15:41.260697 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.260672 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" podUID="a3eaa6f4-f603-4397-926e-001158f180d8" containerName="authorino" containerID="cri-o://edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b" gracePeriod=30 Jun 03 21:15:41.534735 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.534700 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:15:41.724861 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.724803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3eaa6f4-f603-4397-926e-001158f180d8-tls-cert\") pod \"a3eaa6f4-f603-4397-926e-001158f180d8\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " Jun 03 21:15:41.725038 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.724986 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w79h7\" (UniqueName: \"kubernetes.io/projected/a3eaa6f4-f603-4397-926e-001158f180d8-kube-api-access-w79h7\") pod \"a3eaa6f4-f603-4397-926e-001158f180d8\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " Jun 03 21:15:41.725038 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.725026 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a3eaa6f4-f603-4397-926e-001158f180d8-oidc-ca\") pod \"a3eaa6f4-f603-4397-926e-001158f180d8\" (UID: \"a3eaa6f4-f603-4397-926e-001158f180d8\") " Jun 03 21:15:41.727235 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.727195 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3eaa6f4-f603-4397-926e-001158f180d8-kube-api-access-w79h7" (OuterVolumeSpecName: "kube-api-access-w79h7") pod "a3eaa6f4-f603-4397-926e-001158f180d8" (UID: "a3eaa6f4-f603-4397-926e-001158f180d8"). InnerVolumeSpecName "kube-api-access-w79h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:15:41.730379 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.730350 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3eaa6f4-f603-4397-926e-001158f180d8-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "a3eaa6f4-f603-4397-926e-001158f180d8" (UID: "a3eaa6f4-f603-4397-926e-001158f180d8"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:15:41.738479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.738448 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3eaa6f4-f603-4397-926e-001158f180d8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a3eaa6f4-f603-4397-926e-001158f180d8" (UID: "a3eaa6f4-f603-4397-926e-001158f180d8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:15:41.826478 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.826388 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w79h7\" (UniqueName: \"kubernetes.io/projected/a3eaa6f4-f603-4397-926e-001158f180d8-kube-api-access-w79h7\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:15:41.826478 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.826420 2579 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a3eaa6f4-f603-4397-926e-001158f180d8-oidc-ca\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:15:41.826478 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:41.826434 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3eaa6f4-f603-4397-926e-001158f180d8-tls-cert\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:15:42.218714 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.218677 2579 generic.go:356] "Generic (PLEG): container finished" podID="a3eaa6f4-f603-4397-926e-001158f180d8" containerID="edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b" exitCode=0 Jun 03 21:15:42.219160 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.218720 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" Jun 03 21:15:42.219160 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.218782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" event={"ID":"a3eaa6f4-f603-4397-926e-001158f180d8","Type":"ContainerDied","Data":"edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b"} Jun 03 21:15:42.219160 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.218818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7567b6c4f4-8d5sn" event={"ID":"a3eaa6f4-f603-4397-926e-001158f180d8","Type":"ContainerDied","Data":"ded7ecdad0591376b458dee82835564fce168b9a8fefcaefe7000016bd25bd98"} Jun 03 21:15:42.219160 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.218835 2579 scope.go:117] "RemoveContainer" containerID="edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b" Jun 03 21:15:42.229212 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.229188 2579 scope.go:117] "RemoveContainer" containerID="edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b" Jun 03 21:15:42.229512 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:15:42.229491 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b\": container with ID starting with edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b not found: ID does not exist" containerID="edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b" Jun 03 21:15:42.229588 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.229526 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b"} err="failed to get container status \"edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b\": rpc error: code = NotFound desc = could not find container \"edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b\": container with ID starting with edfe753eb0413b391f85089046e95dd3eb67c623d7e4f61aded7c6dbdc7ad95b not found: ID does not exist" Jun 03 21:15:42.241822 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.241789 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7567b6c4f4-8d5sn"] Jun 03 21:15:42.246292 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:42.246247 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7567b6c4f4-8d5sn"] Jun 03 21:15:44.040492 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:15:44.040458 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3eaa6f4-f603-4397-926e-001158f180d8" path="/var/lib/kubelet/pods/a3eaa6f4-f603-4397-926e-001158f180d8/volumes" Jun 03 21:18:18.132914 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:18:18.132879 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:18:18.137977 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:18:18.137953 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:23:18.177349 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:23:18.177223 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:23:18.182506 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:23:18.182482 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:27:45.085486 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.085440 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz"] Jun 03 21:27:45.086054 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.085691 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" podUID="95f22dc5-8e29-4429-94e8-3c7eb26bc074" containerName="manager" containerID="cri-o://c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25" gracePeriod=10 Jun 03 21:27:45.846652 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.846624 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:27:45.883057 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.883017 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f22dc5-8e29-4429-94e8-3c7eb26bc074-extensions-socket-volume\") pod \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " Jun 03 21:27:45.883253 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.883144 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pft4\" (UniqueName: \"kubernetes.io/projected/95f22dc5-8e29-4429-94e8-3c7eb26bc074-kube-api-access-7pft4\") pod \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\" (UID: \"95f22dc5-8e29-4429-94e8-3c7eb26bc074\") " Jun 03 21:27:45.883468 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.883442 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f22dc5-8e29-4429-94e8-3c7eb26bc074-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "95f22dc5-8e29-4429-94e8-3c7eb26bc074" (UID: "95f22dc5-8e29-4429-94e8-3c7eb26bc074"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:27:45.885431 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.885409 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f22dc5-8e29-4429-94e8-3c7eb26bc074-kube-api-access-7pft4" (OuterVolumeSpecName: "kube-api-access-7pft4") pod "95f22dc5-8e29-4429-94e8-3c7eb26bc074" (UID: "95f22dc5-8e29-4429-94e8-3c7eb26bc074"). InnerVolumeSpecName "kube-api-access-7pft4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:27:45.984530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.984496 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pft4\" (UniqueName: \"kubernetes.io/projected/95f22dc5-8e29-4429-94e8-3c7eb26bc074-kube-api-access-7pft4\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:27:45.984530 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:45.984524 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95f22dc5-8e29-4429-94e8-3c7eb26bc074-extensions-socket-volume\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Jun 03 21:27:46.694550 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.694510 2579 generic.go:356] "Generic (PLEG): container finished" podID="95f22dc5-8e29-4429-94e8-3c7eb26bc074" containerID="c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25" exitCode=0 Jun 03 21:27:46.694994 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.694558 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" Jun 03 21:27:46.694994 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.694556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" event={"ID":"95f22dc5-8e29-4429-94e8-3c7eb26bc074","Type":"ContainerDied","Data":"c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25"} Jun 03 21:27:46.694994 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.694615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz" event={"ID":"95f22dc5-8e29-4429-94e8-3c7eb26bc074","Type":"ContainerDied","Data":"dfa435d8cdfc0128470bfbe93a0391ea012b5cda8925d3ca5127b0c6838894aa"} Jun 03 21:27:46.694994 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.694646 2579 scope.go:117] "RemoveContainer" containerID="c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25" Jun 03 21:27:46.704664 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.704639 2579 scope.go:117] "RemoveContainer" containerID="c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25" Jun 03 21:27:46.705145 ip-10-0-135-120 kubenswrapper[2579]: E0603 21:27:46.705113 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25\": container with ID starting with c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25 not found: ID does not exist" containerID="c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25" Jun 03 21:27:46.705228 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.705158 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25"} err="failed to get container status \"c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25\": rpc error: code = NotFound desc = could not find container \"c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25\": container with ID starting with c9b598fe924b31e1039d967db06194bbe24fda9794e96d209b93eabe90f14e25 not found: ID does not exist" Jun 03 21:27:46.720503 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.720467 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz"] Jun 03 21:27:46.725886 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:46.725857 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2tbz"] Jun 03 21:27:48.040761 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:27:48.040708 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f22dc5-8e29-4429-94e8-3c7eb26bc074" path="/var/lib/kubelet/pods/95f22dc5-8e29-4429-94e8-3c7eb26bc074/volumes" Jun 03 21:28:18.222308 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:28:18.222275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:28:18.228647 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:28:18.228627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:33:18.262968 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:33:18.262850 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:33:18.271674 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:33:18.271648 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:38:18.305995 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:38:18.305890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:38:18.315479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:38:18.315453 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spj7s_bacf5d35-0b7c-485e-8b7c-6a4d0b782a29/ovn-acl-logging/0.log" Jun 03 21:38:55.921284 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:38:55.921244 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d5cd974f9-44l26_e7e9411c-bdbd-46a1-9670-d5d678dfbc83/authorino/0.log" Jun 03 21:39:00.537178 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:00.537146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64d8cdd79c-6xqgm_4e993961-2eca-4856-aa8d-5a17d0780ac9/nginx/0.log" Jun 03 21:39:00.885388 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:00.885308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f75d9d46c-kdfsw_5be38bbd-7135-4af8-8c7f-79221dec326a/maas-api/0.log" Jun 03 21:39:01.453987 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:01.453955 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-5xmjh_290ac81a-9d78-416a-a91c-aaa15b6b6a23/manager/0.log" Jun 03 21:39:01.572159 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:01.572131 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl_f556742f-7162-4831-a0ee-034a121b949f/copy-manifests/0.log" Jun 03 21:39:01.585321 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:01.585282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl_f556742f-7162-4831-a0ee-034a121b949f/manager/0.log" Jun 03 21:39:02.719192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.719118 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm_f1296c3f-641d-4920-9d83-2034daf95282/util/0.log" Jun 03 21:39:02.726509 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.726480 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm_f1296c3f-641d-4920-9d83-2034daf95282/pull/0.log" Jun 03 21:39:02.733877 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.733848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm_f1296c3f-641d-4920-9d83-2034daf95282/extract/0.log" Jun 03 21:39:02.841040 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.841012 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg_b3dc21b3-9f72-4262-8c82-c8c29c44a461/util/0.log" Jun 03 21:39:02.848479 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.848449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg_b3dc21b3-9f72-4262-8c82-c8c29c44a461/pull/0.log" Jun 03 21:39:02.855409 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.855385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg_b3dc21b3-9f72-4262-8c82-c8c29c44a461/extract/0.log" Jun 03 21:39:02.973726 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.973642 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd_5057516d-09d5-4fcd-be80-f6e3e4dff1e1/util/0.log" Jun 03 21:39:02.981247 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.981223 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd_5057516d-09d5-4fcd-be80-f6e3e4dff1e1/pull/0.log" Jun 03 21:39:02.988328 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:02.988303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd_5057516d-09d5-4fcd-be80-f6e3e4dff1e1/extract/0.log" Jun 03 21:39:03.110363 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.110333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66_55832135-e450-4d74-9c61-17fd6874a8ae/extract/0.log" Jun 03 21:39:03.118410 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.118381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66_55832135-e450-4d74-9c61-17fd6874a8ae/util/0.log" Jun 03 21:39:03.126086 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.126044 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66_55832135-e450-4d74-9c61-17fd6874a8ae/pull/0.log" Jun 03 21:39:03.248247 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.248163 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d5cd974f9-44l26_e7e9411c-bdbd-46a1-9670-d5d678dfbc83/authorino/0.log" Jun 03 21:39:03.374644 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.374615 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j7f4r_241902c4-9063-444f-ae75-afc9a0d9b6f0/manager/0.log" Jun 03 21:39:03.486621 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.486587 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cr28p_20e4d955-83f7-46f7-be36-62b4218436ab/manager/0.log" Jun 03 21:39:03.713264 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:03.713228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nvsd6_290f3fa0-cfb7-40e2-8174-b66cd1285704/registry-server/0.log" Jun 03 21:39:04.427503 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:04.427466 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gr5kn_d2431081-3a8a-4ccc-a65a-2af18cf77920/istio-proxy/0.log" Jun 03 21:39:04.889133 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:04.889096 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/1.log" Jun 03 21:39:05.575212 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:05.575179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-zcrl2_a7fb259d-ab3d-4044-b054-336142eb8717/storage-initializer/0.log" Jun 03 21:39:05.582883 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:05.582860 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-zcrl2_a7fb259d-ab3d-4044-b054-336142eb8717/main/0.log" Jun 03 21:39:05.695973 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:05.695943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t_91e0d743-4b63-4c5b-8a50-71c76996530b/main/0.log" Jun 03 21:39:05.702967 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:05.702942 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7qb8t_91e0d743-4b63-4c5b-8a50-71c76996530b/storage-initializer/0.log" Jun 03 21:39:06.055326 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:06.055291 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-jfxm5_49ed7699-b807-4548-b4f3-d6b9c26f8996/storage-initializer/0.log" Jun 03 21:39:06.063528 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:06.063497 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-jfxm5_49ed7699-b807-4548-b4f3-d6b9c26f8996/main/0.log" Jun 03 21:39:12.967585 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:12.967548 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n7lph_8358b910-e09f-41bb-9158-0e65bf49e711/global-pull-secret-syncer/0.log" Jun 03 21:39:13.092276 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:13.092242 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jzphx_96d00132-0d39-447e-88f5-582b18088ffe/konnectivity-agent/0.log" Jun 03 21:39:13.159851 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:13.159824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-120.ec2.internal_40cb1235e1746ccaa0e7fc6c6540c44b/haproxy/0.log" Jun 03 21:39:16.460413 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:16.460380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-gckn5_a786f092-1aa1-4564-8113-3578c0b58c43/sail-operator/0.log" Jun 03 21:39:17.942649 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:17.942613 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm_f1296c3f-641d-4920-9d83-2034daf95282/extract/0.log" Jun 03 21:39:17.965752 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:17.965719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm_f1296c3f-641d-4920-9d83-2034daf95282/util/0.log" Jun 03 21:39:17.989842 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:17.989815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958psm_f1296c3f-641d-4920-9d83-2034daf95282/pull/0.log" Jun 03 21:39:18.024141 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.024115 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg_b3dc21b3-9f72-4262-8c82-c8c29c44a461/extract/0.log" Jun 03 21:39:18.046541 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.046513 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg_b3dc21b3-9f72-4262-8c82-c8c29c44a461/util/0.log" Jun 03 21:39:18.067954 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.067927 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kzksg_b3dc21b3-9f72-4262-8c82-c8c29c44a461/pull/0.log" Jun 03 21:39:18.094758 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.094722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd_5057516d-09d5-4fcd-be80-f6e3e4dff1e1/extract/0.log" Jun 03 21:39:18.119240 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.119202 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd_5057516d-09d5-4fcd-be80-f6e3e4dff1e1/util/0.log" Jun 03 21:39:18.144085 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.144046 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q4mnd_5057516d-09d5-4fcd-be80-f6e3e4dff1e1/pull/0.log" Jun 03 21:39:18.171130 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.171103 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66_55832135-e450-4d74-9c61-17fd6874a8ae/extract/0.log" Jun 03 21:39:18.196509 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.196428 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66_55832135-e450-4d74-9c61-17fd6874a8ae/util/0.log" Jun 03 21:39:18.219125 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.219101 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16pf66_55832135-e450-4d74-9c61-17fd6874a8ae/pull/0.log" Jun 03 21:39:18.474880 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.474800 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d5cd974f9-44l26_e7e9411c-bdbd-46a1-9670-d5d678dfbc83/authorino/0.log" Jun 03 21:39:18.527873 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.527843 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j7f4r_241902c4-9063-444f-ae75-afc9a0d9b6f0/manager/0.log" Jun 03 21:39:18.552936 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.552908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cr28p_20e4d955-83f7-46f7-be36-62b4218436ab/manager/0.log" Jun 03 21:39:18.616793 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:18.616762 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nvsd6_290f3fa0-cfb7-40e2-8174-b66cd1285704/registry-server/0.log" Jun 03 21:39:20.265192 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.265160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/alertmanager/0.log" Jun 03 21:39:20.290849 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.290818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/config-reloader/0.log" Jun 03 21:39:20.312632 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.312599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/kube-rbac-proxy-web/0.log" Jun 03 21:39:20.341240 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.341213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/kube-rbac-proxy/0.log" Jun 03 21:39:20.365781 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.365727 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/kube-rbac-proxy-metric/0.log" Jun 03 21:39:20.412047 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.412020 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/prom-label-proxy/0.log" Jun 03 21:39:20.456968 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.456942 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b77f9dc9-2f93-4c97-8895-2d593649563a/init-config-reloader/0.log" Jun 03 21:39:20.686634 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.686608 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74x2l_879bb6ee-26ff-48b5-97a5-2af534c3995e/node-exporter/0.log" Jun 03 21:39:20.708884 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.708852 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74x2l_879bb6ee-26ff-48b5-97a5-2af534c3995e/kube-rbac-proxy/0.log" Jun 03 21:39:20.731843 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.731817 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74x2l_879bb6ee-26ff-48b5-97a5-2af534c3995e/init-textfile/0.log" Jun 03 21:39:20.924861 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.924827 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-g9d8f_7aa681d8-d40f-41b6-9329-ffb6108e63c1/kube-rbac-proxy-main/0.log" Jun 03 21:39:20.956955 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.956886 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-g9d8f_7aa681d8-d40f-41b6-9329-ffb6108e63c1/kube-rbac-proxy-self/0.log" Jun 03 21:39:20.986244 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:20.986214 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-g9d8f_7aa681d8-d40f-41b6-9329-ffb6108e63c1/openshift-state-metrics/0.log" Jun 03 21:39:21.400612 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.400586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7485f945f8-p6gvv_0440cae2-beff-497a-830e-52367e451783/telemeter-client/0.log" Jun 03 21:39:21.430658 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.430631 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7485f945f8-p6gvv_0440cae2-beff-497a-830e-52367e451783/reload/0.log" Jun 03 21:39:21.453241 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.453202 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7485f945f8-p6gvv_0440cae2-beff-497a-830e-52367e451783/kube-rbac-proxy/0.log" Jun 03 21:39:21.489127 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.489090 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b6d4648f-6tdqm_90f7833f-e303-45a0-a057-7521d9153ba3/thanos-query/0.log" Jun 03 21:39:21.515730 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.515688 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b6d4648f-6tdqm_90f7833f-e303-45a0-a057-7521d9153ba3/kube-rbac-proxy-web/0.log" Jun 03 21:39:21.537852 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.537817 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b6d4648f-6tdqm_90f7833f-e303-45a0-a057-7521d9153ba3/kube-rbac-proxy/0.log" Jun 03 21:39:21.561249 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.561224 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b6d4648f-6tdqm_90f7833f-e303-45a0-a057-7521d9153ba3/prom-label-proxy/0.log" Jun 03 21:39:21.585595 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.585565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b6d4648f-6tdqm_90f7833f-e303-45a0-a057-7521d9153ba3/kube-rbac-proxy-rules/0.log" Jun 03 21:39:21.607453 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:21.607424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b6d4648f-6tdqm_90f7833f-e303-45a0-a057-7521d9153ba3/kube-rbac-proxy-metrics/0.log" Jun 03 21:39:25.003451 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.003409 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4"] Jun 03 21:39:25.004088 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.004058 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95f22dc5-8e29-4429-94e8-3c7eb26bc074" containerName="manager" Jun 03 21:39:25.004221 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.004090 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="95f22dc5-8e29-4429-94e8-3c7eb26bc074" containerName="manager" Jun 03 21:39:25.004221 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.004111 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3eaa6f4-f603-4397-926e-001158f180d8" containerName="authorino" Jun 03 21:39:25.004221 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.004120 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3eaa6f4-f603-4397-926e-001158f180d8" containerName="authorino" Jun 03 21:39:25.004377 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.004233 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="95f22dc5-8e29-4429-94e8-3c7eb26bc074" containerName="manager" Jun 03 21:39:25.004377 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.004248 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3eaa6f4-f603-4397-926e-001158f180d8" containerName="authorino" Jun 03 21:39:25.007304 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.007284 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.009796 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.009775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wwj5f\"/\"kube-root-ca.crt\"" Jun 03 21:39:25.009960 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.009942 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wwj5f\"/\"default-dockercfg-lt4ng\"" Jun 03 21:39:25.010929 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.010910 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wwj5f\"/\"openshift-service-ca.crt\"" Jun 03 21:39:25.016853 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.016830 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4"] Jun 03 21:39:25.068183 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.068143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-podres\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.068377 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.068194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-lib-modules\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.068377 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.068290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-sys\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.068377 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.068324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-proc\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.068377 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.068344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfgt\" (UniqueName: \"kubernetes.io/projected/3939f3da-133b-4bea-acbc-3b6191014f30-kube-api-access-ktfgt\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.168958 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.168914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-podres\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169146 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.168976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-lib-modules\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169146 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-sys\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169146 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-podres\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169146 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-proc\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169341 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169164 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-lib-modules\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169341 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfgt\" (UniqueName: \"kubernetes.io/projected/3939f3da-133b-4bea-acbc-3b6191014f30-kube-api-access-ktfgt\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169341 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-sys\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.169341 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.169181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3939f3da-133b-4bea-acbc-3b6191014f30-proc\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.177850 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.177823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfgt\" (UniqueName: \"kubernetes.io/projected/3939f3da-133b-4bea-acbc-3b6191014f30-kube-api-access-ktfgt\") pod \"perf-node-gather-daemonset-kvzf4\" (UID: \"3939f3da-133b-4bea-acbc-3b6191014f30\") " pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.317888 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.317795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.457773 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.457724 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4"] Jun 03 21:39:25.459807 ip-10-0-135-120 kubenswrapper[2579]: W0603 21:39:25.459776 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3939f3da_133b_4bea_acbc_3b6191014f30.slice/crio-f240a62a8fc4871a51ab7a188a8f7b9d9e5efbf84e743817bc7a4bbb07384b1f WatchSource:0}: Error finding container f240a62a8fc4871a51ab7a188a8f7b9d9e5efbf84e743817bc7a4bbb07384b1f: Status 404 returned error can't find the container with id f240a62a8fc4871a51ab7a188a8f7b9d9e5efbf84e743817bc7a4bbb07384b1f Jun 03 21:39:25.900993 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.900883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" event={"ID":"3939f3da-133b-4bea-acbc-3b6191014f30","Type":"ContainerStarted","Data":"d6eeaddb195b982de8b4a179a1af997e2f73c2e1252b228ed9848ac41925657b"} Jun 03 21:39:25.900993 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.900948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" event={"ID":"3939f3da-133b-4bea-acbc-3b6191014f30","Type":"ContainerStarted","Data":"f240a62a8fc4871a51ab7a188a8f7b9d9e5efbf84e743817bc7a4bbb07384b1f"} Jun 03 21:39:25.901190 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.901106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:25.917735 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:25.917674 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" podStartSLOduration=1.9176559819999999 podStartE2EDuration="1.917655982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:25.917453735 +0000 UTC m=+2168.325217229" watchObservedRunningTime="2026-06-03 21:39:25.917655982 +0000 UTC m=+2168.325419479" Jun 03 21:39:26.080209 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:26.080179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nbmlj_d6d6475b-45e6-41a3-bd04-b0d52c3dc36b/dns/0.log" Jun 03 21:39:26.101723 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:26.101699 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nbmlj_d6d6475b-45e6-41a3-bd04-b0d52c3dc36b/kube-rbac-proxy/0.log" Jun 03 21:39:26.222366 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:26.222336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pg4px_e42338e2-7f1b-4e1f-ac6f-435120ad5d7b/dns-node-resolver/0.log" Jun 03 21:39:26.745117 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:26.745084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-859c8d746b-fsw9g_199a3043-a52b-4066-b15f-f4462191eeca/registry/0.log" Jun 03 21:39:26.789919 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:26.789886 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sz9zs_3612e48c-9a99-4e0a-9a43-9bea4eaedd89/node-ca/0.log" Jun 03 21:39:27.709725 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:27.709690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gr5kn_d2431081-3a8a-4ccc-a65a-2af18cf77920/istio-proxy/0.log" Jun 03 21:39:27.932042 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:27.932004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/0.log" Jun 03 21:39:27.964390 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:27.964305 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/1.log" Jun 03 21:39:28.675122 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:28.675095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fkrw_05106a86-9f0e-450f-b001-75f9027ba521/serve-healthcheck-canary/0.log" Jun 03 21:39:29.406309 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:29.406272 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k65zq_cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93/kube-rbac-proxy/0.log" Jun 03 21:39:29.427428 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:29.427398 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k65zq_cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93/exporter/0.log" Jun 03 21:39:29.448876 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:29.448824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k65zq_cc3d0dad-8ba7-4a0e-ba64-5152d74e0d93/extractor/0.log" Jun 03 21:39:31.746040 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:31.746008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64d8cdd79c-6xqgm_4e993961-2eca-4856-aa8d-5a17d0780ac9/nginx/0.log" Jun 03 21:39:31.918056 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:31.918026 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wwj5f/perf-node-gather-daemonset-kvzf4" Jun 03 21:39:31.972054 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:31.972022 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f75d9d46c-kdfsw_5be38bbd-7135-4af8-8c7f-79221dec326a/maas-api/0.log" Jun 03 21:39:32.296707 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:32.296675 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-5xmjh_290ac81a-9d78-416a-a91c-aaa15b6b6a23/manager/0.log" Jun 03 21:39:32.408019 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:32.407981 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl_f556742f-7162-4831-a0ee-034a121b949f/manager/0.log" Jun 03 21:39:32.443471 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:32.443444 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd94fd8d9-4g8tl_f556742f-7162-4831-a0ee-034a121b949f/copy-manifests/0.log" Jun 03 21:39:34.397869 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:34.397831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57c88bd5b4-fzk82_f5406f3e-3b49-4e8b-a337-b16b45d1f03a/manager/0.log" Jun 03 21:39:37.601089 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:37.601059 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gr5kn_d2431081-3a8a-4ccc-a65a-2af18cf77920/istio-proxy/0.log" Jun 03 21:39:37.788134 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:37.788104 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/0.log" Jun 03 21:39:37.824834 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:37.824802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/1.log" Jun 03 21:39:39.063709 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:39.063674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gr5kn_d2431081-3a8a-4ccc-a65a-2af18cf77920/istio-proxy/0.log" Jun 03 21:39:39.255685 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:39.255650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/0.log" Jun 03 21:39:39.290076 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:39.290038 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/1.log" Jun 03 21:39:41.051770 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.051731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795gr5kn_d2431081-3a8a-4ccc-a65a-2af18cf77920/istio-proxy/0.log" Jun 03 21:39:41.240728 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.240692 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/0.log" Jun 03 21:39:41.272036 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.272000 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lgktm_7c3cf22d-12d2-4eb2-91cf-5e4bbe9d53cf/istio-proxy/1.log" Jun 03 21:39:41.668431 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.668405 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/kube-multus-additional-cni-plugins/0.log" Jun 03 21:39:41.693926 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.693895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/egress-router-binary-copy/0.log" Jun 03 21:39:41.717195 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.717165 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/cni-plugins/0.log" Jun 03 21:39:41.738259 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.738228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/bond-cni-plugin/0.log" Jun 03 21:39:41.759946 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.759912 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/routeoverride-cni/0.log" Jun 03 21:39:41.782488 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.782459 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/whereabouts-cni-bincopy/0.log" Jun 03 21:39:41.805162 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:41.805126 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxvrq_829e950d-fac9-4e3a-adb2-714d47920218/whereabouts-cni/0.log" Jun 03 21:39:42.083455 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:42.083426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xpvqm_7701e63f-aba1-45cc-bcd0-28d0ce89ef0d/kube-multus/0.log" Jun 03 21:39:42.154032 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:42.154003 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wgmqq_4a29ca40-5f62-4e6a-9d30-f3275493d903/network-metrics-daemon/0.log" Jun 03 21:39:42.175447 ip-10-0-135-120 kubenswrapper[2579]: I0603 21:39:42.175415 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wgmqq_4a29ca40-5f62-4e6a-9d30-f3275493d903/kube-rbac-proxy/0.log"