Jun 15 09:11:20.783899 ip-10-0-141-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 09:11:20.783913 ip-10-0-141-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 09:11:20.783921 ip-10-0-141-4 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 09:11:20.784210 ip-10-0-141-4 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 09:11:30.986021 ip-10-0-141-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 09:11:30.986035 ip-10-0-141-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 79f4a6770d714982827a93107b01af58 -- Jun 15 09:13:35.946013 ip-10-0-141-4 systemd[1]: Starting Kubernetes Kubelet... Jun 15 09:13:36.263695 ip-10-0-141-4 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 09:13:36.263695 ip-10-0-141-4 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 09:13:36.263695 ip-10-0-141-4 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 09:13:36.263695 ip-10-0-141-4 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 09:13:36.263695 ip-10-0-141-4 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 09:13:36.265793 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.265704 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 09:13:36.269577 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269562 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 09:13:36.269577 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269577 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269580 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269584 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269586 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269589 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269592 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269596 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269600 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269603 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269606 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269608 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269611 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269614 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269616 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269619 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269621 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269624 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269626 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269629 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 09:13:36.269637 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269635 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269637 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269641 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269644 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269646 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269649 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269652 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269655 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269658 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269660 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269663 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269665 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269668 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269670 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269673 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269675 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269678 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269680 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269683 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269685 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 09:13:36.270103 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269688 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269690 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269693 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269695 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269698 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269700 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269702 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269706 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269709 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269711 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269714 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269716 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269719 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269722 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269725 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269728 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269731 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269746 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269749 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269752 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 09:13:36.270606 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269754 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269757 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269760 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269762 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269765 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269767 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269770 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269773 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269775 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269778 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269780 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269783 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269785 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269788 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269791 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269793 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269796 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269798 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269800 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269804 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 09:13:36.271137 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269806 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269809 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269811 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269814 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269816 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269819 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269825 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269828 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269831 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269834 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269838 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269841 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269844 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269847 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269850 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269852 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269855 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269857 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.269860 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 09:13:36.271627 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270523 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270529 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270532 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270536 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270539 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270542 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270544 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270547 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270549 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270552 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270554 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270557 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270559 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270562 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270564 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270567 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270569 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270572 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270575 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270578 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 09:13:36.272107 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270581 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270584 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270586 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270589 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270591 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270594 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270598 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270602 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270605 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270608 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270611 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270614 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270617 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270619 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270622 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270625 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270628 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270631 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270633 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270635 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 09:13:36.272631 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270638 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270640 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270643 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270646 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270648 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270650 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270653 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270655 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270658 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270660 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270663 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270666 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270668 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270671 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270673 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270676 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270679 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270681 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270684 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270687 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 09:13:36.273192 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270691 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270694 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270696 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270699 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270703 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270707 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270710 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270713 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270716 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270719 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270721 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270724 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270726 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270729 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270751 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270754 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270757 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270762 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 09:13:36.273678 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270765 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270768 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270771 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270774 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270777 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270780 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270782 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270785 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270788 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270790 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270793 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270796 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270799 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270801 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270804 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270807 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270809 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270812 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270814 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.270817 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 09:13:36.274166 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271171 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271176 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271179 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271181 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271184 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271187 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271189 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271192 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271195 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271197 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271200 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271202 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271206 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271210 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271212 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271217 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271220 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271223 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271226 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 09:13:36.274644 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271229 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271232 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271234 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271237 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271240 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271243 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271245 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271248 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271251 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271253 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271256 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271258 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271261 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271264 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271266 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271269 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271272 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271274 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271277 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 09:13:36.275122 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271279 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271282 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271284 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271287 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271289 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271292 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271294 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271296 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271299 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271303 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271306 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271309 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271311 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271314 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271316 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271319 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271321 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271325 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271327 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271330 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 09:13:36.275583 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271332 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271335 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271339 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271342 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271345 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271348 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271350 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271353 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271355 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271358 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271361 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271363 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271365 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271368 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271370 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271373 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271375 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271378 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271380 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271383 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 09:13:36.276078 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271385 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271389 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271393 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271396 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271398 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271401 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271403 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271406 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271408 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271410 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271413 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271415 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271418 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271420 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271423 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271425 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271428 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271431 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271434 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271436 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 09:13:36.276568 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.271440 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271511 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271521 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271528 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271532 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271536 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271539 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271543 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271546 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271549 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271553 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271556 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271559 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271564 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271567 2572 flags.go:64] FLAG: --cgroup-root="" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271570 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271573 2572 flags.go:64] FLAG: --client-ca-file="" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271576 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271579 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271583 2572 flags.go:64] FLAG: --cluster-domain="" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271586 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271589 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271592 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271595 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 09:13:36.277051 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271598 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271601 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271604 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271607 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271610 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271613 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271616 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271619 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271622 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271626 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271630 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271633 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271636 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271639 2572 flags.go:64] FLAG: --enable-server="true" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271643 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271647 2572 flags.go:64] FLAG: --event-burst="100" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271650 2572 flags.go:64] FLAG: --event-qps="50" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271653 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271656 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271659 2572 flags.go:64] FLAG: --eviction-hard="" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271662 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271667 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271670 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271673 2572 flags.go:64] FLAG: --eviction-soft="" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271676 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 09:13:36.277637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271679 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271682 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271685 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271688 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271690 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271693 2572 flags.go:64] FLAG: --feature-gates="" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271697 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271700 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271703 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271706 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271709 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271712 2572 flags.go:64] FLAG: --help="false" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271714 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271719 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271722 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271725 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271728 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271744 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271747 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271750 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271753 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271756 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271759 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271762 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 09:13:36.278331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271765 2572 flags.go:64] FLAG: --kube-reserved="" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271768 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271771 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271774 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271778 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271781 2572 flags.go:64] FLAG: --lock-file="" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271784 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271787 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271790 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271795 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271798 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271801 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271803 2572 flags.go:64] FLAG: --logging-format="text" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271806 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271809 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271812 2572 flags.go:64] FLAG: --manifest-url="" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271815 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271819 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271822 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271826 2572 flags.go:64] FLAG: --max-pods="110" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271829 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271832 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271835 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271838 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271841 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 09:13:36.278945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271844 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271847 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271854 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271857 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271860 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271863 2572 flags.go:64] FLAG: --pod-cidr="" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271866 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271871 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271874 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271877 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271880 2572 flags.go:64] FLAG: --port="10250" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271884 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271887 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f6ddcc791dbc5ec8" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271890 2572 flags.go:64] FLAG: --qos-reserved="" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271893 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271896 2572 flags.go:64] FLAG: --register-node="true" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271899 2572 flags.go:64] FLAG: --register-with-taints="" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271902 2572 flags.go:64] FLAG: --registry-burst="10" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271905 2572 flags.go:64] FLAG: --registry-qps="5" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271907 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271910 2572 flags.go:64] FLAG: --reserved-memory="" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271914 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271917 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271920 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271922 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 09:13:36.279572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271925 2572 flags.go:64] FLAG: --runonce="false" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271928 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271931 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271934 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271938 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271940 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271943 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271946 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271949 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271952 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271955 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271958 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271961 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271964 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271968 2572 flags.go:64] FLAG: --system-cgroups="" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271970 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271975 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271978 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271982 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271986 2572 flags.go:64] FLAG: --tls-min-version="" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271989 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271992 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271994 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.271997 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.272000 2572 flags.go:64] FLAG: --v="2" Jun 15 09:13:36.280188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.272004 2572 flags.go:64] FLAG: --version="false" Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.272008 2572 flags.go:64] FLAG: --vmodule="" Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.272011 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.272014 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272138 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272142 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272145 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272148 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272153 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272156 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272159 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272164 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272167 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272169 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272172 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272175 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272178 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272181 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272184 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272186 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 09:13:36.280816 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272189 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272192 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272194 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272196 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272199 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272203 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272206 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272208 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272210 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272213 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272215 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272218 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272221 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272223 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272226 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272228 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272230 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272233 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272236 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272238 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 09:13:36.281520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272240 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272243 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272245 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272249 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272252 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272254 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272257 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272259 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272263 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272266 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272269 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272272 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272274 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272277 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272280 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272282 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272285 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272292 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272294 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 09:13:36.282195 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272297 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272300 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272302 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272305 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272307 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272310 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272312 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272315 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272317 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272320 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272322 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272325 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272328 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272330 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272333 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272335 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272340 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272343 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272345 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272348 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 09:13:36.282687 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272351 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272353 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272356 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272358 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272361 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272363 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272366 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272369 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272371 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272374 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272378 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272381 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272384 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272386 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272389 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272393 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272396 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272399 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272402 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272405 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 09:13:36.283212 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272408 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272410 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272413 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.272415 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.273232 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.280864 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.282215 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.283660 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 09:13:36.283711 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.283678 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283759 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283766 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283770 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283773 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283776 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283779 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283782 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283784 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283787 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283790 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283793 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283796 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283798 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283801 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283804 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283806 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283809 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283811 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283814 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 09:13:36.283935 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283817 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283820 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283822 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283825 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283828 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283830 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283833 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283836 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283838 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283841 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283845 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283847 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283850 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283853 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283855 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283858 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283862 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283866 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283869 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 09:13:36.284498 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283871 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283875 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283878 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283880 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283883 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283886 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283888 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283891 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283894 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283897 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283900 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283903 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283905 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283908 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283911 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283913 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283917 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283920 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283923 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 09:13:36.284973 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283926 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283929 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283931 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283934 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283937 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283940 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283943 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283946 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283949 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283952 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283955 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283958 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283961 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283963 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283966 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283969 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283971 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283974 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283976 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283979 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 09:13:36.285452 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283981 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283984 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283987 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283989 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283993 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.283997 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284000 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284002 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284005 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284008 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284010 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284013 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284015 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284018 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284020 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284023 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284026 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284028 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284030 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284033 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 09:13:36.285952 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284036 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284039 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.284044 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284161 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284165 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284169 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284171 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284174 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284177 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284179 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284182 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284185 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284188 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284190 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284193 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 09:13:36.286438 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284197 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284200 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284202 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284205 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284207 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284210 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284212 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284215 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284218 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284220 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284223 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284226 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284228 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284231 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284233 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284235 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284238 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284241 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284244 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284248 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 09:13:36.286845 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284251 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284254 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284257 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284260 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284262 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284265 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284269 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284272 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284275 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284277 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284280 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284283 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284285 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284289 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284291 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284294 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284296 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284299 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284301 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284304 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 09:13:36.287345 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284306 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284309 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284311 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284314 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284316 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284319 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284321 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284324 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284328 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284330 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284333 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284336 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284339 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284342 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284344 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284347 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284349 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284352 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284355 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 09:13:36.287855 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284357 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284360 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284362 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284365 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284367 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284370 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284372 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284375 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284377 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284380 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284382 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284385 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284387 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284390 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284392 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284395 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284397 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284400 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284402 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284405 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 09:13:36.288349 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284407 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284410 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284412 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284414 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284417 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284420 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284422 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:36.284425 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.284430 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.284530 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 09:13:36.288884 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.287898 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 09:13:36.289576 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.289563 2572 server.go:1019] "Starting client certificate rotation" Jun 15 09:13:36.289677 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.289663 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 09:13:36.289710 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.289696 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 09:13:36.292475 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.292461 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 09:13:36.293776 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.293762 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 09:13:36.310294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.310273 2572 log.go:25] "Validated CRI v1 runtime API" Jun 15 09:13:36.314237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.314222 2572 log.go:25] "Validated CRI v1 image API" Jun 15 09:13:36.315074 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.315057 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 09:13:36.317845 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.317822 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 afebc2c9-b507-43d9-a4c7-67308dd7efe4:/dev/nvme0n1p4 b267f685-3bc0-423f-9f65-e423218e7609:/dev/nvme0n1p3] Jun 15 09:13:36.317931 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.317842 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 09:13:36.318987 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.318972 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 09:13:36.322749 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.322633 2572 manager.go:216] Machine: {Timestamp:2026-06-15 09:13:36.321247595 +0000 UTC m=+0.281088348 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109609 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2980209a58a01926b0435ba395c3ff SystemUUID:ec298020-9a58-a019-26b0-435ba395c3ff BootID:79f4a677-0d71-4982-827a-93107b01af58 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:d5:f2:52:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:d5:f2:52:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:c8:6c:89:aa:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 09:13:36.322749 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.322745 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 09:13:36.322849 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.322815 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 09:13:36.324986 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.324964 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 09:13:36.325136 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.324988 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 09:13:36.326514 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.326504 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 09:13:36.326552 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.326517 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 09:13:36.326552 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.326524 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 09:13:36.327345 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.327334 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 09:13:36.329122 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.329107 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 09:13:36.334189 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334174 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 15 09:13:36.334298 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334289 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 09:13:36.334340 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334320 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 15 09:13:36.334340 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334332 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 09:13:36.334392 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334346 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 09:13:36.334392 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334354 2572 kubelet.go:398] "Adding apiserver pod source" Jun 15 09:13:36.334392 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334362 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 09:13:36.334688 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334676 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 09:13:36.334761 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.334707 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 09:13:36.337160 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.337144 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 09:13:36.338786 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338773 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 09:13:36.338839 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338803 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 09:13:36.338964 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338954 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 09:13:36.338996 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338970 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 09:13:36.338996 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338976 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 09:13:36.338996 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338981 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 09:13:36.338996 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338988 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 09:13:36.338996 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.338994 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 09:13:36.339666 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.339658 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 09:13:36.339700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.339667 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 09:13:36.339700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.339673 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 09:13:36.339700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.339678 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 09:13:36.339700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.339686 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 09:13:36.339700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.339693 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 09:13:36.341411 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.341399 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 09:13:36.341411 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.341411 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 09:13:36.344377 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.344364 2572 server.go:1268] "Started kubelet" Jun 15 09:13:36.344552 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.344498 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 09:13:36.344642 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.344569 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 09:13:36.344708 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.344684 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 09:13:36.345240 ip-10-0-141-4 systemd[1]: Started Kubernetes Kubelet. Jun 15 09:13:36.346668 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.346647 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 09:13:36.346773 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.346755 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 09:13:36.346827 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.346782 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 09:13:36.346827 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.346791 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 09:13:36.346887 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.346856 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 15 09:13:36.353472 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.353444 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 09:13:36.353816 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.353801 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 09:13:36.353816 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.353811 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 09:13:36.353941 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.353925 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.354604 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354586 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 09:13:36.354604 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354588 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 09:13:36.354753 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354617 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 09:13:36.354869 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354851 2572 factory.go:153] Registering CRI-O factory Jun 15 09:13:36.354869 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354869 2572 factory.go:223] Registration of the crio container factory successfully Jun 15 09:13:36.355005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354977 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 09:13:36.355005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354988 2572 factory.go:55] Registering systemd factory Jun 15 09:13:36.355005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.354996 2572 factory.go:223] Registration of the systemd container factory successfully Jun 15 09:13:36.355152 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.355016 2572 factory.go:103] Registering Raw factory Jun 15 09:13:36.355152 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.355029 2572 manager.go:1196] Started watching for new ooms in manager Jun 15 09:13:36.355152 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.353887 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-4.ec2.internal.18b936495e4cbac1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-4.ec2.internal,UID:ip-10-0-141-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-4.ec2.internal,},FirstTimestamp:2026-06-15 09:13:36.344341185 +0000 UTC m=+0.304181939,LastTimestamp:2026-06-15 09:13:36.344341185 +0000 UTC m=+0.304181939,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-4.ec2.internal,}" Jun 15 09:13:36.355770 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.355755 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 15 09:13:36.355808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.355773 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 15 09:13:36.355983 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.355970 2572 manager.go:349] Starting recovery of all containers Jun 15 09:13:36.367148 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.366985 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 09:13:36.367256 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.367189 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 09:13:36.367820 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.367805 2572 manager.go:354] Recovery completed Jun 15 09:13:36.369059 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.369040 2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 15 09:13:36.370948 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.370928 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4h7f" Jun 15 09:13:36.371901 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.371887 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.375457 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.375441 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.375545 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.375472 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.375545 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.375486 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.376095 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376078 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 09:13:36.376095 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376095 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 09:13:36.376203 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376114 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 15 09:13:36.376203 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376114 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.376863 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376848 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4h7f" Jun 15 09:13:36.376942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376895 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.376942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376918 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.376942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.376933 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.378358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.378343 2572 policy_none.go:49] "None policy: Start" Jun 15 09:13:36.378358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.378359 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 09:13:36.378441 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.378369 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 09:13:36.380227 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.380216 2572 policy_none.go:47] "Start" Jun 15 09:13:36.424274 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424260 2572 manager.go:337] "Starting Device Plugin manager" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.424288 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424301 2572 server.go:87] "Starting device plugin registration server" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424520 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424533 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424649 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424758 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.424770 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.425563 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.425611 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.431053 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.432181 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.432207 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.432223 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.432251 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 09:13:36.444188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.433905 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 09:13:36.525082 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.525027 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.525875 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.525861 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.525942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.525887 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.525942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.525899 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.525942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.525924 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.532510 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.532493 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal"] Jun 15 09:13:36.532587 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.532554 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.534005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.533991 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.534074 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.534017 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.534074 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.534026 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.536199 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.536188 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.536303 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.536290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.536340 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.536316 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.536589 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.536578 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.536622 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.536595 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-4.ec2.internal\": node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.537179 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.537165 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.537242 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.537165 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.537242 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.537219 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.537242 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.537234 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.537242 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.537191 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.537352 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.537263 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.539476 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.539460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.539560 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.539492 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 09:13:36.540207 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.540192 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientMemory" Jun 15 09:13:36.540281 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.540214 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 09:13:36.540281 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.540225 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeHasSufficientPID" Jun 15 09:13:36.556226 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.556210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8921aa51ea1d7702a00f526b6904c809-config\") pod \"kube-apiserver-proxy-ip-10-0-141-4.ec2.internal\" (UID: \"8921aa51ea1d7702a00f526b6904c809\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.556286 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.556233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f7b0c028b43c60e73e394a8c9cbff2d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal\" (UID: \"8f7b0c028b43c60e73e394a8c9cbff2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.556286 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.556247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7b0c028b43c60e73e394a8c9cbff2d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal\" (UID: \"8f7b0c028b43c60e73e394a8c9cbff2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.558445 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.558430 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.568980 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.568966 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-4.ec2.internal\" not found" node="ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.573238 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.573223 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-4.ec2.internal\" not found" node="ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.656961 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.656938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8921aa51ea1d7702a00f526b6904c809-config\") pod \"kube-apiserver-proxy-ip-10-0-141-4.ec2.internal\" (UID: \"8921aa51ea1d7702a00f526b6904c809\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.657063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.656968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f7b0c028b43c60e73e394a8c9cbff2d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal\" (UID: \"8f7b0c028b43c60e73e394a8c9cbff2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.657063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.656992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7b0c028b43c60e73e394a8c9cbff2d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal\" (UID: \"8f7b0c028b43c60e73e394a8c9cbff2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.657063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.657022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8921aa51ea1d7702a00f526b6904c809-config\") pod \"kube-apiserver-proxy-ip-10-0-141-4.ec2.internal\" (UID: \"8921aa51ea1d7702a00f526b6904c809\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.657063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.657041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f7b0c028b43c60e73e394a8c9cbff2d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal\" (UID: \"8f7b0c028b43c60e73e394a8c9cbff2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.657063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.657023 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7b0c028b43c60e73e394a8c9cbff2d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal\" (UID: \"8f7b0c028b43c60e73e394a8c9cbff2d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.659052 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.659035 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.759585 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.759568 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.860329 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.860283 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:36.872444 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.872426 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.878313 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:36.878298 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:36.960644 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:36.960621 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:37.061125 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:37.061093 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:37.161678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:37.161625 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:37.262072 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:37.262054 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:37.289221 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.289196 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 09:13:37.289692 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.289364 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 09:13:37.362846 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:37.362825 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-4.ec2.internal\" not found" Jun 15 09:13:37.382519 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.382479 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 09:08:36 +0000 UTC" deadline="2028-02-03 18:54:05.62762272 +0000 UTC" Jun 15 09:13:37.382519 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.382516 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14361h40m28.245109882s" Jun 15 09:13:37.425993 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:37.425962 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7b0c028b43c60e73e394a8c9cbff2d.slice/crio-41cd6659e7bfe6f49a2e7ec105f1731ee760b21cf9c4b848f533a95b793ae88e WatchSource:0}: Error finding container 41cd6659e7bfe6f49a2e7ec105f1731ee760b21cf9c4b848f533a95b793ae88e: Status 404 returned error can't find the container with id 41cd6659e7bfe6f49a2e7ec105f1731ee760b21cf9c4b848f533a95b793ae88e Jun 15 09:13:37.432273 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.432256 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 09:13:37.436414 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:37.436390 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8921aa51ea1d7702a00f526b6904c809.slice/crio-517cfb9d37b807a3110cd516c95b8ebdd54f014dd51becbb006befc641abe80c WatchSource:0}: Error finding container 517cfb9d37b807a3110cd516c95b8ebdd54f014dd51becbb006befc641abe80c: Status 404 returned error can't find the container with id 517cfb9d37b807a3110cd516c95b8ebdd54f014dd51becbb006befc641abe80c Jun 15 09:13:37.436554 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.436511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" event={"ID":"8f7b0c028b43c60e73e394a8c9cbff2d","Type":"ContainerStarted","Data":"41cd6659e7bfe6f49a2e7ec105f1731ee760b21cf9c4b848f533a95b793ae88e"} Jun 15 09:13:37.450439 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.450421 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 09:13:37.453937 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.453919 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" Jun 15 09:13:37.454024 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.454010 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 09:13:37.467004 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.466986 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 09:13:37.468048 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.468035 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" Jun 15 09:13:37.476185 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.476174 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 09:13:37.762788 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:37.762708 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 09:13:38.336190 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.336164 2572 apiserver.go:52] "Watching apiserver" Jun 15 09:13:38.342324 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.342301 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 09:13:38.343745 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.343680 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-cvd6z","openshift-network-operator/iptables-alerter-qms6f","kube-system/konnectivity-agent-pngx4","kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bd5mg","openshift-dns/node-resolver-zp9wx","openshift-network-diagnostics/network-check-target-94648","openshift-ovn-kubernetes/ovnkube-node-qqzs7","kube-system/global-pull-secret-syncer-m568z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd","openshift-image-registry/node-ca-d8pd6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal","openshift-multus/multus-additional-cni-plugins-c9l7t","openshift-multus/multus-w8mmc"] Jun 15 09:13:38.345974 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.345952 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.348193 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.348172 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 09:13:38.348193 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.348183 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.348342 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.348296 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hdq4j\"" Jun 15 09:13:38.348342 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.348297 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.348821 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.348801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.350751 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.350721 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 09:13:38.350841 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.350754 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.350841 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.350788 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65f4n\"" Jun 15 09:13:38.351079 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.351040 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 09:13:38.351079 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.351040 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 09:13:38.351079 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.351074 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.351265 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.351175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.352937 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.352921 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 09:13:38.353028 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.352938 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gpsn9\"" Jun 15 09:13:38.353028 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.352938 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 09:13:38.353527 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.353510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.354895 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.354872 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 09:13:38.358043 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.357711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.358043 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.357773 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mpf2p\"" Jun 15 09:13:38.358043 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.357800 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 09:13:38.359685 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.359666 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.359685 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.359679 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-85grt\"" Jun 15 09:13:38.359896 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.359669 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.360091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.360072 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.361937 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.361918 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.362017 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.361921 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.362017 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.361928 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wzhlj\"" Jun 15 09:13:38.362284 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.362266 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.362366 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.362337 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:38.364381 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.364364 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 09:13:38.364639 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.364620 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:38.364707 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.364685 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:38.365438 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-multus-certs\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.365520 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-host\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.365520 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd46n\" (UniqueName: \"kubernetes.io/projected/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-kube-api-access-bd46n\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.365520 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-system-cni-dir\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.365669 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-cnibin\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.365669 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-os-release\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.365669 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365566 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-cni-bin\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.365669 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-tuned\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.365669 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-registration-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-device-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-systemd\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-hostroot\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-conf-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-etc-kubernetes\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.365900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-var-lib-kubelet\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-tmp\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-socket-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-socket-dir-parent\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-kubelet\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.365989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-modprobe-d\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysconfig\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-lib-modules\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-etc-selinux\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-os-release\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmgq6\" (UniqueName: \"kubernetes.io/projected/653d3b81-5827-4082-8d58-1e08e86add96-kube-api-access-cmgq6\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-cnibin\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysctl-d\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysctl-conf\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbxwk\" (UniqueName: \"kubernetes.io/projected/714412fb-93c2-445e-b732-fe70b8861ab7-kube-api-access-qbxwk\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/316df621-9c9f-42c8-9765-323288a7f85a-agent-certs\") pod \"konnectivity-agent-pngx4\" (UID: \"316df621-9c9f-42c8-9765-323288a7f85a\") " pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-cni-multus\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366345 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7zb\" (UniqueName: \"kubernetes.io/projected/874cf913-64bf-4f20-81a5-b7aa67b38486-kube-api-access-hn7zb\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-cni-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/874cf913-64bf-4f20-81a5-b7aa67b38486-cni-binary-copy\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366414 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-netns\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-daemon-config\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366489 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-kubernetes\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-run\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-sys\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-sys-fs\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.366855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/316df621-9c9f-42c8-9765-323288a7f85a-konnectivity-ca\") pod \"konnectivity-agent-pngx4\" (UID: \"316df621-9c9f-42c8-9765-323288a7f85a\") " pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.367509 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-system-cni-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.367509 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.366624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-k8s-cni-cncf-io\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.367509 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.367004 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.369824 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.369806 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:38.369917 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.369873 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:38.372052 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.372024 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.372143 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.372091 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 09:13:38.372143 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.372118 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.372527 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.372508 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qt94w\"" Jun 15 09:13:38.372600 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.372529 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.374015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.373987 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.374116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.374097 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 09:13:38.374182 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.374166 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.374270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.374245 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-94hjd\"" Jun 15 09:13:38.374556 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.374543 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.376921 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.376568 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 09:13:38.376921 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.376586 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 09:13:38.376921 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.376610 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 09:13:38.376921 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.376625 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 09:13:38.376921 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.376676 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 09:13:38.376921 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.376686 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 09:13:38.377280 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.377000 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s65f5\"" Jun 15 09:13:38.391105 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.391086 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nzcwk" Jun 15 09:13:38.400988 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.400972 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nzcwk" Jun 15 09:13:38.439372 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.439313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" event={"ID":"8921aa51ea1d7702a00f526b6904c809","Type":"ContainerStarted","Data":"517cfb9d37b807a3110cd516c95b8ebdd54f014dd51becbb006befc641abe80c"} Jun 15 09:13:38.455724 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.455702 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 09:13:38.467104 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-host\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.467194 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-system-cni-dir\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.467194 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-hosts-file\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.467194 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5v74\" (UniqueName: \"kubernetes.io/projected/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-kube-api-access-k5v74\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.467194 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467172 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f863db5e-dfa7-4d46-89ad-bcc425f0333c-host\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f863db5e-dfa7-4d46-89ad-bcc425f0333c-serviceca\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-host\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467215 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-system-cni-dir\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-etc-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-os-release\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-cni-bin\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467340 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-os-release\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-registration-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467348 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-cni-bin\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467394 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-registration-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.467409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-kubelet-config\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-cni-netd\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-tmp-dir\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-systemd\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-conf-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-etc-kubernetes\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-var-lib-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467618 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-etc-kubernetes\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467586 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-systemd\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467641 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-socket-dir-parent\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-modprobe-d\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-os-release\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467715 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-socket-dir-parent\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468015 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-iptables-alerter-script\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-os-release\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-modprobe-d\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vw2x\" (UniqueName: \"kubernetes.io/projected/244c5a6c-9683-4cdf-90a6-a70f39c018ef-kube-api-access-6vw2x\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-conf-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysctl-d\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-node-log\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovnkube-config\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/316df621-9c9f-42c8-9765-323288a7f85a-agent-certs\") pod \"konnectivity-agent-pngx4\" (UID: \"316df621-9c9f-42c8-9765-323288a7f85a\") " pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.467981 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysctl-d\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl4lc\" (UniqueName: \"kubernetes.io/projected/f863db5e-dfa7-4d46-89ad-bcc425f0333c-kube-api-access-zl4lc\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-systemd\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468070 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-ovn\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-netns\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.468673 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-daemon-config\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-sys-fs\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468216 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468236 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-netns\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468259 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-sys-fs\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-cni-bin\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovn-node-metrics-cert\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-system-cni-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-k8s-cni-cncf-io\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd46n\" (UniqueName: \"kubernetes.io/projected/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-kube-api-access-bd46n\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-cnibin\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-k8s-cni-cncf-io\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-system-cni-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-host-slash\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-slash\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.469487 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/653d3b81-5827-4082-8d58-1e08e86add96-cnibin\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-run-netns\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-kubelet\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468695 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-log-socket\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468756 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-tuned\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-device-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-systemd-units\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-daemon-config\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4pv\" (UniqueName: \"kubernetes.io/projected/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-kube-api-access-6s4pv\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-hostroot\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-var-lib-kubelet\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-device-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-tmp\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-socket-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468957 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-hostroot\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468912 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.470277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-var-lib-kubelet\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.468978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmgq6\" (UniqueName: \"kubernetes.io/projected/653d3b81-5827-4082-8d58-1e08e86add96-kube-api-access-cmgq6\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-env-overrides\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-kubelet\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysconfig\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469061 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-socket-dir\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-kubelet\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-lib-modules\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469124 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-etc-selinux\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysconfig\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-dbus\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-cnibin\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469194 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysctl-conf\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxwk\" (UniqueName: \"kubernetes.io/projected/714412fb-93c2-445e-b732-fe70b8861ab7-kube-api-access-qbxwk\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-lib-modules\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrrs\" (UniqueName: \"kubernetes.io/projected/0b1550fb-2331-4d01-8b86-4762fb506edb-kube-api-access-xwrrs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469290 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-cnibin\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471091 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/714412fb-93c2-445e-b732-fe70b8861ab7-etc-selinux\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-cni-multus\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469342 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-sysctl-conf\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7zb\" (UniqueName: \"kubernetes.io/projected/874cf913-64bf-4f20-81a5-b7aa67b38486-kube-api-access-hn7zb\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469384 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-var-lib-cni-multus\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovnkube-script-lib\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-cni-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/874cf913-64bf-4f20-81a5-b7aa67b38486-cni-binary-copy\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-kubernetes\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469501 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-multus-cni-dir\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-run\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469545 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-kubernetes\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-run\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-sys\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469665 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-sys\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.471910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/316df621-9c9f-42c8-9765-323288a7f85a-konnectivity-ca\") pod \"konnectivity-agent-pngx4\" (UID: \"316df621-9c9f-42c8-9765-323288a7f85a\") " pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-multus-certs\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469903 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/874cf913-64bf-4f20-81a5-b7aa67b38486-host-run-multus-certs\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.469932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/874cf913-64bf-4f20-81a5-b7aa67b38486-cni-binary-copy\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.470201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/653d3b81-5827-4082-8d58-1e08e86add96-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.470341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/316df621-9c9f-42c8-9765-323288a7f85a-konnectivity-ca\") pod \"konnectivity-agent-pngx4\" (UID: \"316df621-9c9f-42c8-9765-323288a7f85a\") " pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.472215 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-etc-tuned\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.472726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.472716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/316df621-9c9f-42c8-9765-323288a7f85a-agent-certs\") pod \"konnectivity-agent-pngx4\" (UID: \"316df621-9c9f-42c8-9765-323288a7f85a\") " pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.473068 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.472914 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-tmp\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.477999 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.477945 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd46n\" (UniqueName: \"kubernetes.io/projected/8f4dbb85-dabb-4f48-8a29-51d7f6b621ad-kube-api-access-bd46n\") pod \"tuned-bd5mg\" (UID: \"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad\") " pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.478493 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.478470 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7zb\" (UniqueName: \"kubernetes.io/projected/874cf913-64bf-4f20-81a5-b7aa67b38486-kube-api-access-hn7zb\") pod \"multus-w8mmc\" (UID: \"874cf913-64bf-4f20-81a5-b7aa67b38486\") " pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.479067 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.478909 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmgq6\" (UniqueName: \"kubernetes.io/projected/653d3b81-5827-4082-8d58-1e08e86add96-kube-api-access-cmgq6\") pod \"multus-additional-cni-plugins-c9l7t\" (UID: \"653d3b81-5827-4082-8d58-1e08e86add96\") " pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.479161 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.479095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbxwk\" (UniqueName: \"kubernetes.io/projected/714412fb-93c2-445e-b732-fe70b8861ab7-kube-api-access-qbxwk\") pod \"aws-ebs-csi-driver-node-47tdd\" (UID: \"714412fb-93c2-445e-b732-fe70b8861ab7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.571012 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.570980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-systemd-units\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571012 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571019 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4pv\" (UniqueName: \"kubernetes.io/projected/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-kube-api-access-6s4pv\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.571217 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-env-overrides\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571217 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-dbus\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.571217 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-systemd-units\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571217 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571106 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrrs\" (UniqueName: \"kubernetes.io/projected/0b1550fb-2331-4d01-8b86-4762fb506edb-kube-api-access-xwrrs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:38.571409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-dbus\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.571409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovnkube-script-lib\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571282 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:38.571409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571409 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571350 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571409 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.571400 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-hosts-file\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.571497 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:13:39.071460046 +0000 UTC m=+3.031300786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571515 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-hosts-file\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571531 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-env-overrides\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571532 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5v74\" (UniqueName: \"kubernetes.io/projected/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-kube-api-access-k5v74\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571577 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f863db5e-dfa7-4d46-89ad-bcc425f0333c-host\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f863db5e-dfa7-4d46-89ad-bcc425f0333c-serviceca\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.571680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571649 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f863db5e-dfa7-4d46-89ad-bcc425f0333c-host\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-etc-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-kubelet-config\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-etc-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-cni-netd\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovnkube-script-lib\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-kubelet-config\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-tmp-dir\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571874 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-var-lib-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571894 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-cni-netd\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-var-lib-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571970 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f863db5e-dfa7-4d46-89ad-bcc425f0333c-serviceca\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.571997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-iptables-alerter-script\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vw2x\" (UniqueName: \"kubernetes.io/projected/244c5a6c-9683-4cdf-90a6-a70f39c018ef-kube-api-access-6vw2x\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-node-log\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572153 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.572060 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovnkube-config\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl4lc\" (UniqueName: \"kubernetes.io/projected/f863db5e-dfa7-4d46-89ad-bcc425f0333c-kube-api-access-zl4lc\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-tmp-dir\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.572114 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:39.072099188 +0000 UTC m=+3.031939944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-systemd\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-node-log\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-ovn\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-cni-bin\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovn-node-metrics-cert\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-host-slash\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-slash\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-run-netns\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572335 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-systemd\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572382 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-host-slash\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.572906 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-run-netns\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-slash\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572431 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-run-ovn\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572466 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-cni-bin\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-kubelet\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-iptables-alerter-script\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-log-socket\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-host-kubelet\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572605 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/244c5a6c-9683-4cdf-90a6-a70f39c018ef-log-socket\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.573542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.572614 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovnkube-config\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.574726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.574680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/244c5a6c-9683-4cdf-90a6-a70f39c018ef-ovn-node-metrics-cert\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.578778 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.578756 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:13:38.578778 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.578785 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:13:38.578940 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.578799 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:38.578940 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:38.578855 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:39.078839579 +0000 UTC m=+3.038680336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:38.580494 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.579959 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4pv\" (UniqueName: \"kubernetes.io/projected/81f0f2eb-a1c6-4853-89a9-7549e0ebbacc-kube-api-access-6s4pv\") pod \"node-resolver-zp9wx\" (UID: \"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc\") " pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.580494 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.580430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrrs\" (UniqueName: \"kubernetes.io/projected/0b1550fb-2331-4d01-8b86-4762fb506edb-kube-api-access-xwrrs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:38.580848 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.580825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5v74\" (UniqueName: \"kubernetes.io/projected/e3e6e418-21f7-4bd9-bf4d-6822682a0d0f-kube-api-access-k5v74\") pod \"iptables-alerter-qms6f\" (UID: \"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f\") " pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.581162 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.581139 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl4lc\" (UniqueName: \"kubernetes.io/projected/f863db5e-dfa7-4d46-89ad-bcc425f0333c-kube-api-access-zl4lc\") pod \"node-ca-d8pd6\" (UID: \"f863db5e-dfa7-4d46-89ad-bcc425f0333c\") " pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.581459 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.581430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vw2x\" (UniqueName: \"kubernetes.io/projected/244c5a6c-9683-4cdf-90a6-a70f39c018ef-kube-api-access-6vw2x\") pod \"ovnkube-node-qqzs7\" (UID: \"244c5a6c-9683-4cdf-90a6-a70f39c018ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.660369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.660343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" Jun 15 09:13:38.666597 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.666576 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" Jun 15 09:13:38.673318 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.673302 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:38.681067 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.681042 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w8mmc" Jun 15 09:13:38.686721 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.686700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" Jun 15 09:13:38.694270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.694219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zp9wx" Jun 15 09:13:38.699749 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.699721 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qms6f" Jun 15 09:13:38.706394 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.706372 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d8pd6" Jun 15 09:13:38.712125 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.712096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:13:38.809780 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:38.809758 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 09:13:39.076676 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:39.076587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:39.076837 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:39.076654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:39.076837 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.076768 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:39.076837 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.076786 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:39.076837 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.076835 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:13:40.076820481 +0000 UTC m=+4.036661223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:39.077060 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.076850 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:40.076844159 +0000 UTC m=+4.036684899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:39.177587 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:39.177554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:39.177784 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.177748 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:13:39.177784 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.177779 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:13:39.177926 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.177792 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:39.177926 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:39.177851 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:40.177837003 +0000 UTC m=+4.137677747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:39.404084 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:39.404004 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 09:08:38 +0000 UTC" deadline="2028-04-02 00:52:50.501634644 +0000 UTC" Jun 15 09:13:39.404084 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:39.404035 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15759h39m11.097602602s" Jun 15 09:13:39.542998 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.542845 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf863db5e_dfa7_4d46_89ad_bcc425f0333c.slice/crio-9e005d868dd968248bd3b5ca22c891193f6437f581fc89553e4dabff8a8b87f3 WatchSource:0}: Error finding container 9e005d868dd968248bd3b5ca22c891193f6437f581fc89553e4dabff8a8b87f3: Status 404 returned error can't find the container with id 9e005d868dd968248bd3b5ca22c891193f6437f581fc89553e4dabff8a8b87f3 Jun 15 09:13:39.543879 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.543852 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244c5a6c_9683_4cdf_90a6_a70f39c018ef.slice/crio-e206077dea310fddf5b03f45e94144d2f65f99fc432cc154c4f10794f9bd7f5a WatchSource:0}: Error finding container e206077dea310fddf5b03f45e94144d2f65f99fc432cc154c4f10794f9bd7f5a: Status 404 returned error can't find the container with id e206077dea310fddf5b03f45e94144d2f65f99fc432cc154c4f10794f9bd7f5a Jun 15 09:13:39.547793 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.547755 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e6e418_21f7_4bd9_bf4d_6822682a0d0f.slice/crio-d9d5b91941be05b916241613883476c3a2888250b4e53cb3f0e8da0971c1a738 WatchSource:0}: Error finding container d9d5b91941be05b916241613883476c3a2888250b4e53cb3f0e8da0971c1a738: Status 404 returned error can't find the container with id d9d5b91941be05b916241613883476c3a2888250b4e53cb3f0e8da0971c1a738 Jun 15 09:13:39.549810 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.549789 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316df621_9c9f_42c8_9765_323288a7f85a.slice/crio-c1b064625952a88747ed26752263bd7f048c8b8671126cf4e9d049fadecd4e08 WatchSource:0}: Error finding container c1b064625952a88747ed26752263bd7f048c8b8671126cf4e9d049fadecd4e08: Status 404 returned error can't find the container with id c1b064625952a88747ed26752263bd7f048c8b8671126cf4e9d049fadecd4e08 Jun 15 09:13:39.550119 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.550096 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653d3b81_5827_4082_8d58_1e08e86add96.slice/crio-19b5afe600a307d0d7aee8ed3b5d1f9fe6255216273c83b3297705b91c4da48f WatchSource:0}: Error finding container 19b5afe600a307d0d7aee8ed3b5d1f9fe6255216273c83b3297705b91c4da48f: Status 404 returned error can't find the container with id 19b5afe600a307d0d7aee8ed3b5d1f9fe6255216273c83b3297705b91c4da48f Jun 15 09:13:39.550711 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.550688 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874cf913_64bf_4f20_81a5_b7aa67b38486.slice/crio-19c0c2ec83294c5b9c7052553cd5b9c4fbd88446bea93092e3395aec17ce99d0 WatchSource:0}: Error finding container 19c0c2ec83294c5b9c7052553cd5b9c4fbd88446bea93092e3395aec17ce99d0: Status 404 returned error can't find the container with id 19c0c2ec83294c5b9c7052553cd5b9c4fbd88446bea93092e3395aec17ce99d0 Jun 15 09:13:39.551520 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.551501 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4dbb85_dabb_4f48_8a29_51d7f6b621ad.slice/crio-61467934f9ce1406c9439d75fa27f48032efe7f289fbb37201ebcbe6e12c057d WatchSource:0}: Error finding container 61467934f9ce1406c9439d75fa27f48032efe7f289fbb37201ebcbe6e12c057d: Status 404 returned error can't find the container with id 61467934f9ce1406c9439d75fa27f48032efe7f289fbb37201ebcbe6e12c057d Jun 15 09:13:39.552927 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.552882 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714412fb_93c2_445e_b732_fe70b8861ab7.slice/crio-c13305e8247648f0a8482693d9610716cb72e5ca1e5ff44766ef73fbfb49b0b4 WatchSource:0}: Error finding container c13305e8247648f0a8482693d9610716cb72e5ca1e5ff44766ef73fbfb49b0b4: Status 404 returned error can't find the container with id c13305e8247648f0a8482693d9610716cb72e5ca1e5ff44766ef73fbfb49b0b4 Jun 15 09:13:39.553600 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:13:39.553578 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f0f2eb_a1c6_4853_89a9_7549e0ebbacc.slice/crio-ec1861d148b2d0cd1c4877abcdbb0366c6b48129399e08eb3c55541caf152dbd WatchSource:0}: Error finding container ec1861d148b2d0cd1c4877abcdbb0366c6b48129399e08eb3c55541caf152dbd: Status 404 returned error can't find the container with id ec1861d148b2d0cd1c4877abcdbb0366c6b48129399e08eb3c55541caf152dbd Jun 15 09:13:40.086312 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.086215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:40.086312 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.086309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:40.086537 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.086430 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:40.086537 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.086492 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:13:42.086472491 +0000 UTC m=+6.046313236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:40.086906 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.086887 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:40.086988 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.086939 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:42.086923896 +0000 UTC m=+6.046764641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:40.187244 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.187072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:40.187244 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.187231 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:13:40.187244 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.187255 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:13:40.187517 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.187267 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:40.187517 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.187324 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:42.187306839 +0000 UTC m=+6.147147583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:40.404320 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.404209 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 09:08:38 +0000 UTC" deadline="2027-12-30 05:56:38.161236555 +0000 UTC" Jun 15 09:13:40.404320 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.404271 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13508h42m57.75696925s" Jun 15 09:13:40.436685 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.436659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:40.436853 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.436808 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:40.437222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.437207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:40.437319 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.437300 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:40.437376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.437362 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:40.437443 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:40.437426 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:40.463247 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.463205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" event={"ID":"8921aa51ea1d7702a00f526b6904c809","Type":"ContainerStarted","Data":"d3e8b60a4aad274d20cbd9b9105ed2d27a6060d5b16d0817232bc424be4fd59c"} Jun 15 09:13:40.465775 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.465727 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zp9wx" event={"ID":"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc","Type":"ContainerStarted","Data":"ec1861d148b2d0cd1c4877abcdbb0366c6b48129399e08eb3c55541caf152dbd"} Jun 15 09:13:40.476948 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.476895 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" event={"ID":"714412fb-93c2-445e-b732-fe70b8861ab7","Type":"ContainerStarted","Data":"c13305e8247648f0a8482693d9610716cb72e5ca1e5ff44766ef73fbfb49b0b4"} Jun 15 09:13:40.478371 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.478326 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-4.ec2.internal" podStartSLOduration=3.478310115 podStartE2EDuration="3.478310115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:40.477936634 +0000 UTC m=+4.437777396" watchObservedRunningTime="2026-06-15 09:13:40.478310115 +0000 UTC m=+4.438150878" Jun 15 09:13:40.483501 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.483452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" event={"ID":"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad","Type":"ContainerStarted","Data":"61467934f9ce1406c9439d75fa27f48032efe7f289fbb37201ebcbe6e12c057d"} Jun 15 09:13:40.485281 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.485257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w8mmc" event={"ID":"874cf913-64bf-4f20-81a5-b7aa67b38486","Type":"ContainerStarted","Data":"19c0c2ec83294c5b9c7052553cd5b9c4fbd88446bea93092e3395aec17ce99d0"} Jun 15 09:13:40.504040 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.504015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerStarted","Data":"19b5afe600a307d0d7aee8ed3b5d1f9fe6255216273c83b3297705b91c4da48f"} Jun 15 09:13:40.508925 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.507827 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qms6f" event={"ID":"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f","Type":"ContainerStarted","Data":"d9d5b91941be05b916241613883476c3a2888250b4e53cb3f0e8da0971c1a738"} Jun 15 09:13:40.515199 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.515175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"e206077dea310fddf5b03f45e94144d2f65f99fc432cc154c4f10794f9bd7f5a"} Jun 15 09:13:40.518045 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.518020 2572 generic.go:356] "Generic (PLEG): container finished" podID="8f7b0c028b43c60e73e394a8c9cbff2d" containerID="bf8407f39dbf72389d9999c1b67bebc2c4bfd9cb42ec3979e0d8bf37a8f86a57" exitCode=0 Jun 15 09:13:40.518141 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.518096 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" event={"ID":"8f7b0c028b43c60e73e394a8c9cbff2d","Type":"ContainerDied","Data":"bf8407f39dbf72389d9999c1b67bebc2c4bfd9cb42ec3979e0d8bf37a8f86a57"} Jun 15 09:13:40.528686 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.528656 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pngx4" event={"ID":"316df621-9c9f-42c8-9765-323288a7f85a","Type":"ContainerStarted","Data":"c1b064625952a88747ed26752263bd7f048c8b8671126cf4e9d049fadecd4e08"} Jun 15 09:13:40.544420 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:40.544360 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d8pd6" event={"ID":"f863db5e-dfa7-4d46-89ad-bcc425f0333c","Type":"ContainerStarted","Data":"9e005d868dd968248bd3b5ca22c891193f6437f581fc89553e4dabff8a8b87f3"} Jun 15 09:13:41.586899 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:41.586796 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" event={"ID":"8f7b0c028b43c60e73e394a8c9cbff2d","Type":"ContainerStarted","Data":"92cc7497c55ecced32d54c1b0e8b2ba7f7ca77f905c1ea519df11499c589b56d"} Jun 15 09:13:41.603633 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:41.603578 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-4.ec2.internal" podStartSLOduration=4.603561147 podStartE2EDuration="4.603561147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:41.603085326 +0000 UTC m=+5.562926093" watchObservedRunningTime="2026-06-15 09:13:41.603561147 +0000 UTC m=+5.563401911" Jun 15 09:13:42.105704 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:42.105081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:42.105704 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:42.105151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:42.105704 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.105280 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:42.105704 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.105352 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:46.105332431 +0000 UTC m=+10.065173174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:42.105704 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.105413 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:42.105704 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.105482 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:13:46.105464659 +0000 UTC m=+10.065305414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:42.205573 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:42.205513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:42.206422 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.205759 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:13:42.206422 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.205805 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:13:42.206422 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.205818 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:42.206422 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.205877 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:46.205859196 +0000 UTC m=+10.165699953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:42.435768 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:42.434794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:42.435768 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.434926 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:42.435768 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:42.435364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:42.435768 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.435486 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:42.435768 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:42.435555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:42.435768 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:42.435664 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:44.433427 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:44.433396 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:44.433427 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:44.433420 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:44.433917 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:44.433554 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:44.433917 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:44.433552 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:44.433917 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:44.433689 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:44.433917 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:44.433784 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:46.138460 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:46.138422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:46.138939 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:46.138483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:46.138939 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.138626 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:46.138939 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.138685 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:54.13866778 +0000 UTC m=+18.098508555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:46.138939 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.138626 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:46.138939 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.138753 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:13:54.138725553 +0000 UTC m=+18.098566297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:46.239753 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:46.239710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:46.239929 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.239906 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:13:46.239929 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.239924 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:13:46.240037 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.239935 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:46.240037 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.239989 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:13:54.239971458 +0000 UTC m=+18.199812201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:46.434560 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:46.434482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:46.434560 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:46.434547 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:46.434806 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:46.434632 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:46.434806 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.434636 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:46.434806 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.434776 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:46.434964 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:46.434879 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:48.432845 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:48.432756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:48.433326 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:48.432887 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:48.433326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:48.432914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:48.433326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:48.432968 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:48.433326 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:48.433077 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:48.433326 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:48.433169 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:50.433416 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:50.433321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:50.433876 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:50.433459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:50.433876 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:50.433572 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:50.433876 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:50.433460 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:50.433876 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:50.433680 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:50.433876 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:50.433804 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:52.432959 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:52.432933 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:52.432959 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:52.432966 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:52.433489 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:52.432936 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:52.433489 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:52.433060 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:52.433489 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:52.433156 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:52.433489 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:52.433249 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:54.201780 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:54.201693 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:54.201780 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:54.201753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:54.202253 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.201835 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:54.202253 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.201912 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:14:10.201890158 +0000 UTC m=+34.161730900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:13:54.202253 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.201844 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:54.202253 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.201967 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:10.201954242 +0000 UTC m=+34.161794988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:13:54.302628 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:54.302600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:54.303133 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.303109 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:13:54.303244 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.303139 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:13:54.303244 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.303153 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:54.303244 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.303218 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:10.303199905 +0000 UTC m=+34.263040663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:13:54.432559 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:54.432518 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:54.432730 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:54.432570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:54.432730 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:54.432523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:54.432730 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.432663 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:54.432964 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.432763 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:54.432964 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:54.432820 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:56.433293 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:56.433264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:56.433772 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:56.433362 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:56.433772 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:56.433456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:56.433772 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:56.433561 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:56.433772 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:56.433607 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:56.433772 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:56.433684 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:58.433138 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:58.433096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:13:58.433536 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:58.433199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:13:58.433536 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:58.433210 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:13:58.433536 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:58.433290 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:13:58.433536 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:58.433295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:13:58.433536 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:13:58.433379 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:13:58.628575 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:58.626953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pngx4" event={"ID":"316df621-9c9f-42c8-9765-323288a7f85a","Type":"ContainerStarted","Data":"ac4b2ddd4ec860ac5947b3014551206fcf7106615b13f38ee37f065df3362b47"} Jun 15 09:13:58.642660 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:58.642491 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pngx4" podStartSLOduration=8.354093286 podStartE2EDuration="22.642471957s" totalImagesPullingTime="14.288378671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:58.64182689 +0000 UTC m=+22.601667653" watchObservedRunningTime="2026-06-15 09:13:58.642471957 +0000 UTC m=+22.602312935" Jun 15 09:13:59.567972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.567940 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:59.568857 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.568832 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:59.632162 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.632120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w8mmc" event={"ID":"874cf913-64bf-4f20-81a5-b7aa67b38486","Type":"ContainerStarted","Data":"4e08abffe4df845fbe189c65deeb6ba7f20b453f21788a23e968ddcedd2068e7"} Jun 15 09:13:59.633946 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.633916 2572 generic.go:356] "Generic (PLEG): container finished" podID="653d3b81-5827-4082-8d58-1e08e86add96" containerID="3622ef3c26784ccc64f60656a5c8154ac44abcc95fae3f2e2f7a3f2a2a7b4506" exitCode=0 Jun 15 09:13:59.634063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.633999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerDied","Data":"3622ef3c26784ccc64f60656a5c8154ac44abcc95fae3f2e2f7a3f2a2a7b4506"} Jun 15 09:13:59.637376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:13:59.637758 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637719 2572 generic.go:356] "Generic (PLEG): container finished" podID="244c5a6c-9683-4cdf-90a6-a70f39c018ef" containerID="64fb4c9be3f16bacafd4c9ae1b3bf86b7491cc6c0b8db338ac2991d7c38499da" exitCode=1 Jun 15 09:13:59.637842 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637764 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"94d3d1d5edee429579e25c7d0645267f62b4835cb93faecde496b92b699fc8a1"} Jun 15 09:13:59.637842 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"a2eb41bfd57553105e28d420b58b843fce7dd9e4763432c14c1d393bcbe1dbce"} Jun 15 09:13:59.637956 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"c6244797b8ee7dcfe1c2427d74a477ce6634004b8f78c356cca861b47276120c"} Jun 15 09:13:59.637956 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637908 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"1aa175a04e04ebf147f90a1b702099de7555a391c0498a7c5046bbb60b5acc86"} Jun 15 09:13:59.637956 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerDied","Data":"64fb4c9be3f16bacafd4c9ae1b3bf86b7491cc6c0b8db338ac2991d7c38499da"} Jun 15 09:13:59.638108 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.637984 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"0dc965f9af83b03b8bd817d80ea7b7285b24fe6a7886a9bb31fe0b3d81e5ce25"} Jun 15 09:13:59.639380 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.639346 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d8pd6" event={"ID":"f863db5e-dfa7-4d46-89ad-bcc425f0333c","Type":"ContainerStarted","Data":"51f929d77d74f558bc7139cd67c00d5fca0b4e35a2eeebbb688627c6c2e600b5"} Jun 15 09:13:59.640876 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.640853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zp9wx" event={"ID":"81f0f2eb-a1c6-4853-89a9-7549e0ebbacc","Type":"ContainerStarted","Data":"4b3c4aaa58afaf38c7c0fbca2b7895b4fcd505b54e849e1bc50c6c1c18ab237f"} Jun 15 09:13:59.642416 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.642387 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" event={"ID":"714412fb-93c2-445e-b732-fe70b8861ab7","Type":"ContainerStarted","Data":"38db5ec2e95c5ff645dfc7efd7e0ebdbd69c0afeb0bbc36b154eb46152d05e91"} Jun 15 09:13:59.643883 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.643814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" event={"ID":"8f4dbb85-dabb-4f48-8a29-51d7f6b621ad","Type":"ContainerStarted","Data":"ccf8c81ec153e2c415b1bd23f56108661835a08f1ff11a952e74e6ab59fa4c39"} Jun 15 09:13:59.644196 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.644177 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:59.644565 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.644539 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pngx4" Jun 15 09:13:59.649097 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.649060 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w8mmc" podStartSLOduration=4.73203086 podStartE2EDuration="23.649048349s" totalImagesPullingTime="18.917017489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:59.648890666 +0000 UTC m=+23.608731447" watchObservedRunningTime="2026-06-15 09:13:59.649048349 +0000 UTC m=+23.608889111" Jun 15 09:13:59.662338 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.662300 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d8pd6" podStartSLOduration=4.771333416 podStartE2EDuration="23.662284691s" totalImagesPullingTime="18.890951275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:59.662151611 +0000 UTC m=+23.621992372" watchObservedRunningTime="2026-06-15 09:13:59.662284691 +0000 UTC m=+23.622125454" Jun 15 09:13:59.714958 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.714920 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bd5mg" podStartSLOduration=4.832813594 podStartE2EDuration="23.714907506s" totalImagesPullingTime="18.882093912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:59.714504657 +0000 UTC m=+23.674345409" watchObservedRunningTime="2026-06-15 09:13:59.714907506 +0000 UTC m=+23.674748265" Jun 15 09:13:59.729220 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:13:59.729178 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zp9wx" podStartSLOduration=4.849849728 podStartE2EDuration="23.729165992s" totalImagesPullingTime="18.879316264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:13:59.728772686 +0000 UTC m=+23.688613465" watchObservedRunningTime="2026-06-15 09:13:59.729165992 +0000 UTC m=+23.689006754" Jun 15 09:14:00.164240 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.164218 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 09:14:00.433192 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.432934 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:00.433376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.432933 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:00.433376 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:00.433258 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:00.433376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.433010 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:00.433376 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:00.433329 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:00.433592 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:00.433482 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:14:00.434812 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.434707 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T09:14:00.164236467Z","UUID":"934ee556-e1bb-4076-962c-cf241da2427d","Handler":null,"Name":"","Endpoint":""} Jun 15 09:14:00.436396 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.436378 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 09:14:00.436525 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.436418 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 09:14:00.652808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.652770 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" event={"ID":"714412fb-93c2-445e-b732-fe70b8861ab7","Type":"ContainerStarted","Data":"4f955f15e907b03d729234387a322fbd576e266671c802414bb05d34194bd751"} Jun 15 09:14:00.654629 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.654600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qms6f" event={"ID":"e3e6e418-21f7-4bd9-bf4d-6822682a0d0f","Type":"ContainerStarted","Data":"46894ad1052b53f74c8029f4bbbba5e01b0a9c114d249425cc0f93551eb4c53c"} Jun 15 09:14:00.670491 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:00.670443 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qms6f" podStartSLOduration=5.784280195 podStartE2EDuration="24.67042989s" totalImagesPullingTime="18.886149695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:00.669873918 +0000 UTC m=+24.629714696" watchObservedRunningTime="2026-06-15 09:14:00.67042989 +0000 UTC m=+24.630270651" Jun 15 09:14:01.661072 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:01.661048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:14:01.662147 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:01.662040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"4acfaa5c4f8497db040de9bfb80ff7fedd097d8e4ed40c20c922ecb3615d42d7"} Jun 15 09:14:01.664682 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:01.664620 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" event={"ID":"714412fb-93c2-445e-b732-fe70b8861ab7","Type":"ContainerStarted","Data":"334a63525ea1f72bc4e9755e40fa769ac6907714c360ce230f1e6fbe7a5e2607"} Jun 15 09:14:01.682280 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:01.682231 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47tdd" podStartSLOduration=4.230974602 podStartE2EDuration="25.68221805s" totalImagesPullingTime="21.451243448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:01.681944906 +0000 UTC m=+25.641785667" watchObservedRunningTime="2026-06-15 09:14:01.68221805 +0000 UTC m=+25.642058812" Jun 15 09:14:02.433228 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:02.433154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:02.433430 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:02.433154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:02.433430 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:02.433276 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:14:02.433430 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:02.433154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:02.433430 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:02.433334 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:02.433649 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:02.433429 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:04.434226 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:04.433403 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:04.434226 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:04.433431 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:04.434226 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:04.433654 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:14:04.434226 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:04.433693 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:04.436033 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:04.435782 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:04.436033 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:04.435980 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:05.674329 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.674140 2572 generic.go:356] "Generic (PLEG): container finished" podID="653d3b81-5827-4082-8d58-1e08e86add96" containerID="5cf5aeaa9b55c577f84b4c5944565d8d00ede90f2c14bd60fd141367dadb3099" exitCode=0 Jun 15 09:14:05.674899 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.674215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerDied","Data":"5cf5aeaa9b55c577f84b4c5944565d8d00ede90f2c14bd60fd141367dadb3099"} Jun 15 09:14:05.677756 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.677722 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:14:05.678075 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.678053 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"c6a959cc50cac6eab7382f913a53fd670670339d9834266e7cefd1db87815257"} Jun 15 09:14:05.678336 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.678313 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:14:05.678450 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.678373 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:14:05.678511 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.678448 2572 scope.go:117] "RemoveContainer" containerID="64fb4c9be3f16bacafd4c9ae1b3bf86b7491cc6c0b8db338ac2991d7c38499da" Jun 15 09:14:05.695328 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:05.695310 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:14:06.432610 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.432512 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:06.432610 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.432526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:06.432610 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.432542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:06.432994 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:06.432635 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:06.432994 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:06.432716 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:06.432994 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:06.432828 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:14:06.684767 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.684690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:14:06.685179 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.685043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"244c5a6c-9683-4cdf-90a6-a70f39c018ef","Type":"ContainerStarted","Data":"e81d34dc40e867ab4d998c52ebdfd27bc922589485a2b4f41e3da1a7bc765ac2"} Jun 15 09:14:06.685436 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.685398 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:14:06.699796 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.699773 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:14:06.720944 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:06.720905 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" podStartSLOduration=11.447602169 podStartE2EDuration="30.720891068s" totalImagesPullingTime="19.273288899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:06.720636911 +0000 UTC m=+30.680477674" watchObservedRunningTime="2026-06-15 09:14:06.720891068 +0000 UTC m=+30.680731829" Jun 15 09:14:07.135621 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.135539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m568z"] Jun 15 09:14:07.135777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.135690 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:07.135851 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:07.135788 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:07.138632 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.138607 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94648"] Jun 15 09:14:07.138753 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.138691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:07.138823 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:07.138798 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:14:07.139192 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.139169 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvd6z"] Jun 15 09:14:07.139291 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.139265 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:07.139360 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:07.139343 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:07.689548 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.689512 2572 generic.go:356] "Generic (PLEG): container finished" podID="653d3b81-5827-4082-8d58-1e08e86add96" containerID="e7baa4d2d6f2cc8bc15d7b01a4ab35a558f461d40786b9c93ff1dc5bd69adcef" exitCode=0 Jun 15 09:14:07.690002 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:07.689598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerDied","Data":"e7baa4d2d6f2cc8bc15d7b01a4ab35a558f461d40786b9c93ff1dc5bd69adcef"} Jun 15 09:14:08.432718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:08.432503 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:08.432882 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:08.432560 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:08.432882 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:08.432787 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:08.432882 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:08.432831 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:09.433041 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:09.432974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:09.433531 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:09.433065 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94648" podUID="b28cc647-e9b9-4c8c-b24c-7580b7e40f34" Jun 15 09:14:09.696450 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:09.696384 2572 generic.go:356] "Generic (PLEG): container finished" podID="653d3b81-5827-4082-8d58-1e08e86add96" containerID="b0863aeffb9f657d21255f8cefe95768e572b8c5578c12d1c71d8c010fca434f" exitCode=0 Jun 15 09:14:09.696450 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:09.696434 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerDied","Data":"b0863aeffb9f657d21255f8cefe95768e572b8c5578c12d1c71d8c010fca434f"} Jun 15 09:14:10.220429 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:10.220399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:10.220609 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:10.220459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:10.220609 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.220552 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:14:10.220609 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.220559 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 09:14:10.220609 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.220607 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:14:42.220590964 +0000 UTC m=+66.180431721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 09:14:10.220801 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.220620 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret podName:8b25bf6e-22ab-43d7-b225-e4f1b4a504b7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:42.220614317 +0000 UTC m=+66.180455057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret") pod "global-pull-secret-syncer-m568z" (UID: "8b25bf6e-22ab-43d7-b225-e4f1b4a504b7") : object "kube-system"/"original-pull-secret" not registered Jun 15 09:14:10.321491 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:10.321454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:10.321678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.321634 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 09:14:10.321678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.321657 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 09:14:10.321678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.321669 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2f2jj for pod openshift-network-diagnostics/network-check-target-94648: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:14:10.321858 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.321751 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj podName:b28cc647-e9b9-4c8c-b24c-7580b7e40f34 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:42.321714567 +0000 UTC m=+66.281555314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f2jj" (UniqueName: "kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj") pod "network-check-target-94648" (UID: "b28cc647-e9b9-4c8c-b24c-7580b7e40f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 09:14:10.433005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:10.432977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:10.433171 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.433113 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:14:10.433171 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:10.433148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:10.433502 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:10.433237 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m568z" podUID="8b25bf6e-22ab-43d7-b225-e4f1b4a504b7" Jun 15 09:14:11.378875 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.378800 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-4.ec2.internal" event="NodeReady" Jun 15 09:14:11.378995 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.378909 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 09:14:11.410597 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.410569 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-lnwqc"] Jun 15 09:14:11.414268 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.414189 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85f578b465-w9fw6"] Jun 15 09:14:11.414513 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.414456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:11.416971 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.416805 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 09:14:11.416971 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.416825 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wb5cc\"" Jun 15 09:14:11.416971 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.416884 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 09:14:11.419279 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.419223 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt"] Jun 15 09:14:11.419424 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.419406 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.421877 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.421802 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 09:14:11.422301 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.422248 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 09:14:11.422666 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.422625 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 09:14:11.422777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.422680 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-25zgd\"" Jun 15 09:14:11.422951 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.422923 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz"] Jun 15 09:14:11.423165 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.423146 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.425949 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.425908 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 09:14:11.426211 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.425931 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 09:14:11.426326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.426046 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 15 09:14:11.426326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.426223 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5"] Jun 15 09:14:11.426326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.426097 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 09:14:11.426478 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.426417 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.427832 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.427810 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 09:14:11.428632 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.428610 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 15 09:14:11.429715 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.429067 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 15 09:14:11.430036 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.430016 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 15 09:14:11.430381 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.430336 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 15 09:14:11.431342 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.431323 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-lnwqc"] Jun 15 09:14:11.431442 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.431361 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt"] Jun 15 09:14:11.431442 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.431383 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ndd7t"] Jun 15 09:14:11.431541 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.431455 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.433536 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.433510 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n4nzz\"" Jun 15 09:14:11.434054 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.433584 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 15 09:14:11.435049 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.434692 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz"] Jun 15 09:14:11.435049 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.434725 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f578b465-w9fw6"] Jun 15 09:14:11.435049 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.434769 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6nxv9"] Jun 15 09:14:11.435049 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.434991 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.436060 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.435247 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:11.437852 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.437831 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 09:14:11.437961 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.437850 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 09:14:11.437961 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.437902 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 09:14:11.438150 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.438081 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xq464\"" Jun 15 09:14:11.438448 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.438263 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kvn5q\"" Jun 15 09:14:11.438448 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.438313 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 09:14:11.438448 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.438314 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 09:14:11.438902 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.438878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.441283 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.441022 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 09:14:11.441283 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.441072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7dsb\"" Jun 15 09:14:11.441524 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.441503 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 09:14:11.442221 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.442204 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ndd7t"] Jun 15 09:14:11.444580 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.444536 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5"] Jun 15 09:14:11.445468 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.445446 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6nxv9"] Jun 15 09:14:11.528991 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.528966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:11.529108 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.529108 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529108 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxq7r\" (UniqueName: \"kubernetes.io/projected/6355dea9-d914-42da-999a-bb54fbfdcfa2-kube-api-access-zxq7r\") pod \"ingress-canary-ndd7t\" (UID: \"6355dea9-d914-42da-999a-bb54fbfdcfa2\") " pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.529257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhx6s\" (UniqueName: \"kubernetes.io/projected/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-kube-api-access-bhx6s\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.529257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-installation-pull-secrets\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c0290eb-b138-450b-b965-36b56f01d740-tmp\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.529257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/157076da-2dc6-471f-a92a-1ec7199c39f3-nginx-conf\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-bound-sa-token\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c0290eb-b138-450b-b965-36b56f01d740-klusterlet-config\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqf5c\" (UniqueName: \"kubernetes.io/projected/8c0290eb-b138-450b-b965-36b56f01d740-kube-api-access-mqf5c\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx7rs\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-kube-api-access-cx7rs\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-image-registry-private-configuration\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6355dea9-d914-42da-999a-bb54fbfdcfa2-cert\") pod \"ingress-canary-ndd7t\" (UID: \"6355dea9-d914-42da-999a-bb54fbfdcfa2\") " pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.529452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07a5301b-257a-4f61-82b3-8a328d3a8cb0-ca-trust-extracted\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-certificates\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-ca\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529519 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529545 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa4f83a-1cc9-490e-857d-8f7108c065d7-config-volume\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-trusted-ca\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c03bde2-7214-45dd-b800-0de3427b4fde-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b96bc9ccb-649l5\" (UID: \"3c03bde2-7214-45dd-b800-0de3427b4fde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-hub\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.529777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkp2l\" (UniqueName: \"kubernetes.io/projected/3c03bde2-7214-45dd-b800-0de3427b4fde-kube-api-access-mkp2l\") pod \"managed-serviceaccount-addon-agent-7b96bc9ccb-649l5\" (UID: \"3c03bde2-7214-45dd-b800-0de3427b4fde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.530031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.530031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ms8l\" (UniqueName: \"kubernetes.io/projected/9aa4f83a-1cc9-490e-857d-8f7108c065d7-kube-api-access-6ms8l\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.530031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aa4f83a-1cc9-490e-857d-8f7108c065d7-tmp-dir\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.530031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.529887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.630776 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.630701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ms8l\" (UniqueName: \"kubernetes.io/projected/9aa4f83a-1cc9-490e-857d-8f7108c065d7-kube-api-access-6ms8l\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.630776 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.630750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aa4f83a-1cc9-490e-857d-8f7108c065d7-tmp-dir\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.630937 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.630792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.630937 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.630924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:11.631059 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.630957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.631059 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.630988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631059 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxq7r\" (UniqueName: \"kubernetes.io/projected/6355dea9-d914-42da-999a-bb54fbfdcfa2-kube-api-access-zxq7r\") pod \"ingress-canary-ndd7t\" (UID: \"6355dea9-d914-42da-999a-bb54fbfdcfa2\") " pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.631059 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhx6s\" (UniqueName: \"kubernetes.io/projected/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-kube-api-access-bhx6s\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.631059 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.631051 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-installation-pull-secrets\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631083 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aa4f83a-1cc9-490e-857d-8f7108c065d7-tmp-dir\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.631102 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:12.131084324 +0000 UTC m=+36.090925083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c0290eb-b138-450b-b965-36b56f01d740-tmp\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/157076da-2dc6-471f-a92a-1ec7199c39f3-nginx-conf\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-bound-sa-token\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c0290eb-b138-450b-b965-36b56f01d740-klusterlet-config\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf5c\" (UniqueName: \"kubernetes.io/projected/8c0290eb-b138-450b-b965-36b56f01d740-kube-api-access-mqf5c\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx7rs\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-kube-api-access-cx7rs\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-image-registry-private-configuration\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6355dea9-d914-42da-999a-bb54fbfdcfa2-cert\") pod \"ingress-canary-ndd7t\" (UID: \"6355dea9-d914-42da-999a-bb54fbfdcfa2\") " pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07a5301b-257a-4f61-82b3-8a328d3a8cb0-ca-trust-extracted\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-certificates\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-ca\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa4f83a-1cc9-490e-857d-8f7108c065d7-config-volume\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-trusted-ca\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c03bde2-7214-45dd-b800-0de3427b4fde-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b96bc9ccb-649l5\" (UID: \"3c03bde2-7214-45dd-b800-0de3427b4fde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-hub\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkp2l\" (UniqueName: \"kubernetes.io/projected/3c03bde2-7214-45dd-b800-0de3427b4fde-kube-api-access-mkp2l\") pod \"managed-serviceaccount-addon-agent-7b96bc9ccb-649l5\" (UID: \"3c03bde2-7214-45dd-b800-0de3427b4fde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.631722 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.631585 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c0290eb-b138-450b-b965-36b56f01d740-tmp\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.632678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.631593 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:11.632678 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.632286 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/157076da-2dc6-471f-a92a-1ec7199c39f3-nginx-conf\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:11.632678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.632301 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:12.132283244 +0000 UTC m=+36.092123995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:11.632678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.631694 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:11.632678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.632326 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:11.632678 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:11.632358 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:12.132348381 +0000 UTC m=+36.092189136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:11.633034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.632826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07a5301b-257a-4f61-82b3-8a328d3a8cb0-ca-trust-extracted\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.633034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.632877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.633601 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.633327 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-certificates\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.634761 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.634423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9aa4f83a-1cc9-490e-857d-8f7108c065d7-config-volume\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.635851 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.635391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-trusted-ca\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.636134 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.636112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-installation-pull-secrets\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.636266 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.636171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-image-registry-private-configuration\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.636351 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.636203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6355dea9-d914-42da-999a-bb54fbfdcfa2-cert\") pod \"ingress-canary-ndd7t\" (UID: \"6355dea9-d914-42da-999a-bb54fbfdcfa2\") " pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.636436 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.636343 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.636914 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.636879 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c0290eb-b138-450b-b965-36b56f01d740-klusterlet-config\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.637037 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.637003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c03bde2-7214-45dd-b800-0de3427b4fde-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b96bc9ccb-649l5\" (UID: \"3c03bde2-7214-45dd-b800-0de3427b4fde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.637142 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.637121 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-ca\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.638229 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.638185 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.638791 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.638726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-hub\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.642791 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.642730 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhx6s\" (UniqueName: \"kubernetes.io/projected/454376a7-6ced-4c4e-85dc-bb31a2f7b3eb-kube-api-access-bhx6s\") pod \"cluster-proxy-proxy-agent-84b9f65458-hknhz\" (UID: \"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.642997 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.642969 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqf5c\" (UniqueName: \"kubernetes.io/projected/8c0290eb-b138-450b-b965-36b56f01d740-kube-api-access-mqf5c\") pod \"klusterlet-addon-workmgr-595bf48776-7bcvt\" (UID: \"8c0290eb-b138-450b-b965-36b56f01d740\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.643206 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.643149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxq7r\" (UniqueName: \"kubernetes.io/projected/6355dea9-d914-42da-999a-bb54fbfdcfa2-kube-api-access-zxq7r\") pod \"ingress-canary-ndd7t\" (UID: \"6355dea9-d914-42da-999a-bb54fbfdcfa2\") " pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.643766 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.643714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-bound-sa-token\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.643913 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.643893 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ms8l\" (UniqueName: \"kubernetes.io/projected/9aa4f83a-1cc9-490e-857d-8f7108c065d7-kube-api-access-6ms8l\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:11.644771 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.644722 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx7rs\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-kube-api-access-cx7rs\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:11.645283 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.645258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkp2l\" (UniqueName: \"kubernetes.io/projected/3c03bde2-7214-45dd-b800-0de3427b4fde-kube-api-access-mkp2l\") pod \"managed-serviceaccount-addon-agent-7b96bc9ccb-649l5\" (UID: \"3c03bde2-7214-45dd-b800-0de3427b4fde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.748579 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.748545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:11.765178 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.764727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:14:11.770360 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.770294 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:14:11.784882 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.784817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ndd7t" Jun 15 09:14:11.942413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.942096 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt"] Jun 15 09:14:11.944943 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.944920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5"] Jun 15 09:14:11.947326 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:14:11.947295 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0290eb_b138_450b_b965_36b56f01d740.slice/crio-cca26d3f7e575083e6415826b546b8223e43a509f4ebc55171badbafde59b0b4 WatchSource:0}: Error finding container cca26d3f7e575083e6415826b546b8223e43a509f4ebc55171badbafde59b0b4: Status 404 returned error can't find the container with id cca26d3f7e575083e6415826b546b8223e43a509f4ebc55171badbafde59b0b4 Jun 15 09:14:11.947849 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:14:11.947816 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c03bde2_7214_45dd_b800_0de3427b4fde.slice/crio-fb71dbe89f159b3231c4576f8e543792bacdcb1127a106ef9d2e34e680cb577c WatchSource:0}: Error finding container fb71dbe89f159b3231c4576f8e543792bacdcb1127a106ef9d2e34e680cb577c: Status 404 returned error can't find the container with id fb71dbe89f159b3231c4576f8e543792bacdcb1127a106ef9d2e34e680cb577c Jun 15 09:14:11.959142 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.959123 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ndd7t"] Jun 15 09:14:11.960183 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:11.960158 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz"] Jun 15 09:14:11.961312 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:14:11.961289 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6355dea9_d914_42da_999a_bb54fbfdcfa2.slice/crio-04903c47dd6a4300a1911c2a3e65aa858c63999795e258eceb370d52a2dfee61 WatchSource:0}: Error finding container 04903c47dd6a4300a1911c2a3e65aa858c63999795e258eceb370d52a2dfee61: Status 404 returned error can't find the container with id 04903c47dd6a4300a1911c2a3e65aa858c63999795e258eceb370d52a2dfee61 Jun 15 09:14:11.962204 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:14:11.962184 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod454376a7_6ced_4c4e_85dc_bb31a2f7b3eb.slice/crio-036b005146070a59f05ea4172f26b4e58e51c7259cac4ee9c16a49d353b1a0f6 WatchSource:0}: Error finding container 036b005146070a59f05ea4172f26b4e58e51c7259cac4ee9c16a49d353b1a0f6: Status 404 returned error can't find the container with id 036b005146070a59f05ea4172f26b4e58e51c7259cac4ee9c16a49d353b1a0f6 Jun 15 09:14:12.135972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.135933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:12.136124 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.136020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:12.136124 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.136049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:12.136124 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136090 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:12.136275 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136142 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:13.136128629 +0000 UTC m=+37.095969369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:12.136275 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136176 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:12.136275 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136194 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:12.136275 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136208 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:12.136275 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136225 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:13.136213428 +0000 UTC m=+37.096054168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:12.136275 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:12.136250 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:13.136237038 +0000 UTC m=+37.096077795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:12.432774 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.432728 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:12.432978 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.432956 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:12.435413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.435394 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 09:14:12.435786 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.435414 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 09:14:12.435786 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.435493 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5jg97\"" Jun 15 09:14:12.707455 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.706239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" event={"ID":"3c03bde2-7214-45dd-b800-0de3427b4fde","Type":"ContainerStarted","Data":"fb71dbe89f159b3231c4576f8e543792bacdcb1127a106ef9d2e34e680cb577c"} Jun 15 09:14:12.708021 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.707947 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" event={"ID":"8c0290eb-b138-450b-b965-36b56f01d740","Type":"ContainerStarted","Data":"cca26d3f7e575083e6415826b546b8223e43a509f4ebc55171badbafde59b0b4"} Jun 15 09:14:12.711290 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.711227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ndd7t" event={"ID":"6355dea9-d914-42da-999a-bb54fbfdcfa2","Type":"ContainerStarted","Data":"04903c47dd6a4300a1911c2a3e65aa858c63999795e258eceb370d52a2dfee61"} Jun 15 09:14:12.713063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:12.712992 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" event={"ID":"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb","Type":"ContainerStarted","Data":"036b005146070a59f05ea4172f26b4e58e51c7259cac4ee9c16a49d353b1a0f6"} Jun 15 09:14:13.145131 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:13.145038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:13.145131 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:13.145091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:13.145331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:13.145223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:13.145331 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145251 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:13.145331 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145328 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:15.145304049 +0000 UTC m=+39.105144809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:13.145483 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145384 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:13.145483 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145406 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:13.145483 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145462 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:15.145444022 +0000 UTC m=+39.105284766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:13.145483 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145464 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:13.145663 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:13.145547 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:15.145502472 +0000 UTC m=+39.105343220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:15.166088 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:15.166055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:15.166111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:15.166141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166196 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166239 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166253 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166255 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166264 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:19.166247863 +0000 UTC m=+43.126088616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166299 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:19.166283502 +0000 UTC m=+43.126124249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:15.166492 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:15.166314 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:19.166307216 +0000 UTC m=+43.126147955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:15.664895 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:15.664859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:15.784551 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:15.784510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:16.962385 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:16.962307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:17.031232 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:17.031199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:19.201247 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:19.201208 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:19.201251 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:19.201321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201345 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201421 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:27.201400524 +0000 UTC m=+51.161241264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201424 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201440 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201440 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201491 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:27.201478352 +0000 UTC m=+51.161319092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:19.201683 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:19.201504 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:27.20149853 +0000 UTC m=+51.161339270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:22.740731 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.740697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" event={"ID":"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb","Type":"ContainerStarted","Data":"98a5425c9b261bd587d391491f08f61299d2b243f2adf29fafc10c8bcd9397fc"} Jun 15 09:14:22.741124 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.740752 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" event={"ID":"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb","Type":"ContainerStarted","Data":"2d1ca77c20a813f2e5995114e96edff870570714b4c2f0c336d59d824e278e4d"} Jun 15 09:14:22.741124 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.740768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" event={"ID":"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb","Type":"ContainerStarted","Data":"ecc83c104a8071552b25199371d6c831088729bdc1af97d4c6eeb0776b54dfe8"} Jun 15 09:14:22.742034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.742009 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" event={"ID":"3c03bde2-7214-45dd-b800-0de3427b4fde","Type":"ContainerStarted","Data":"ace26bd8c52c63ea1badf7a5a74f392b8f2e3c07ccd4be2bcfe270a7fcef7518"} Jun 15 09:14:22.743317 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.743293 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" event={"ID":"8c0290eb-b138-450b-b965-36b56f01d740","Type":"ContainerStarted","Data":"11099c9e3adae1765932c12d720ac9585decc513ba8637444de0a270df0376b1"} Jun 15 09:14:22.743413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.743336 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:22.745746 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.745700 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:14:22.749331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.749306 2572 generic.go:356] "Generic (PLEG): container finished" podID="653d3b81-5827-4082-8d58-1e08e86add96" containerID="176eaf9f70721620d130164bdde1c5e5da6b2f75ee3d2e151c51412fea659db0" exitCode=0 Jun 15 09:14:22.749422 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.749378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerDied","Data":"176eaf9f70721620d130164bdde1c5e5da6b2f75ee3d2e151c51412fea659db0"} Jun 15 09:14:22.750794 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.750769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ndd7t" event={"ID":"6355dea9-d914-42da-999a-bb54fbfdcfa2","Type":"ContainerStarted","Data":"18f61fdeb424f66e50b30837182d93199ad6ad62ab7a65fa3884622fef24787c"} Jun 15 09:14:22.760055 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.760014 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" podStartSLOduration=23.067757698 podStartE2EDuration="32.759998194s" totalImagesPullingTime="9.692240496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:22.759625538 +0000 UTC m=+46.719466321" watchObservedRunningTime="2026-06-15 09:14:22.759998194 +0000 UTC m=+46.719838959" Jun 15 09:14:22.774801 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.774766 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" podStartSLOduration=23.067420694 podStartE2EDuration="32.774754987s" totalImagesPullingTime="9.707334293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:22.774200612 +0000 UTC m=+46.734041374" watchObservedRunningTime="2026-06-15 09:14:22.774754987 +0000 UTC m=+46.734595753" Jun 15 09:14:22.789466 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.789433 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" podStartSLOduration=23.078507211 podStartE2EDuration="32.789421251s" totalImagesPullingTime="9.71091404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:22.788541975 +0000 UTC m=+46.748382738" watchObservedRunningTime="2026-06-15 09:14:22.789421251 +0000 UTC m=+46.749262014" Jun 15 09:14:22.825059 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:22.825025 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ndd7t" podStartSLOduration=2.132713542 podStartE2EDuration="11.825013765s" totalImagesPullingTime="9.692300223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:22.823702811 +0000 UTC m=+46.783543575" watchObservedRunningTime="2026-06-15 09:14:22.825013765 +0000 UTC m=+46.784854564" Jun 15 09:14:23.756466 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:23.756435 2572 generic.go:356] "Generic (PLEG): container finished" podID="653d3b81-5827-4082-8d58-1e08e86add96" containerID="364be7287269c4f805fc6cdd53d17ad7f68b21fb7e7172b254a37549c8a6eb51" exitCode=0 Jun 15 09:14:23.756846 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:23.756531 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerDied","Data":"364be7287269c4f805fc6cdd53d17ad7f68b21fb7e7172b254a37549c8a6eb51"} Jun 15 09:14:24.228410 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:24.228379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:24.330753 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:24.330704 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:24.762384 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:24.762348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" event={"ID":"653d3b81-5827-4082-8d58-1e08e86add96","Type":"ContainerStarted","Data":"84b0bff8ac64c10ab6440b1b78869d588fa44178c645c836e8f4b8b42ff0770e"} Jun 15 09:14:24.786327 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:24.786275 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c9l7t" podStartSLOduration=10.375199486 podStartE2EDuration="48.786259391s" totalImagesPullingTime="38.411059905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:24.785789725 +0000 UTC m=+48.745630486" watchObservedRunningTime="2026-06-15 09:14:24.786259391 +0000 UTC m=+48.746100154" Jun 15 09:14:24.916823 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:24.916797 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:24.970336 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:24.970304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" limit=1024 Jun 15 09:14:27.261228 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:27.261198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:27.261253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:27.261274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261336 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261343 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261362 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261371 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261390 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:43.261375681 +0000 UTC m=+67.221216420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261404 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:43.261397873 +0000 UTC m=+67.221238613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:27.261593 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:27.261415 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:14:43.261409412 +0000 UTC m=+67.221250152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:38.720330 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:38.720304 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 15 09:14:42.266249 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.266209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:14:42.266249 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.266252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:42.268470 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.268450 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 09:14:42.268580 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.268452 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 09:14:42.277203 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:42.277185 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 09:14:42.277283 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:42.277247 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:15:46.277227751 +0000 UTC m=+130.237068494 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : secret "metrics-daemon-secret" not found Jun 15 09:14:42.280354 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.280331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b25bf6e-22ab-43d7-b225-e4f1b4a504b7-original-pull-secret\") pod \"global-pull-secret-syncer-m568z\" (UID: \"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7\") " pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:42.367198 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.367166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:42.370068 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.370051 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 09:14:42.379595 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.379578 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 09:14:42.390452 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.390429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2jj\" (UniqueName: \"kubernetes.io/projected/b28cc647-e9b9-4c8c-b24c-7580b7e40f34-kube-api-access-2f2jj\") pod \"network-check-target-94648\" (UID: \"b28cc647-e9b9-4c8c-b24c-7580b7e40f34\") " pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:42.392942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.392928 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xq464\"" Jun 15 09:14:42.401808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.401792 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:42.451265 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.451236 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m568z" Jun 15 09:14:42.528514 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.528489 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94648"] Jun 15 09:14:42.532296 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:14:42.532270 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28cc647_e9b9_4c8c_b24c_7580b7e40f34.slice/crio-c034d0635489e2fb499009ad265c24c901e11456a9f1c4b82ca8e142951c9bf1 WatchSource:0}: Error finding container c034d0635489e2fb499009ad265c24c901e11456a9f1c4b82ca8e142951c9bf1: Status 404 returned error can't find the container with id c034d0635489e2fb499009ad265c24c901e11456a9f1c4b82ca8e142951c9bf1 Jun 15 09:14:42.571317 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.571292 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m568z"] Jun 15 09:14:42.573918 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:14:42.573890 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b25bf6e_22ab_43d7_b225_e4f1b4a504b7.slice/crio-a62ff0585482f7ac38c3d57059e4e72df3d5b970d9e134a1fe4cff81095cb1a5 WatchSource:0}: Error finding container a62ff0585482f7ac38c3d57059e4e72df3d5b970d9e134a1fe4cff81095cb1a5: Status 404 returned error can't find the container with id a62ff0585482f7ac38c3d57059e4e72df3d5b970d9e134a1fe4cff81095cb1a5 Jun 15 09:14:42.823942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.823876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m568z" event={"ID":"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7","Type":"ContainerStarted","Data":"a62ff0585482f7ac38c3d57059e4e72df3d5b970d9e134a1fe4cff81095cb1a5"} Jun 15 09:14:42.824938 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:42.824913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94648" event={"ID":"b28cc647-e9b9-4c8c-b24c-7580b7e40f34","Type":"ContainerStarted","Data":"c034d0635489e2fb499009ad265c24c901e11456a9f1c4b82ca8e142951c9bf1"} Jun 15 09:14:43.275028 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:43.274987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:14:43.275028 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:43.275040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:43.275102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275148 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275196 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275196 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275237 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:15:15.275216572 +0000 UTC m=+99.235057312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275241 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275259 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:15:15.275248135 +0000 UTC m=+99.235088874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:14:43.275503 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:14:43.275280 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:15:15.275265576 +0000 UTC m=+99.235106319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:14:47.845044 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:47.845016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94648" event={"ID":"b28cc647-e9b9-4c8c-b24c-7580b7e40f34","Type":"ContainerStarted","Data":"f121cb9e25b5e8b61a456538f71b5e4266d6f27356d9678b310a8266979e96ae"} Jun 15 09:14:47.845357 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:47.845094 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:14:47.862147 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:47.862107 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-94648" podStartSLOduration=66.6243234 podStartE2EDuration="1m11.862094453s" totalImagesPullingTime="5.237771053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:47.860969884 +0000 UTC m=+71.820810647" watchObservedRunningTime="2026-06-15 09:14:47.862094453 +0000 UTC m=+71.821935215" Jun 15 09:14:48.849415 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:48.849383 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m568z" event={"ID":"8b25bf6e-22ab-43d7-b225-e4f1b4a504b7","Type":"ContainerStarted","Data":"a54c9ba6a80ba75901a5b728df5bf250e2dafec9f836c7b3eb9b3b08e05789ad"} Jun 15 09:14:48.864321 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:14:48.864273 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m568z" podStartSLOduration=67.6619176 podStartE2EDuration="1m12.864257696s" totalImagesPullingTime="5.202340096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:14:48.863651089 +0000 UTC m=+72.823491855" watchObservedRunningTime="2026-06-15 09:14:48.864257696 +0000 UTC m=+72.824098467" Jun 15 09:15:15.293389 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:15:15.293354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:15:15.293417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:15:15.293446 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293490 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293501 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293547 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293559 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293561 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:16:19.293546957 +0000 UTC m=+163.253387697 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293575 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:16:19.293568985 +0000 UTC m=+163.253409726 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:15:15.293934 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:15.293607 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:16:19.293592281 +0000 UTC m=+163.253433027 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:15:18.852134 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:15:18.852105 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-94648" Jun 15 09:15:46.308437 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:15:46.308392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:15:46.308955 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:46.308531 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 09:15:46.308955 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:15:46.308603 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:17:48.308588328 +0000 UTC m=+252.268429067 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : secret "metrics-daemon-secret" not found Jun 15 09:16:14.428320 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:14.428276 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" podUID="157076da-2dc6-471f-a92a-1ec7199c39f3" Jun 15 09:16:14.438464 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:14.438436 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" Jun 15 09:16:14.497827 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:14.497793 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6nxv9" podUID="9aa4f83a-1cc9-490e-857d-8f7108c065d7" Jun 15 09:16:15.093273 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:15.093243 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:16:15.093424 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:15.093278 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nxv9" Jun 15 09:16:15.093424 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:15.093387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:16:15.445372 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:15.445340 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:16:19.333693 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:19.333656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:16:19.333693 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:19.333695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:19.333749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333820 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333839 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333844 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333859 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f578b465-w9fw6: secret "image-registry-tls" not found Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333885 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert podName:157076da-2dc6-471f-a92a-1ec7199c39f3 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:21.333869545 +0000 UTC m=+285.293710286 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-lnwqc" (UID: "157076da-2dc6-471f-a92a-1ec7199c39f3") : secret "networking-console-plugin-cert" not found Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333906 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls podName:07a5301b-257a-4f61-82b3-8a328d3a8cb0 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:21.333894135 +0000 UTC m=+285.293734874 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls") pod "image-registry-85f578b465-w9fw6" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0") : secret "image-registry-tls" not found Jun 15 09:16:19.334083 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:16:19.333918 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls podName:9aa4f83a-1cc9-490e-857d-8f7108c065d7 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:21.333912484 +0000 UTC m=+285.293753223 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls") pod "dns-default-6nxv9" (UID: "9aa4f83a-1cc9-490e-857d-8f7108c065d7") : secret "dns-default-metrics-tls" not found Jun 15 09:16:22.113266 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.113230 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c03bde2-7214-45dd-b800-0de3427b4fde" containerID="ace26bd8c52c63ea1badf7a5a74f392b8f2e3c07ccd4be2bcfe270a7fcef7518" exitCode=255 Jun 15 09:16:22.113625 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.113309 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" event={"ID":"3c03bde2-7214-45dd-b800-0de3427b4fde","Type":"ContainerDied","Data":"ace26bd8c52c63ea1badf7a5a74f392b8f2e3c07ccd4be2bcfe270a7fcef7518"} Jun 15 09:16:22.113625 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.113612 2572 scope.go:117] "RemoveContainer" containerID="ace26bd8c52c63ea1badf7a5a74f392b8f2e3c07ccd4be2bcfe270a7fcef7518" Jun 15 09:16:22.114725 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.114698 2572 generic.go:356] "Generic (PLEG): container finished" podID="8c0290eb-b138-450b-b965-36b56f01d740" containerID="11099c9e3adae1765932c12d720ac9585decc513ba8637444de0a270df0376b1" exitCode=1 Jun 15 09:16:22.114852 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.114766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" event={"ID":"8c0290eb-b138-450b-b965-36b56f01d740","Type":"ContainerDied","Data":"11099c9e3adae1765932c12d720ac9585decc513ba8637444de0a270df0376b1"} Jun 15 09:16:22.115043 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.115028 2572 scope.go:117] "RemoveContainer" containerID="11099c9e3adae1765932c12d720ac9585decc513ba8637444de0a270df0376b1" Jun 15 09:16:22.744215 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:22.744184 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:16:23.118961 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:23.118884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" event={"ID":"3c03bde2-7214-45dd-b800-0de3427b4fde","Type":"ContainerStarted","Data":"563a131831ddeef545f2e5eea2928d64555052c648722fc48d205f1b4b9f57cf"} Jun 15 09:16:23.120539 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:23.120513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" event={"ID":"8c0290eb-b138-450b-b965-36b56f01d740","Type":"ContainerStarted","Data":"f57a874e10d41d12055e20ff85aeb78697e31ea1efd9d6742c17d9600ae0c8b4"} Jun 15 09:16:23.120710 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:23.120696 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:16:23.121318 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:23.121301 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:16:27.433005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:16:27.432928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:17:48.346898 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:48.346849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:17:48.347397 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:48.346991 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 09:17:48.347397 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:48.347051 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs podName:0b1550fb-2331-4d01-8b86-4762fb506edb nodeName:}" failed. No retries permitted until 2026-06-15 09:19:50.347038003 +0000 UTC m=+374.306878747 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs") pod "network-metrics-daemon-cvd6z" (UID: "0b1550fb-2331-4d01-8b86-4762fb506edb") : secret "metrics-daemon-secret" not found Jun 15 09:17:57.840935 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.840856 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nbckg"] Jun 15 09:17:57.843944 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.843926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:57.846005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.845980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 09:17:57.846258 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.846243 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mdrc\"" Jun 15 09:17:57.846336 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.846258 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 09:17:57.846963 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.846948 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 09:17:57.846963 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.846956 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 09:17:57.858694 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.858673 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nbckg"] Jun 15 09:17:57.912716 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.912689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7edc68f5-6516-4e19-9443-48747149b6c2-crio-socket\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:57.912855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.912761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7edc68f5-6516-4e19-9443-48747149b6c2-data-volume\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:57.912855 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.912830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:57.912938 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.912867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:57.912938 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:57.912913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffw2\" (UniqueName: \"kubernetes.io/projected/7edc68f5-6516-4e19-9443-48747149b6c2-kube-api-access-8ffw2\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.013775 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7edc68f5-6516-4e19-9443-48747149b6c2-data-volume\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.013878 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013798 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.013878 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.013988 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffw2\" (UniqueName: \"kubernetes.io/projected/7edc68f5-6516-4e19-9443-48747149b6c2-kube-api-access-8ffw2\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.013988 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.013905 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 09:17:58.013988 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7edc68f5-6516-4e19-9443-48747149b6c2-crio-socket\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.013988 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.013960 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:17:58.513943528 +0000 UTC m=+262.473784267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : configmap "kube-rbac-proxy" not found Jun 15 09:17:58.013988 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013966 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7edc68f5-6516-4e19-9443-48747149b6c2-data-volume\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.014231 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.013998 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7edc68f5-6516-4e19-9443-48747149b6c2-crio-socket\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.014231 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.014016 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 09:17:58.014231 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.014069 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:17:58.514056541 +0000 UTC m=+262.473897285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : secret "insights-runtime-extractor-tls" not found Jun 15 09:17:58.024993 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.024969 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffw2\" (UniqueName: \"kubernetes.io/projected/7edc68f5-6516-4e19-9443-48747149b6c2-kube-api-access-8ffw2\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.516288 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.516258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.516288 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:58.516291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:58.516523 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.516381 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 09:17:58.516523 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.516412 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 09:17:58.516523 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.516459 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:17:59.516441329 +0000 UTC m=+263.476282074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : configmap "kube-rbac-proxy" not found Jun 15 09:17:58.516523 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:58.516477 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:17:59.5164677 +0000 UTC m=+263.476308441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : secret "insights-runtime-extractor-tls" not found Jun 15 09:17:59.522500 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:59.522461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:59.522500 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:17:59.522501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:17:59.522946 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:59.522573 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 09:17:59.522946 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:59.522603 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 09:17:59.522946 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:59.522628 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:01.522613759 +0000 UTC m=+265.482454499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : configmap "kube-rbac-proxy" not found Jun 15 09:17:59.522946 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:17:59.522642 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:01.522636525 +0000 UTC m=+265.482477265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : secret "insights-runtime-extractor-tls" not found Jun 15 09:18:00.022516 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:00.022491 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zp9wx_81f0f2eb-a1c6-4853-89a9-7549e0ebbacc/dns-node-resolver/0.log" Jun 15 09:18:00.622782 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:00.622754 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d8pd6_f863db5e-dfa7-4d46-89ad-bcc425f0333c/node-ca/0.log" Jun 15 09:18:01.533088 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:01.533047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:01.533088 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:01.533089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:01.533300 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:01.533156 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 09:18:01.533300 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:01.533195 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 09:18:01.533300 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:01.533212 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:05.533197835 +0000 UTC m=+269.493038574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : configmap "kube-rbac-proxy" not found Jun 15 09:18:01.533300 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:01.533230 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:05.533219839 +0000 UTC m=+269.493060578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : secret "insights-runtime-extractor-tls" not found Jun 15 09:18:01.622389 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:01.622366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ndd7t_6355dea9-d914-42da-999a-bb54fbfdcfa2/serve-healthcheck-canary/0.log" Jun 15 09:18:05.560909 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:05.560853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:05.560909 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:05.560911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:05.561319 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:05.560985 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 09:18:05.561319 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:05.561019 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 09:18:05.561319 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:05.561050 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:13.56103261 +0000 UTC m=+277.520873359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : configmap "kube-rbac-proxy" not found Jun 15 09:18:05.561319 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:05.561080 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:13.561069341 +0000 UTC m=+277.520910083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : secret "insights-runtime-extractor-tls" not found Jun 15 09:18:11.765833 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:11.765770 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" podUID="454376a7-6ced-4c4e-85dc-bb31a2f7b3eb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 09:18:13.618433 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:13.618401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:13.618433 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:13.618436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:13.618872 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:13.618600 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 09:18:13.618872 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:13.618659 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls podName:7edc68f5-6516-4e19-9443-48747149b6c2 nodeName:}" failed. No retries permitted until 2026-06-15 09:18:29.61864449 +0000 UTC m=+293.578485230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbckg" (UID: "7edc68f5-6516-4e19-9443-48747149b6c2") : secret "insights-runtime-extractor-tls" not found Jun 15 09:18:13.618949 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:13.618902 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7edc68f5-6516-4e19-9443-48747149b6c2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:18.093644 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:18.093602 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" podUID="157076da-2dc6-471f-a92a-1ec7199c39f3" Jun 15 09:18:18.094063 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:18.093716 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6nxv9" podUID="9aa4f83a-1cc9-490e-857d-8f7108c065d7" Jun 15 09:18:18.094063 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:18.093823 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" Jun 15 09:18:18.448302 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:18.448275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:18:18.448470 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:18.448309 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:18:18.448470 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:18.448402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nxv9" Jun 15 09:18:21.371198 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.371162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:18:21.371198 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.371198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:18:21.371818 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.371272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:18:21.373614 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.373590 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"image-registry-85f578b465-w9fw6\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:18:21.373614 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.373612 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9aa4f83a-1cc9-490e-857d-8f7108c065d7-metrics-tls\") pod \"dns-default-6nxv9\" (UID: \"9aa4f83a-1cc9-490e-857d-8f7108c065d7\") " pod="openshift-dns/dns-default-6nxv9" Jun 15 09:18:21.373762 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.373612 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/157076da-2dc6-471f-a92a-1ec7199c39f3-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-lnwqc\" (UID: \"157076da-2dc6-471f-a92a-1ec7199c39f3\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:18:21.452063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.452041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7dsb\"" Jun 15 09:18:21.452173 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.452075 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wb5cc\"" Jun 15 09:18:21.452173 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.452105 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-25zgd\"" Jun 15 09:18:21.459508 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.459490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" Jun 15 09:18:21.459611 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.459519 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:18:21.459611 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.459537 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nxv9" Jun 15 09:18:21.601027 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.600999 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-lnwqc"] Jun 15 09:18:21.604503 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:18:21.604466 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157076da_2dc6_471f_a92a_1ec7199c39f3.slice/crio-6caeed585c5219fe3cb6faa8b0b365e90ea693c67bb1c64e75a948e54cb1fcfb WatchSource:0}: Error finding container 6caeed585c5219fe3cb6faa8b0b365e90ea693c67bb1c64e75a948e54cb1fcfb: Status 404 returned error can't find the container with id 6caeed585c5219fe3cb6faa8b0b365e90ea693c67bb1c64e75a948e54cb1fcfb Jun 15 09:18:21.765637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.765603 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" podUID="454376a7-6ced-4c4e-85dc-bb31a2f7b3eb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 09:18:21.824126 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.824101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6nxv9"] Jun 15 09:18:21.827042 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:21.827021 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f578b465-w9fw6"] Jun 15 09:18:21.828143 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:18:21.828111 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa4f83a_1cc9_490e_857d_8f7108c065d7.slice/crio-f0b199f1e5919919bfe294ebce386ff29a17db52b63658c57a481e3f367fb95f WatchSource:0}: Error finding container f0b199f1e5919919bfe294ebce386ff29a17db52b63658c57a481e3f367fb95f: Status 404 returned error can't find the container with id f0b199f1e5919919bfe294ebce386ff29a17db52b63658c57a481e3f367fb95f Jun 15 09:18:21.829841 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:18:21.829811 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a5301b_257a_4f61_82b3_8a328d3a8cb0.slice/crio-61aed011c26a1c4c362c1ae47af3b5e01e2fb143bbab7f032113af33efde3a18 WatchSource:0}: Error finding container 61aed011c26a1c4c362c1ae47af3b5e01e2fb143bbab7f032113af33efde3a18: Status 404 returned error can't find the container with id 61aed011c26a1c4c362c1ae47af3b5e01e2fb143bbab7f032113af33efde3a18 Jun 15 09:18:22.462769 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.462520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" event={"ID":"07a5301b-257a-4f61-82b3-8a328d3a8cb0","Type":"ContainerStarted","Data":"93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63"} Jun 15 09:18:22.462769 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.462583 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" event={"ID":"07a5301b-257a-4f61-82b3-8a328d3a8cb0","Type":"ContainerStarted","Data":"61aed011c26a1c4c362c1ae47af3b5e01e2fb143bbab7f032113af33efde3a18"} Jun 15 09:18:22.462769 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.462714 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:18:22.463982 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.463954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nxv9" event={"ID":"9aa4f83a-1cc9-490e-857d-8f7108c065d7","Type":"ContainerStarted","Data":"f0b199f1e5919919bfe294ebce386ff29a17db52b63658c57a481e3f367fb95f"} Jun 15 09:18:22.465606 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.465575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" event={"ID":"157076da-2dc6-471f-a92a-1ec7199c39f3","Type":"ContainerStarted","Data":"6caeed585c5219fe3cb6faa8b0b365e90ea693c67bb1c64e75a948e54cb1fcfb"} Jun 15 09:18:22.468445 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.468418 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c03bde2-7214-45dd-b800-0de3427b4fde" containerID="563a131831ddeef545f2e5eea2928d64555052c648722fc48d205f1b4b9f57cf" exitCode=255 Jun 15 09:18:22.468553 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.468465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" event={"ID":"3c03bde2-7214-45dd-b800-0de3427b4fde","Type":"ContainerDied","Data":"563a131831ddeef545f2e5eea2928d64555052c648722fc48d205f1b4b9f57cf"} Jun 15 09:18:22.468553 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.468520 2572 scope.go:117] "RemoveContainer" containerID="ace26bd8c52c63ea1badf7a5a74f392b8f2e3c07ccd4be2bcfe270a7fcef7518" Jun 15 09:18:22.469095 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.468825 2572 scope.go:117] "RemoveContainer" containerID="563a131831ddeef545f2e5eea2928d64555052c648722fc48d205f1b4b9f57cf" Jun 15 09:18:22.469095 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:22.469023 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7b96bc9ccb-649l5_open-cluster-management-agent-addon(3c03bde2-7214-45dd-b800-0de3427b4fde)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" podUID="3c03bde2-7214-45dd-b800-0de3427b4fde" Jun 15 09:18:22.483266 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:22.483172 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" podStartSLOduration=285.483154398 podStartE2EDuration="4m45.483154398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:18:22.481807022 +0000 UTC m=+286.441647800" watchObservedRunningTime="2026-06-15 09:18:22.483154398 +0000 UTC m=+286.442995162" Jun 15 09:18:23.121857 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.121814 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" podUID="8c0290eb-b138-450b-b965-36b56f01d740" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused" Jun 15 09:18:23.475278 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.475244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" event={"ID":"157076da-2dc6-471f-a92a-1ec7199c39f3","Type":"ContainerStarted","Data":"d02eb3883b779f45e7b26a3262f9d1485ac4bda76e220f774fe265207f3f1598"} Jun 15 09:18:23.483665 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.483637 2572 generic.go:356] "Generic (PLEG): container finished" podID="8c0290eb-b138-450b-b965-36b56f01d740" containerID="f57a874e10d41d12055e20ff85aeb78697e31ea1efd9d6742c17d9600ae0c8b4" exitCode=1 Jun 15 09:18:23.483799 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.483718 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" event={"ID":"8c0290eb-b138-450b-b965-36b56f01d740","Type":"ContainerDied","Data":"f57a874e10d41d12055e20ff85aeb78697e31ea1efd9d6742c17d9600ae0c8b4"} Jun 15 09:18:23.483932 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.483911 2572 scope.go:117] "RemoveContainer" containerID="11099c9e3adae1765932c12d720ac9585decc513ba8637444de0a270df0376b1" Jun 15 09:18:23.484195 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.484176 2572 scope.go:117] "RemoveContainer" containerID="f57a874e10d41d12055e20ff85aeb78697e31ea1efd9d6742c17d9600ae0c8b4" Jun 15 09:18:23.484362 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:23.484337 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-595bf48776-7bcvt_open-cluster-management-agent-addon(8c0290eb-b138-450b-b965-36b56f01d740)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" podUID="8c0290eb-b138-450b-b965-36b56f01d740" Jun 15 09:18:23.492069 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:23.492020 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-lnwqc" podStartSLOduration=264.458216536 podStartE2EDuration="4m25.492003806s" totalImagesPullingTime="1.03378727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:18:23.491416378 +0000 UTC m=+287.451257177" watchObservedRunningTime="2026-06-15 09:18:23.492003806 +0000 UTC m=+287.451844569" Jun 15 09:18:24.487856 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:24.487818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nxv9" event={"ID":"9aa4f83a-1cc9-490e-857d-8f7108c065d7","Type":"ContainerStarted","Data":"3cec4acba04a46c55ed7e2371931f8233f493f98fbf786a4102dff7796a0789b"} Jun 15 09:18:24.488294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:24.487878 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nxv9" event={"ID":"9aa4f83a-1cc9-490e-857d-8f7108c065d7","Type":"ContainerStarted","Data":"324db8dead02539c0c4735cce55f8ce4b834f0b585379a1969a8b06c61b13204"} Jun 15 09:18:24.488294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:24.487944 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6nxv9" Jun 15 09:18:24.504913 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:24.504874 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6nxv9" podStartSLOduration=251.886558213 podStartE2EDuration="4m13.50486131s" totalImagesPullingTime="1.618303097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:18:24.503364831 +0000 UTC m=+288.463205595" watchObservedRunningTime="2026-06-15 09:18:24.50486131 +0000 UTC m=+288.464702072" Jun 15 09:18:29.630629 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:29.630595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:29.632812 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:29.632791 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7edc68f5-6516-4e19-9443-48747149b6c2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbckg\" (UID: \"7edc68f5-6516-4e19-9443-48747149b6c2\") " pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:29.652817 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:29.652792 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nbckg" Jun 15 09:18:29.772380 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:29.772295 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nbckg"] Jun 15 09:18:29.778085 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:18:29.778051 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edc68f5_6516_4e19_9443_48747149b6c2.slice/crio-a1cacea5e93a1a694ded318bad9baaf20f97a1eaf2f79baa36a4d3cf61171e71 WatchSource:0}: Error finding container a1cacea5e93a1a694ded318bad9baaf20f97a1eaf2f79baa36a4d3cf61171e71: Status 404 returned error can't find the container with id a1cacea5e93a1a694ded318bad9baaf20f97a1eaf2f79baa36a4d3cf61171e71 Jun 15 09:18:30.433629 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:30.433581 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cvd6z" podUID="0b1550fb-2331-4d01-8b86-4762fb506edb" Jun 15 09:18:30.509109 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:30.509023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbckg" event={"ID":"7edc68f5-6516-4e19-9443-48747149b6c2","Type":"ContainerStarted","Data":"a1cacea5e93a1a694ded318bad9baaf20f97a1eaf2f79baa36a4d3cf61171e71"} Jun 15 09:18:31.749195 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.749162 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:18:31.749585 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.749547 2572 scope.go:117] "RemoveContainer" containerID="f57a874e10d41d12055e20ff85aeb78697e31ea1efd9d6742c17d9600ae0c8b4" Jun 15 09:18:31.749779 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:31.749754 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-595bf48776-7bcvt_open-cluster-management-agent-addon(8c0290eb-b138-450b-b965-36b56f01d740)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" podUID="8c0290eb-b138-450b-b965-36b56f01d740" Jun 15 09:18:31.766081 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.766052 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" podUID="454376a7-6ced-4c4e-85dc-bb31a2f7b3eb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 09:18:31.766213 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.766119 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" Jun 15 09:18:31.766613 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.766582 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"98a5425c9b261bd587d391491f08f61299d2b243f2adf29fafc10c8bcd9397fc"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 15 09:18:31.766696 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.766637 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" podUID="454376a7-6ced-4c4e-85dc-bb31a2f7b3eb" containerName="service-proxy" containerID="cri-o://98a5425c9b261bd587d391491f08f61299d2b243f2adf29fafc10c8bcd9397fc" gracePeriod=30 Jun 15 09:18:31.771158 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.771135 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" Jun 15 09:18:31.772042 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:31.771432 2572 scope.go:117] "RemoveContainer" containerID="563a131831ddeef545f2e5eea2928d64555052c648722fc48d205f1b4b9f57cf" Jun 15 09:18:31.772042 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:31.771594 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7b96bc9ccb-649l5_open-cluster-management-agent-addon(3c03bde2-7214-45dd-b800-0de3427b4fde)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" podUID="3c03bde2-7214-45dd-b800-0de3427b4fde" Jun 15 09:18:33.121235 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.121192 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:18:33.121680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.121612 2572 scope.go:117] "RemoveContainer" containerID="f57a874e10d41d12055e20ff85aeb78697e31ea1efd9d6742c17d9600ae0c8b4" Jun 15 09:18:33.520317 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.520234 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" event={"ID":"8c0290eb-b138-450b-b965-36b56f01d740","Type":"ContainerStarted","Data":"d0459972e22112dfb8addfe2ebfeb89a13b57307755c5b03af48e8762dea1e7d"} Jun 15 09:18:33.520584 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.520553 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:18:33.521779 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.521760 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-595bf48776-7bcvt" Jun 15 09:18:33.521931 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.521910 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbckg" event={"ID":"7edc68f5-6516-4e19-9443-48747149b6c2","Type":"ContainerStarted","Data":"1ea661003de0b66547d073a9ba22b28f4f74529a8220fe4e7f48e9a85959df55"} Jun 15 09:18:33.524018 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.523997 2572 generic.go:356] "Generic (PLEG): container finished" podID="454376a7-6ced-4c4e-85dc-bb31a2f7b3eb" containerID="98a5425c9b261bd587d391491f08f61299d2b243f2adf29fafc10c8bcd9397fc" exitCode=2 Jun 15 09:18:33.524107 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.524044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" event={"ID":"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb","Type":"ContainerDied","Data":"98a5425c9b261bd587d391491f08f61299d2b243f2adf29fafc10c8bcd9397fc"} Jun 15 09:18:33.524107 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:33.524085 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b9f65458-hknhz" event={"ID":"454376a7-6ced-4c4e-85dc-bb31a2f7b3eb","Type":"ContainerStarted","Data":"d43b84e36efb5f9ef6738b5bea1a322adab52c34b62f35f7a3d45cb76a821f8d"} Jun 15 09:18:34.494809 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:34.494779 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6nxv9" Jun 15 09:18:34.530304 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:34.530254 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbckg" event={"ID":"7edc68f5-6516-4e19-9443-48747149b6c2","Type":"ContainerStarted","Data":"919d40c7ad779e94681a6d16f9d7e9c43d60308fc41c2bd8b13521097adf77ec"} Jun 15 09:18:36.373730 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:36.373700 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:18:36.373730 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:36.373706 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:18:36.376562 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:36.376540 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 09:18:36.539066 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:36.539033 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbckg" event={"ID":"7edc68f5-6516-4e19-9443-48747149b6c2","Type":"ContainerStarted","Data":"8f3c6a83317f179f78274c33f0caf87c96f90a11287da3d269b22e409d2b68ae"} Jun 15 09:18:36.556079 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:36.556035 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nbckg" podStartSLOduration=33.561830968 podStartE2EDuration="39.556021445s" totalImagesPullingTime="5.994190477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:17:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:18:36.554378925 +0000 UTC m=+300.514219706" watchObservedRunningTime="2026-06-15 09:18:36.556021445 +0000 UTC m=+300.515862206" Jun 15 09:18:37.837219 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.837182 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d6zjm"] Jun 15 09:18:37.840361 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.840340 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.843308 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.843286 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 09:18:37.844094 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.844065 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 09:18:37.844204 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.844092 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gwglw\"" Jun 15 09:18:37.844204 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.844151 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 09:18:37.844299 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.844222 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 09:18:37.844353 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.844323 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 09:18:37.844399 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.844367 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 09:18:37.889127 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qlc7\" (UniqueName: \"kubernetes.io/projected/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-kube-api-access-5qlc7\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889172 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-wtmp\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-tls\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889360 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-metrics-client-ca\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889360 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-textfile\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889360 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-root\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889360 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-sys\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.889483 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.889377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990386 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qlc7\" (UniqueName: \"kubernetes.io/projected/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-kube-api-access-5qlc7\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990517 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-wtmp\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990517 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990420 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990517 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-tls\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990517 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-metrics-client-ca\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990517 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990505 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-textfile\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990528 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-root\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:37.990540 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-sys\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990553 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-wtmp\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990611 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-sys\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-root\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.990813 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:18:37.990654 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-tls podName:80ba47b7-4570-4e62-87fc-9291b8bbaaaa nodeName:}" failed. No retries permitted until 2026-06-15 09:18:38.490636071 +0000 UTC m=+302.450476811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-tls") pod "node-exporter-d6zjm" (UID: "80ba47b7-4570-4e62-87fc-9291b8bbaaaa") : secret "node-exporter-tls" not found Jun 15 09:18:37.991125 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.990998 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-textfile\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.991160 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.991144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.991198 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.991174 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-metrics-client-ca\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:37.992703 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:37.992683 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:38.000528 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:38.000507 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qlc7\" (UniqueName: \"kubernetes.io/projected/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-kube-api-access-5qlc7\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:38.494567 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:38.494535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-tls\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:38.496705 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:38.496688 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80ba47b7-4570-4e62-87fc-9291b8bbaaaa-node-exporter-tls\") pod \"node-exporter-d6zjm\" (UID: \"80ba47b7-4570-4e62-87fc-9291b8bbaaaa\") " pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:38.748878 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:38.748803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6zjm" Jun 15 09:18:38.760771 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:18:38.760726 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ba47b7_4570_4e62_87fc_9291b8bbaaaa.slice/crio-a3d920dae796bd8a0c2c969ffa55420676e9afa8a704b8bc678f9f7212afa4b5 WatchSource:0}: Error finding container a3d920dae796bd8a0c2c969ffa55420676e9afa8a704b8bc678f9f7212afa4b5: Status 404 returned error can't find the container with id a3d920dae796bd8a0c2c969ffa55420676e9afa8a704b8bc678f9f7212afa4b5 Jun 15 09:18:38.762717 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:38.762701 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 09:18:39.549248 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:39.549222 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6zjm" event={"ID":"80ba47b7-4570-4e62-87fc-9291b8bbaaaa","Type":"ContainerStarted","Data":"d7ef1e0fd60da3a4e4094195319cac921e9b9c761143d29daa95563ad10925d0"} Jun 15 09:18:39.549530 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:39.549271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6zjm" event={"ID":"80ba47b7-4570-4e62-87fc-9291b8bbaaaa","Type":"ContainerStarted","Data":"a3d920dae796bd8a0c2c969ffa55420676e9afa8a704b8bc678f9f7212afa4b5"} Jun 15 09:18:40.553098 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:40.553065 2572 generic.go:356] "Generic (PLEG): container finished" podID="80ba47b7-4570-4e62-87fc-9291b8bbaaaa" containerID="d7ef1e0fd60da3a4e4094195319cac921e9b9c761143d29daa95563ad10925d0" exitCode=0 Jun 15 09:18:40.553458 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:40.553128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6zjm" event={"ID":"80ba47b7-4570-4e62-87fc-9291b8bbaaaa","Type":"ContainerDied","Data":"d7ef1e0fd60da3a4e4094195319cac921e9b9c761143d29daa95563ad10925d0"} Jun 15 09:18:41.464001 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:41.463970 2572 patch_prober.go:28] interesting pod/image-registry-85f578b465-w9fw6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 09:18:41.464160 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:41.464021 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 09:18:41.558395 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:41.558361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6zjm" event={"ID":"80ba47b7-4570-4e62-87fc-9291b8bbaaaa","Type":"ContainerStarted","Data":"b93a79f6c7a3b298f2f0096fc27fe4c6b7e64269b27c70cdbaa37bf7e3b64e62"} Jun 15 09:18:41.558730 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:41.558449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6zjm" event={"ID":"80ba47b7-4570-4e62-87fc-9291b8bbaaaa","Type":"ContainerStarted","Data":"9cf1b22bdda514232cec751024fb69b62b6bab077270ef50d334fbf6dad678c2"} Jun 15 09:18:41.579231 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:41.579185 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d6zjm" podStartSLOduration=3.818610847 podStartE2EDuration="4.579171926s" totalImagesPullingTime="697.955013ms" totalInitContainerRuntime="62.606066ms" isStatefulPod=true podCreationTimestamp="2026-06-15 09:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:18:41.577852033 +0000 UTC m=+305.537692796" watchObservedRunningTime="2026-06-15 09:18:41.579171926 +0000 UTC m=+305.539012725" Jun 15 09:18:42.432904 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:42.432875 2572 scope.go:117] "RemoveContainer" containerID="563a131831ddeef545f2e5eea2928d64555052c648722fc48d205f1b4b9f57cf" Jun 15 09:18:42.565356 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:42.565319 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b96bc9ccb-649l5" event={"ID":"3c03bde2-7214-45dd-b800-0de3427b4fde","Type":"ContainerStarted","Data":"044e27bde53e8f9104a19c634d55c77d675a63a0f7e4295523d3609ee82b9b7f"} Jun 15 09:18:43.488438 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:43.488404 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:18:44.432845 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:44.432809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:18:44.792287 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:18:44.792255 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f578b465-w9fw6"] Jun 15 09:19:09.811296 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:09.811254 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" containerName="registry" containerID="cri-o://93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63" gracePeriod=30 Jun 15 09:19:10.055084 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.055061 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:19:10.201497 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201466 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07a5301b-257a-4f61-82b3-8a328d3a8cb0-ca-trust-extracted\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201497 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201498 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-certificates\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201752 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201523 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-trusted-ca\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201752 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201544 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx7rs\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-kube-api-access-cx7rs\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201752 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201576 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-image-registry-private-configuration\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201752 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201626 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201752 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201666 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-installation-pull-secrets\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.201752 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201689 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-bound-sa-token\") pod \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\" (UID: \"07a5301b-257a-4f61-82b3-8a328d3a8cb0\") " Jun 15 09:19:10.202067 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.201965 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 09:19:10.202067 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.202002 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 09:19:10.204098 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.204063 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-kube-api-access-cx7rs" (OuterVolumeSpecName: "kube-api-access-cx7rs") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "kube-api-access-cx7rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:19:10.204343 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.204317 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:19:10.204440 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.204387 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 09:19:10.204440 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.204415 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:19:10.204544 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.204469 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 09:19:10.212558 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.212532 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07a5301b-257a-4f61-82b3-8a328d3a8cb0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "07a5301b-257a-4f61-82b3-8a328d3a8cb0" (UID: "07a5301b-257a-4f61-82b3-8a328d3a8cb0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:19:10.303116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303079 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07a5301b-257a-4f61-82b3-8a328d3a8cb0-ca-trust-extracted\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303115 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-certificates\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303126 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07a5301b-257a-4f61-82b3-8a328d3a8cb0-trusted-ca\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303289 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303135 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx7rs\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-kube-api-access-cx7rs\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303289 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303145 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-image-registry-private-configuration\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303289 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303154 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-registry-tls\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303289 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303162 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07a5301b-257a-4f61-82b3-8a328d3a8cb0-installation-pull-secrets\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.303289 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.303170 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a5301b-257a-4f61-82b3-8a328d3a8cb0-bound-sa-token\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:19:10.654646 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.654562 2572 generic.go:356] "Generic (PLEG): container finished" podID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" containerID="93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63" exitCode=0 Jun 15 09:19:10.654646 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.654611 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" Jun 15 09:19:10.654646 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.654627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" event={"ID":"07a5301b-257a-4f61-82b3-8a328d3a8cb0","Type":"ContainerDied","Data":"93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63"} Jun 15 09:19:10.654884 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.654674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f578b465-w9fw6" event={"ID":"07a5301b-257a-4f61-82b3-8a328d3a8cb0","Type":"ContainerDied","Data":"61aed011c26a1c4c362c1ae47af3b5e01e2fb143bbab7f032113af33efde3a18"} Jun 15 09:19:10.654884 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.654702 2572 scope.go:117] "RemoveContainer" containerID="93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63" Jun 15 09:19:10.662474 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.662454 2572 scope.go:117] "RemoveContainer" containerID="93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63" Jun 15 09:19:10.662758 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:19:10.662720 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63\": container with ID starting with 93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63 not found: ID does not exist" containerID="93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63" Jun 15 09:19:10.662810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.662769 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63"} err="failed to get container status \"93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63\": rpc error: code = NotFound desc = could not find container \"93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63\": container with ID starting with 93b7d194aaed20f9720bd420bb40510b190c069152e85ce5836bf8a742307a63 not found: ID does not exist" Jun 15 09:19:10.673796 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.673772 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f578b465-w9fw6"] Jun 15 09:19:10.678668 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:10.678646 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85f578b465-w9fw6"] Jun 15 09:19:12.437449 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:12.437408 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" path="/var/lib/kubelet/pods/07a5301b-257a-4f61-82b3-8a328d3a8cb0/volumes" Jun 15 09:19:50.369171 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:50.369135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:19:50.371340 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:50.371319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b1550fb-2331-4d01-8b86-4762fb506edb-metrics-certs\") pod \"network-metrics-daemon-cvd6z\" (UID: \"0b1550fb-2331-4d01-8b86-4762fb506edb\") " pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:19:50.436473 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:50.436450 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5jg97\"" Jun 15 09:19:50.443319 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:50.443301 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvd6z" Jun 15 09:19:50.569645 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:50.569615 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvd6z"] Jun 15 09:19:50.572560 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:19:50.572534 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1550fb_2331_4d01_8b86_4762fb506edb.slice/crio-d11ad58151753c046122f1cea0e877e969e53c5c12176ee22e6f2c77e2c03ab6 WatchSource:0}: Error finding container d11ad58151753c046122f1cea0e877e969e53c5c12176ee22e6f2c77e2c03ab6: Status 404 returned error can't find the container with id d11ad58151753c046122f1cea0e877e969e53c5c12176ee22e6f2c77e2c03ab6 Jun 15 09:19:50.784771 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:50.784724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvd6z" event={"ID":"0b1550fb-2331-4d01-8b86-4762fb506edb","Type":"ContainerStarted","Data":"d11ad58151753c046122f1cea0e877e969e53c5c12176ee22e6f2c77e2c03ab6"} Jun 15 09:19:51.790449 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:51.790418 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvd6z" event={"ID":"0b1550fb-2331-4d01-8b86-4762fb506edb","Type":"ContainerStarted","Data":"5d23b81a09ad6f747f8a23057b487e8f4229319e74ca0210eb69a65bc68ad0ed"} Jun 15 09:19:51.790873 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:51.790497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvd6z" event={"ID":"0b1550fb-2331-4d01-8b86-4762fb506edb","Type":"ContainerStarted","Data":"9fc125203cc35df7caa239cc70ab388e99aca3625127fed014a38272257bb276"} Jun 15 09:19:51.805925 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:19:51.805879 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cvd6z" podStartSLOduration=374.97388542 podStartE2EDuration="6m15.805866108s" totalImagesPullingTime="831.980688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:19:51.805154054 +0000 UTC m=+375.764994823" watchObservedRunningTime="2026-06-15 09:19:51.805866108 +0000 UTC m=+375.765706870" Jun 15 09:21:23.005254 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.002987 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v"] Jun 15 09:21:23.005254 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.003480 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" containerName="registry" Jun 15 09:21:23.005254 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.003498 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" containerName="registry" Jun 15 09:21:23.005254 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.003602 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a5301b-257a-4f61-82b3-8a328d3a8cb0" containerName="registry" Jun 15 09:21:23.007377 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.007346 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.009633 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.009612 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 09:21:23.009724 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.009614 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 09:21:23.010284 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.010265 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6vfcw\"" Jun 15 09:21:23.013100 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.013080 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v"] Jun 15 09:21:23.049266 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.049241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpfx4\" (UniqueName: \"kubernetes.io/projected/e076a543-cee9-4f4c-89f9-99522183a4f3-kube-api-access-bpfx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.049356 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.049270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.049356 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.049292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.150566 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.150543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpfx4\" (UniqueName: \"kubernetes.io/projected/e076a543-cee9-4f4c-89f9-99522183a4f3-kube-api-access-bpfx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.150675 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.150571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.150675 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.150593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.151034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.151014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.151034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.151027 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.161542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.161516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpfx4\" (UniqueName: \"kubernetes.io/projected/e076a543-cee9-4f4c-89f9-99522183a4f3-kube-api-access-bpfx4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.317333 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.317271 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:23.455101 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:23.455066 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v"] Jun 15 09:21:23.459314 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:21:23.459280 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode076a543_cee9_4f4c_89f9_99522183a4f3.slice/crio-7d1b37cb56ddeaaa3b23666870b673ad0c5b2ec1c53be0eafd9ff5a22b5a35ab WatchSource:0}: Error finding container 7d1b37cb56ddeaaa3b23666870b673ad0c5b2ec1c53be0eafd9ff5a22b5a35ab: Status 404 returned error can't find the container with id 7d1b37cb56ddeaaa3b23666870b673ad0c5b2ec1c53be0eafd9ff5a22b5a35ab Jun 15 09:21:24.078371 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:24.078334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" event={"ID":"e076a543-cee9-4f4c-89f9-99522183a4f3","Type":"ContainerStarted","Data":"7d1b37cb56ddeaaa3b23666870b673ad0c5b2ec1c53be0eafd9ff5a22b5a35ab"} Jun 15 09:21:30.101721 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:30.101684 2572 generic.go:356] "Generic (PLEG): container finished" podID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerID="f4ea4182587bcd9dde6ebb4119c265783fc31862a9be69868f967fcc402c8a6b" exitCode=0 Jun 15 09:21:30.102092 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:30.101776 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" event={"ID":"e076a543-cee9-4f4c-89f9-99522183a4f3","Type":"ContainerDied","Data":"f4ea4182587bcd9dde6ebb4119c265783fc31862a9be69868f967fcc402c8a6b"} Jun 15 09:21:32.109663 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:32.109626 2572 generic.go:356] "Generic (PLEG): container finished" podID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerID="7a4942352998be545eafcd32a238abf56a45025f5313ea8ffa0b6f4267fc0184" exitCode=0 Jun 15 09:21:32.109989 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:32.109697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" event={"ID":"e076a543-cee9-4f4c-89f9-99522183a4f3","Type":"ContainerDied","Data":"7a4942352998be545eafcd32a238abf56a45025f5313ea8ffa0b6f4267fc0184"} Jun 15 09:21:39.135523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:39.135493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" event={"ID":"e076a543-cee9-4f4c-89f9-99522183a4f3","Type":"ContainerStarted","Data":"8b5c8a10b7ef273046f24603f08e00d63d13613f32ea3a0c42463e8b3286916f"} Jun 15 09:21:39.152789 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:39.152722 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" podStartSLOduration=2.394460793 podStartE2EDuration="17.152706858s" totalImagesPullingTime="14.758246065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:21:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:21:39.151570942 +0000 UTC m=+483.111411704" watchObservedRunningTime="2026-06-15 09:21:39.152706858 +0000 UTC m=+483.112547634" Jun 15 09:21:40.140576 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:40.140537 2572 generic.go:356] "Generic (PLEG): container finished" podID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerID="8b5c8a10b7ef273046f24603f08e00d63d13613f32ea3a0c42463e8b3286916f" exitCode=0 Jun 15 09:21:40.140576 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:40.140580 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" event={"ID":"e076a543-cee9-4f4c-89f9-99522183a4f3","Type":"ContainerDied","Data":"8b5c8a10b7ef273046f24603f08e00d63d13613f32ea3a0c42463e8b3286916f"} Jun 15 09:21:41.262639 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.262616 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:41.385412 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.385384 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpfx4\" (UniqueName: \"kubernetes.io/projected/e076a543-cee9-4f4c-89f9-99522183a4f3-kube-api-access-bpfx4\") pod \"e076a543-cee9-4f4c-89f9-99522183a4f3\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " Jun 15 09:21:41.385538 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.385426 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-util\") pod \"e076a543-cee9-4f4c-89f9-99522183a4f3\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " Jun 15 09:21:41.385538 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.385460 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-bundle\") pod \"e076a543-cee9-4f4c-89f9-99522183a4f3\" (UID: \"e076a543-cee9-4f4c-89f9-99522183a4f3\") " Jun 15 09:21:41.386127 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.386103 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-bundle" (OuterVolumeSpecName: "bundle") pod "e076a543-cee9-4f4c-89f9-99522183a4f3" (UID: "e076a543-cee9-4f4c-89f9-99522183a4f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:21:41.387575 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.387549 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e076a543-cee9-4f4c-89f9-99522183a4f3-kube-api-access-bpfx4" (OuterVolumeSpecName: "kube-api-access-bpfx4") pod "e076a543-cee9-4f4c-89f9-99522183a4f3" (UID: "e076a543-cee9-4f4c-89f9-99522183a4f3"). InnerVolumeSpecName "kube-api-access-bpfx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:21:41.389511 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.389487 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-util" (OuterVolumeSpecName: "util") pod "e076a543-cee9-4f4c-89f9-99522183a4f3" (UID: "e076a543-cee9-4f4c-89f9-99522183a4f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:21:41.486009 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.485989 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:21:41.486009 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.486008 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpfx4\" (UniqueName: \"kubernetes.io/projected/e076a543-cee9-4f4c-89f9-99522183a4f3-kube-api-access-bpfx4\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:21:41.486144 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:41.486017 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e076a543-cee9-4f4c-89f9-99522183a4f3-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:21:42.148719 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:42.148694 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" Jun 15 09:21:42.148894 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:42.148687 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d54t5v" event={"ID":"e076a543-cee9-4f4c-89f9-99522183a4f3","Type":"ContainerDied","Data":"7d1b37cb56ddeaaa3b23666870b673ad0c5b2ec1c53be0eafd9ff5a22b5a35ab"} Jun 15 09:21:42.148894 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:42.148815 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d1b37cb56ddeaaa3b23666870b673ad0c5b2ec1c53be0eafd9ff5a22b5a35ab" Jun 15 09:21:50.380421 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380383 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt"] Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380629 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="extract" Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380640 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="extract" Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380650 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="util" Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380656 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="util" Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380669 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="pull" Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380675 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="pull" Jun 15 09:21:50.380941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.380714 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e076a543-cee9-4f4c-89f9-99522183a4f3" containerName="extract" Jun 15 09:21:50.428696 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.428663 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt"] Jun 15 09:21:50.428863 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.428834 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.431079 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.431061 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 09:21:50.431837 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.431823 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6vfcw\"" Jun 15 09:21:50.431885 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.431862 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 09:21:50.546980 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.546947 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.546980 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.546981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.547191 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.547001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmvkz\" (UniqueName: \"kubernetes.io/projected/4b62ddc0-f41c-4271-b9d9-df74df3a2587-kube-api-access-hmvkz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.647547 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.647461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.647547 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.647496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.647547 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.647524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmvkz\" (UniqueName: \"kubernetes.io/projected/4b62ddc0-f41c-4271-b9d9-df74df3a2587-kube-api-access-hmvkz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.647856 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.647838 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.647941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.647920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.663326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.663300 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmvkz\" (UniqueName: \"kubernetes.io/projected/4b62ddc0-f41c-4271-b9d9-df74df3a2587-kube-api-access-hmvkz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.737636 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.737601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:50.876478 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:50.876455 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt"] Jun 15 09:21:50.878898 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:21:50.878872 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b62ddc0_f41c_4271_b9d9_df74df3a2587.slice/crio-cbc436b53aa4ec5aea835eceb4c3285598c0d35d41e07f6b5a4ee91f3b93dc9b WatchSource:0}: Error finding container cbc436b53aa4ec5aea835eceb4c3285598c0d35d41e07f6b5a4ee91f3b93dc9b: Status 404 returned error can't find the container with id cbc436b53aa4ec5aea835eceb4c3285598c0d35d41e07f6b5a4ee91f3b93dc9b Jun 15 09:21:51.178682 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:51.178601 2572 generic.go:356] "Generic (PLEG): container finished" podID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerID="dd7fdfc288f35b37230bba90780b1f3347ee6534a8836cddf99e451209b18f77" exitCode=0 Jun 15 09:21:51.178852 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:51.178690 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" event={"ID":"4b62ddc0-f41c-4271-b9d9-df74df3a2587","Type":"ContainerDied","Data":"dd7fdfc288f35b37230bba90780b1f3347ee6534a8836cddf99e451209b18f77"} Jun 15 09:21:51.178852 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:51.178769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" event={"ID":"4b62ddc0-f41c-4271-b9d9-df74df3a2587","Type":"ContainerStarted","Data":"cbc436b53aa4ec5aea835eceb4c3285598c0d35d41e07f6b5a4ee91f3b93dc9b"} Jun 15 09:21:53.189868 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:53.189834 2572 generic.go:356] "Generic (PLEG): container finished" podID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerID="eb65edf73d959d32f2bf84774b73289caf5704a082dc9a507369adc895f527ce" exitCode=0 Jun 15 09:21:53.190202 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:53.189935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" event={"ID":"4b62ddc0-f41c-4271-b9d9-df74df3a2587","Type":"ContainerDied","Data":"eb65edf73d959d32f2bf84774b73289caf5704a082dc9a507369adc895f527ce"} Jun 15 09:21:54.195657 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:54.195621 2572 generic.go:356] "Generic (PLEG): container finished" podID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerID="2dcb7c7c12e2dfdfeee794eef14166a5dcb745f2e9eec338a24b4b25c89ab881" exitCode=0 Jun 15 09:21:54.196036 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:54.195682 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" event={"ID":"4b62ddc0-f41c-4271-b9d9-df74df3a2587","Type":"ContainerDied","Data":"2dcb7c7c12e2dfdfeee794eef14166a5dcb745f2e9eec338a24b4b25c89ab881"} Jun 15 09:21:55.326453 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.326426 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:55.484849 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.484760 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-bundle\") pod \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " Jun 15 09:21:55.484849 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.484815 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-util\") pod \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " Jun 15 09:21:55.484849 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.484836 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmvkz\" (UniqueName: \"kubernetes.io/projected/4b62ddc0-f41c-4271-b9d9-df74df3a2587-kube-api-access-hmvkz\") pod \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\" (UID: \"4b62ddc0-f41c-4271-b9d9-df74df3a2587\") " Jun 15 09:21:55.485250 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.485202 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-bundle" (OuterVolumeSpecName: "bundle") pod "4b62ddc0-f41c-4271-b9d9-df74df3a2587" (UID: "4b62ddc0-f41c-4271-b9d9-df74df3a2587"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:21:55.486841 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.486817 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b62ddc0-f41c-4271-b9d9-df74df3a2587-kube-api-access-hmvkz" (OuterVolumeSpecName: "kube-api-access-hmvkz") pod "4b62ddc0-f41c-4271-b9d9-df74df3a2587" (UID: "4b62ddc0-f41c-4271-b9d9-df74df3a2587"). InnerVolumeSpecName "kube-api-access-hmvkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:21:55.490602 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.490578 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-util" (OuterVolumeSpecName: "util") pod "4b62ddc0-f41c-4271-b9d9-df74df3a2587" (UID: "4b62ddc0-f41c-4271-b9d9-df74df3a2587"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:21:55.585523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.585486 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:21:55.585523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.585516 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmvkz\" (UniqueName: \"kubernetes.io/projected/4b62ddc0-f41c-4271-b9d9-df74df3a2587-kube-api-access-hmvkz\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:21:55.585523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:55.585530 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b62ddc0-f41c-4271-b9d9-df74df3a2587-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:21:56.204872 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:56.204836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" event={"ID":"4b62ddc0-f41c-4271-b9d9-df74df3a2587","Type":"ContainerDied","Data":"cbc436b53aa4ec5aea835eceb4c3285598c0d35d41e07f6b5a4ee91f3b93dc9b"} Jun 15 09:21:56.204872 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:56.204856 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6bqt" Jun 15 09:21:56.205071 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:56.204888 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbc436b53aa4ec5aea835eceb4c3285598c0d35d41e07f6b5a4ee91f3b93dc9b" Jun 15 09:21:57.494930 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.494898 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k"] Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495134 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="util" Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495145 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="util" Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495152 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="extract" Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495158 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="extract" Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495169 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="pull" Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495175 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="pull" Jun 15 09:21:57.495270 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.495212 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b62ddc0-f41c-4271-b9d9-df74df3a2587" containerName="extract" Jun 15 09:21:57.497500 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.497485 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.499630 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.499598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 09:21:57.500369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.500345 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 09:21:57.500369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.500361 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r99vn\"" Jun 15 09:21:57.508378 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.508357 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k"] Jun 15 09:21:57.598817 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.598789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlpl\" (UniqueName: \"kubernetes.io/projected/1ee2c3ce-16b2-452b-9d2f-c0642ea41719-kube-api-access-7qlpl\") pod \"cert-manager-webhook-7dc76cbb94-7qf2k\" (UID: \"1ee2c3ce-16b2-452b-9d2f-c0642ea41719\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.598927 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.598835 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ee2c3ce-16b2-452b-9d2f-c0642ea41719-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7qf2k\" (UID: \"1ee2c3ce-16b2-452b-9d2f-c0642ea41719\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.699237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.699203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ee2c3ce-16b2-452b-9d2f-c0642ea41719-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7qf2k\" (UID: \"1ee2c3ce-16b2-452b-9d2f-c0642ea41719\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.699347 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.699267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlpl\" (UniqueName: \"kubernetes.io/projected/1ee2c3ce-16b2-452b-9d2f-c0642ea41719-kube-api-access-7qlpl\") pod \"cert-manager-webhook-7dc76cbb94-7qf2k\" (UID: \"1ee2c3ce-16b2-452b-9d2f-c0642ea41719\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.707773 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.707725 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ee2c3ce-16b2-452b-9d2f-c0642ea41719-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7qf2k\" (UID: \"1ee2c3ce-16b2-452b-9d2f-c0642ea41719\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.708269 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.708250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlpl\" (UniqueName: \"kubernetes.io/projected/1ee2c3ce-16b2-452b-9d2f-c0642ea41719-kube-api-access-7qlpl\") pod \"cert-manager-webhook-7dc76cbb94-7qf2k\" (UID: \"1ee2c3ce-16b2-452b-9d2f-c0642ea41719\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.806575 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.806512 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:21:57.927616 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:57.927465 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k"] Jun 15 09:21:57.929663 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:21:57.929623 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ee2c3ce_16b2_452b_9d2f_c0642ea41719.slice/crio-38877abc6da11087375b906c604763e584ec6703b58c5fcb22e61ffac4e6a4f7 WatchSource:0}: Error finding container 38877abc6da11087375b906c604763e584ec6703b58c5fcb22e61ffac4e6a4f7: Status 404 returned error can't find the container with id 38877abc6da11087375b906c604763e584ec6703b58c5fcb22e61ffac4e6a4f7 Jun 15 09:21:58.213911 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:21:58.213876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" event={"ID":"1ee2c3ce-16b2-452b-9d2f-c0642ea41719","Type":"ContainerStarted","Data":"38877abc6da11087375b906c604763e584ec6703b58c5fcb22e61ffac4e6a4f7"} Jun 15 09:22:01.227082 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:01.227040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" event={"ID":"1ee2c3ce-16b2-452b-9d2f-c0642ea41719","Type":"ContainerStarted","Data":"19161a29fac60bd5ffb71b7c5b7c63c6843ef5139071538723e8eda2508d5a52"} Jun 15 09:22:01.227479 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:01.227185 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:22:01.243331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:01.243288 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" podStartSLOduration=1.6043818829999998 podStartE2EDuration="4.243274336s" totalImagesPullingTime="2.638892453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:22:01.242082118 +0000 UTC m=+505.201922898" watchObservedRunningTime="2026-06-15 09:22:01.243274336 +0000 UTC m=+505.203115098" Jun 15 09:22:07.232683 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:07.232652 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7qf2k" Jun 15 09:22:10.042724 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.042684 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-9ptls"] Jun 15 09:22:10.046031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.046009 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.047985 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.047959 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7d59q\"" Jun 15 09:22:10.055557 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.055525 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-9ptls"] Jun 15 09:22:10.193472 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.193436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672d9ea2-0e7e-4635-9b78-832ca8436217-bound-sa-token\") pod \"cert-manager-59c77684cc-9ptls\" (UID: \"672d9ea2-0e7e-4635-9b78-832ca8436217\") " pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.193472 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.193477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bmcg\" (UniqueName: \"kubernetes.io/projected/672d9ea2-0e7e-4635-9b78-832ca8436217-kube-api-access-5bmcg\") pod \"cert-manager-59c77684cc-9ptls\" (UID: \"672d9ea2-0e7e-4635-9b78-832ca8436217\") " pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.293930 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.293814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bmcg\" (UniqueName: \"kubernetes.io/projected/672d9ea2-0e7e-4635-9b78-832ca8436217-kube-api-access-5bmcg\") pod \"cert-manager-59c77684cc-9ptls\" (UID: \"672d9ea2-0e7e-4635-9b78-832ca8436217\") " pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.293930 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.293927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672d9ea2-0e7e-4635-9b78-832ca8436217-bound-sa-token\") pod \"cert-manager-59c77684cc-9ptls\" (UID: \"672d9ea2-0e7e-4635-9b78-832ca8436217\") " pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.303804 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.303774 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672d9ea2-0e7e-4635-9b78-832ca8436217-bound-sa-token\") pod \"cert-manager-59c77684cc-9ptls\" (UID: \"672d9ea2-0e7e-4635-9b78-832ca8436217\") " pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.303994 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.303977 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bmcg\" (UniqueName: \"kubernetes.io/projected/672d9ea2-0e7e-4635-9b78-832ca8436217-kube-api-access-5bmcg\") pod \"cert-manager-59c77684cc-9ptls\" (UID: \"672d9ea2-0e7e-4635-9b78-832ca8436217\") " pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.354970 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.354938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-9ptls" Jun 15 09:22:10.477655 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:10.477559 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-9ptls"] Jun 15 09:22:10.480265 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:22:10.480239 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod672d9ea2_0e7e_4635_9b78_832ca8436217.slice/crio-e45a699220a47f92fbce2aa5dc56d2ad2adcb4b079d185708a8e9ac9327f1b6f WatchSource:0}: Error finding container e45a699220a47f92fbce2aa5dc56d2ad2adcb4b079d185708a8e9ac9327f1b6f: Status 404 returned error can't find the container with id e45a699220a47f92fbce2aa5dc56d2ad2adcb4b079d185708a8e9ac9327f1b6f Jun 15 09:22:11.263595 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:11.263561 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-9ptls" event={"ID":"672d9ea2-0e7e-4635-9b78-832ca8436217","Type":"ContainerStarted","Data":"1cff162ce423ad9e581b356e389d4e0394fed738581500d21616902e6618214b"} Jun 15 09:22:11.263595 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:11.263600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-9ptls" event={"ID":"672d9ea2-0e7e-4635-9b78-832ca8436217","Type":"ContainerStarted","Data":"e45a699220a47f92fbce2aa5dc56d2ad2adcb4b079d185708a8e9ac9327f1b6f"} Jun 15 09:22:11.283188 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:11.283143 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-9ptls" podStartSLOduration=1.283128083 podStartE2EDuration="1.283128083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:22:11.281724392 +0000 UTC m=+515.241565175" watchObservedRunningTime="2026-06-15 09:22:11.283128083 +0000 UTC m=+515.242968843" Jun 15 09:22:17.240258 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.240220 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7"] Jun 15 09:22:17.243476 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.243459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.245701 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.245669 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 09:22:17.245867 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.245851 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 09:22:17.246460 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.246446 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6vfcw\"" Jun 15 09:22:17.251533 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.251511 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7"] Jun 15 09:22:17.340910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.340879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.341041 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.340914 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.341041 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.340932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22tp5\" (UniqueName: \"kubernetes.io/projected/b8de6e86-9644-4069-ae2d-4054324e344e-kube-api-access-22tp5\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.441868 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.441834 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.442021 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.441886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.442021 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.441912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22tp5\" (UniqueName: \"kubernetes.io/projected/b8de6e86-9644-4069-ae2d-4054324e344e-kube-api-access-22tp5\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.442294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.442267 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.442360 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.442303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.450017 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.449994 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22tp5\" (UniqueName: \"kubernetes.io/projected/b8de6e86-9644-4069-ae2d-4054324e344e-kube-api-access-22tp5\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.553793 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.553715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:17.677338 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:17.677212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7"] Jun 15 09:22:17.679291 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:22:17.679263 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8de6e86_9644_4069_ae2d_4054324e344e.slice/crio-95600705e493d399ab62b995dad39ce24d7fad1a31c3a2712cdc4e8cc696d540 WatchSource:0}: Error finding container 95600705e493d399ab62b995dad39ce24d7fad1a31c3a2712cdc4e8cc696d540: Status 404 returned error can't find the container with id 95600705e493d399ab62b995dad39ce24d7fad1a31c3a2712cdc4e8cc696d540 Jun 15 09:22:18.288543 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:18.288505 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8de6e86-9644-4069-ae2d-4054324e344e" containerID="efb3f0e920527cf26d41f861cba00e97313d30301628ab2c44893c4443d257aa" exitCode=0 Jun 15 09:22:18.288945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:18.288592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" event={"ID":"b8de6e86-9644-4069-ae2d-4054324e344e","Type":"ContainerDied","Data":"efb3f0e920527cf26d41f861cba00e97313d30301628ab2c44893c4443d257aa"} Jun 15 09:22:18.288945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:18.288648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" event={"ID":"b8de6e86-9644-4069-ae2d-4054324e344e","Type":"ContainerStarted","Data":"95600705e493d399ab62b995dad39ce24d7fad1a31c3a2712cdc4e8cc696d540"} Jun 15 09:22:19.293665 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:19.293636 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8de6e86-9644-4069-ae2d-4054324e344e" containerID="ede73eb716529c0bbf0bdd4e603f4510413c9f7ca96f8dcb1a4801b8a468b678" exitCode=0 Jun 15 09:22:19.294035 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:19.293700 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" event={"ID":"b8de6e86-9644-4069-ae2d-4054324e344e","Type":"ContainerDied","Data":"ede73eb716529c0bbf0bdd4e603f4510413c9f7ca96f8dcb1a4801b8a468b678"} Jun 15 09:22:20.298784 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:20.298724 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8de6e86-9644-4069-ae2d-4054324e344e" containerID="66a6b2ba5a51eb80855b833781ec94691994ccb234fe0a235b7b4d2a5c814b2e" exitCode=0 Jun 15 09:22:20.298784 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:20.298765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" event={"ID":"b8de6e86-9644-4069-ae2d-4054324e344e","Type":"ContainerDied","Data":"66a6b2ba5a51eb80855b833781ec94691994ccb234fe0a235b7b4d2a5c814b2e"} Jun 15 09:22:21.424369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.424343 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:21.468442 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.468412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22tp5\" (UniqueName: \"kubernetes.io/projected/b8de6e86-9644-4069-ae2d-4054324e344e-kube-api-access-22tp5\") pod \"b8de6e86-9644-4069-ae2d-4054324e344e\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " Jun 15 09:22:21.468666 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.468446 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-util\") pod \"b8de6e86-9644-4069-ae2d-4054324e344e\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " Jun 15 09:22:21.468666 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.468472 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-bundle\") pod \"b8de6e86-9644-4069-ae2d-4054324e344e\" (UID: \"b8de6e86-9644-4069-ae2d-4054324e344e\") " Jun 15 09:22:21.469224 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.469201 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-bundle" (OuterVolumeSpecName: "bundle") pod "b8de6e86-9644-4069-ae2d-4054324e344e" (UID: "b8de6e86-9644-4069-ae2d-4054324e344e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:22:21.470345 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.470321 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8de6e86-9644-4069-ae2d-4054324e344e-kube-api-access-22tp5" (OuterVolumeSpecName: "kube-api-access-22tp5") pod "b8de6e86-9644-4069-ae2d-4054324e344e" (UID: "b8de6e86-9644-4069-ae2d-4054324e344e"). InnerVolumeSpecName "kube-api-access-22tp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:22:21.476762 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.476711 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-util" (OuterVolumeSpecName: "util") pod "b8de6e86-9644-4069-ae2d-4054324e344e" (UID: "b8de6e86-9644-4069-ae2d-4054324e344e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:22:21.569582 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.569529 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:22:21.569582 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.569551 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22tp5\" (UniqueName: \"kubernetes.io/projected/b8de6e86-9644-4069-ae2d-4054324e344e-kube-api-access-22tp5\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:22:21.569582 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:21.569561 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8de6e86-9644-4069-ae2d-4054324e344e-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:22:22.306810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:22.306779 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" event={"ID":"b8de6e86-9644-4069-ae2d-4054324e344e","Type":"ContainerDied","Data":"95600705e493d399ab62b995dad39ce24d7fad1a31c3a2712cdc4e8cc696d540"} Jun 15 09:22:22.306810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:22.306813 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdr85p7" Jun 15 09:22:22.306810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:22.306825 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95600705e493d399ab62b995dad39ce24d7fad1a31c3a2712cdc4e8cc696d540" Jun 15 09:22:34.292357 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292284 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp"] Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292512 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="util" Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292523 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="util" Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292536 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="extract" Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292542 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="extract" Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292554 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="pull" Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292558 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="pull" Jun 15 09:22:34.292718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.292598 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8de6e86-9644-4069-ae2d-4054324e344e" containerName="extract" Jun 15 09:22:34.296718 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.296702 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.299029 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.299006 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 09:22:34.299145 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.299020 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 09:22:34.299145 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.299101 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pv6sp\"" Jun 15 09:22:34.299326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.299313 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 09:22:34.299563 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.299546 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 09:22:34.314754 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.311925 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp"] Jun 15 09:22:34.343822 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.343790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04159138-804b-4008-86eb-50cc2e251f6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.343960 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.343829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04159138-804b-4008-86eb-50cc2e251f6e-manifests\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.343960 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.343851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh8fk\" (UniqueName: \"kubernetes.io/projected/04159138-804b-4008-86eb-50cc2e251f6e-kube-api-access-kh8fk\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.343960 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.343871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04159138-804b-4008-86eb-50cc2e251f6e-tmp\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.343960 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.343914 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04159138-804b-4008-86eb-50cc2e251f6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.445110 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.445078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04159138-804b-4008-86eb-50cc2e251f6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.445110 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.445112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04159138-804b-4008-86eb-50cc2e251f6e-manifests\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.445326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.445134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh8fk\" (UniqueName: \"kubernetes.io/projected/04159138-804b-4008-86eb-50cc2e251f6e-kube-api-access-kh8fk\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.445326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.445163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04159138-804b-4008-86eb-50cc2e251f6e-tmp\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.445326 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.445212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04159138-804b-4008-86eb-50cc2e251f6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.445576 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.445551 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04159138-804b-4008-86eb-50cc2e251f6e-manifests\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.447491 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.447459 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04159138-804b-4008-86eb-50cc2e251f6e-tmp\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.447768 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.447729 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04159138-804b-4008-86eb-50cc2e251f6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.447814 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.447768 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04159138-804b-4008-86eb-50cc2e251f6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.458865 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.458836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh8fk\" (UniqueName: \"kubernetes.io/projected/04159138-804b-4008-86eb-50cc2e251f6e-kube-api-access-kh8fk\") pod \"opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp\" (UID: \"04159138-804b-4008-86eb-50cc2e251f6e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.606606 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.606512 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:34.740362 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:34.740322 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp"] Jun 15 09:22:34.743317 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:22:34.743287 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04159138_804b_4008_86eb_50cc2e251f6e.slice/crio-e2fcc81875eef2dee62f3b793f9fadaa4fc5d9dcb2e5b5954711f97000aa9a86 WatchSource:0}: Error finding container e2fcc81875eef2dee62f3b793f9fadaa4fc5d9dcb2e5b5954711f97000aa9a86: Status 404 returned error can't find the container with id e2fcc81875eef2dee62f3b793f9fadaa4fc5d9dcb2e5b5954711f97000aa9a86 Jun 15 09:22:35.356512 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:35.356472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" event={"ID":"04159138-804b-4008-86eb-50cc2e251f6e","Type":"ContainerStarted","Data":"e2fcc81875eef2dee62f3b793f9fadaa4fc5d9dcb2e5b5954711f97000aa9a86"} Jun 15 09:22:38.372162 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:38.372122 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" event={"ID":"04159138-804b-4008-86eb-50cc2e251f6e","Type":"ContainerStarted","Data":"ef312fc30292ead7c4ff73de22e895d67de1c419710c53202a10d01fc25426f9"} Jun 15 09:22:39.378018 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:39.377979 2572 generic.go:356] "Generic (PLEG): container finished" podID="04159138-804b-4008-86eb-50cc2e251f6e" containerID="ef312fc30292ead7c4ff73de22e895d67de1c419710c53202a10d01fc25426f9" exitCode=0 Jun 15 09:22:39.378483 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:39.378039 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" event={"ID":"04159138-804b-4008-86eb-50cc2e251f6e","Type":"ContainerDied","Data":"ef312fc30292ead7c4ff73de22e895d67de1c419710c53202a10d01fc25426f9"} Jun 15 09:22:40.383787 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:40.383723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" event={"ID":"04159138-804b-4008-86eb-50cc2e251f6e","Type":"ContainerStarted","Data":"16516cf23a393734f73dd647eb31a2a6ec4f6c6ca83fb58a910f8b3af3744324"} Jun 15 09:22:40.384242 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:40.383894 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:40.410851 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:40.410631 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" podStartSLOduration=1.875992104 podStartE2EDuration="6.410617809s" totalImagesPullingTime="3.560750235s" totalInitContainerRuntime="973.87547ms" isStatefulPod=false podCreationTimestamp="2026-06-15 09:22:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:22:40.409004476 +0000 UTC m=+544.368845238" watchObservedRunningTime="2026-06-15 09:22:40.410617809 +0000 UTC m=+544.370458570" Jun 15 09:22:51.389659 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:51.389624 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp" Jun 15 09:22:54.497366 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.497328 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4"] Jun 15 09:22:54.505712 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.505689 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.508337 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.508313 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-486nx\"" Jun 15 09:22:54.508470 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.508351 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 09:22:54.509000 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.508979 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 09:22:54.509116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.509055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 09:22:54.509116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.509093 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 09:22:54.513910 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.513879 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4"] Jun 15 09:22:54.515960 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.515933 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-72c97"] Jun 15 09:22:54.519095 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.519079 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:54.521533 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.521514 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 15 09:22:54.522155 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.522138 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l9hv2\"" Jun 15 09:22:54.533948 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.533925 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-72c97"] Jun 15 09:22:54.592117 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.592083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rlrd\" (UniqueName: \"kubernetes.io/projected/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-kube-api-access-2rlrd\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:54.592238 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.592120 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rmpw\" (UniqueName: \"kubernetes.io/projected/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-kube-api-access-7rmpw\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.592238 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.592143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-cert\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:54.592238 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.592166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-tls-certs\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.592238 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.592228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-tmp\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.693127 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.693082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlrd\" (UniqueName: \"kubernetes.io/projected/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-kube-api-access-2rlrd\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:54.693127 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.693123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rmpw\" (UniqueName: \"kubernetes.io/projected/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-kube-api-access-7rmpw\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.693406 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.693141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-cert\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:54.693406 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.693186 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-tls-certs\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.693406 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.693215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-tmp\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.693406 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:22:54.693386 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 15 09:22:54.693607 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:22:54.693455 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-cert podName:c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c nodeName:}" failed. No retries permitted until 2026-06-15 09:22:55.193435667 +0000 UTC m=+559.153276416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-cert") pod "odh-model-controller-6dc94f689f-72c97" (UID: "c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c") : secret "odh-model-controller-webhook-cert" not found Jun 15 09:22:54.695703 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.695675 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-tls-certs\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.695903 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.695886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-tmp\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.708556 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.708526 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rmpw\" (UniqueName: \"kubernetes.io/projected/7d7a4466-c3c9-4ffe-b367-eb5435b7b38d-kube-api-access-7rmpw\") pod \"kube-auth-proxy-5b6c667b66-kkbr4\" (UID: \"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d\") " pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.708686 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.708561 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rlrd\" (UniqueName: \"kubernetes.io/projected/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-kube-api-access-2rlrd\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:54.817261 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.817164 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" Jun 15 09:22:54.955216 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:54.955007 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4"] Jun 15 09:22:54.957894 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:22:54.957864 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7a4466_c3c9_4ffe_b367_eb5435b7b38d.slice/crio-70ed5d975c159d9eed87d7d2eeff1c05d39788bb6b5df9c04c41fb3b795ab010 WatchSource:0}: Error finding container 70ed5d975c159d9eed87d7d2eeff1c05d39788bb6b5df9c04c41fb3b795ab010: Status 404 returned error can't find the container with id 70ed5d975c159d9eed87d7d2eeff1c05d39788bb6b5df9c04c41fb3b795ab010 Jun 15 09:22:55.125537 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.125458 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-jsnp5"] Jun 15 09:22:55.129791 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.129775 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.131797 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.131773 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 15 09:22:55.143937 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.143910 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-jsnp5"] Jun 15 09:22:55.197272 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.197239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e0fc050-0bd9-4324-a909-0d786444c736-tls-certs\") pod \"model-serving-api-5dd488fc48-jsnp5\" (UID: \"4e0fc050-0bd9-4324-a909-0d786444c736\") " pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.197411 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.197308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-cert\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:55.197411 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.197351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lqc\" (UniqueName: \"kubernetes.io/projected/4e0fc050-0bd9-4324-a909-0d786444c736-kube-api-access-j2lqc\") pod \"model-serving-api-5dd488fc48-jsnp5\" (UID: \"4e0fc050-0bd9-4324-a909-0d786444c736\") " pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.199679 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.199651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c-cert\") pod \"odh-model-controller-6dc94f689f-72c97\" (UID: \"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c\") " pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:55.298282 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.298229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lqc\" (UniqueName: \"kubernetes.io/projected/4e0fc050-0bd9-4324-a909-0d786444c736-kube-api-access-j2lqc\") pod \"model-serving-api-5dd488fc48-jsnp5\" (UID: \"4e0fc050-0bd9-4324-a909-0d786444c736\") " pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.298460 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.298324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e0fc050-0bd9-4324-a909-0d786444c736-tls-certs\") pod \"model-serving-api-5dd488fc48-jsnp5\" (UID: \"4e0fc050-0bd9-4324-a909-0d786444c736\") " pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.300703 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.300679 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e0fc050-0bd9-4324-a909-0d786444c736-tls-certs\") pod \"model-serving-api-5dd488fc48-jsnp5\" (UID: \"4e0fc050-0bd9-4324-a909-0d786444c736\") " pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.306885 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.306852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lqc\" (UniqueName: \"kubernetes.io/projected/4e0fc050-0bd9-4324-a909-0d786444c736-kube-api-access-j2lqc\") pod \"model-serving-api-5dd488fc48-jsnp5\" (UID: \"4e0fc050-0bd9-4324-a909-0d786444c736\") " pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.428501 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.428404 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:22:55.439527 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.439503 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:22:55.444404 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.444377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" event={"ID":"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d","Type":"ContainerStarted","Data":"70ed5d975c159d9eed87d7d2eeff1c05d39788bb6b5df9c04c41fb3b795ab010"} Jun 15 09:22:55.582318 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.582285 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-72c97"] Jun 15 09:22:55.587244 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:22:55.587213 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b3ba20_3fb5_4bc8_80d9_6882e09fee0c.slice/crio-fe3cc179775e2dba3bf5a54cd858a7f9d317afa0a1a8583b6c2091d47822ff0e WatchSource:0}: Error finding container fe3cc179775e2dba3bf5a54cd858a7f9d317afa0a1a8583b6c2091d47822ff0e: Status 404 returned error can't find the container with id fe3cc179775e2dba3bf5a54cd858a7f9d317afa0a1a8583b6c2091d47822ff0e Jun 15 09:22:55.603969 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:55.603895 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-jsnp5"] Jun 15 09:22:55.607272 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:22:55.607244 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0fc050_0bd9_4324_a909_0d786444c736.slice/crio-ced8c7e3a55667510dd9548efa9577e915c157f847d4fbfebfa5bc9aa037c7bc WatchSource:0}: Error finding container ced8c7e3a55667510dd9548efa9577e915c157f847d4fbfebfa5bc9aa037c7bc: Status 404 returned error can't find the container with id ced8c7e3a55667510dd9548efa9577e915c157f847d4fbfebfa5bc9aa037c7bc Jun 15 09:22:56.452819 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:56.452777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" event={"ID":"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c","Type":"ContainerStarted","Data":"fe3cc179775e2dba3bf5a54cd858a7f9d317afa0a1a8583b6c2091d47822ff0e"} Jun 15 09:22:56.455329 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:56.455298 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" event={"ID":"4e0fc050-0bd9-4324-a909-0d786444c736","Type":"ContainerStarted","Data":"ced8c7e3a55667510dd9548efa9577e915c157f847d4fbfebfa5bc9aa037c7bc"} Jun 15 09:22:57.377764 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.376486 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb"] Jun 15 09:22:57.383149 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.382192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.387371 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.386928 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 09:22:57.388830 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.387997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 09:22:57.388830 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.388230 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6vfcw\"" Jun 15 09:22:57.392997 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.391656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb"] Jun 15 09:22:57.526678 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.526637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.526879 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.526714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.526879 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.526780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgctb\" (UniqueName: \"kubernetes.io/projected/2587fea5-4a58-46dc-96cd-ca12e511938d-kube-api-access-cgctb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.627763 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.627543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.627763 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.627606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgctb\" (UniqueName: \"kubernetes.io/projected/2587fea5-4a58-46dc-96cd-ca12e511938d-kube-api-access-cgctb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.627763 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.627673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.628106 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.627964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.628106 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.628074 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.636969 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.636943 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgctb\" (UniqueName: \"kubernetes.io/projected/2587fea5-4a58-46dc-96cd-ca12e511938d-kube-api-access-cgctb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:22:57.697584 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:22:57.697398 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:23:00.844508 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:00.844479 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb"] Jun 15 09:23:00.846841 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:00.846820 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2587fea5_4a58_46dc_96cd_ca12e511938d.slice/crio-f074e3e5f604d45afdca3dd00769cae66f2d0be5d67b5d55171a98c7882a762c WatchSource:0}: Error finding container f074e3e5f604d45afdca3dd00769cae66f2d0be5d67b5d55171a98c7882a762c: Status 404 returned error can't find the container with id f074e3e5f604d45afdca3dd00769cae66f2d0be5d67b5d55171a98c7882a762c Jun 15 09:23:01.482099 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.482061 2572 generic.go:356] "Generic (PLEG): container finished" podID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerID="d2a6313b37a70132c4bbe28bf40c2145d63113625fd76d89dfd243c4492149f6" exitCode=0 Jun 15 09:23:01.482281 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.482153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" event={"ID":"2587fea5-4a58-46dc-96cd-ca12e511938d","Type":"ContainerDied","Data":"d2a6313b37a70132c4bbe28bf40c2145d63113625fd76d89dfd243c4492149f6"} Jun 15 09:23:01.482281 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.482209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" event={"ID":"2587fea5-4a58-46dc-96cd-ca12e511938d","Type":"ContainerStarted","Data":"f074e3e5f604d45afdca3dd00769cae66f2d0be5d67b5d55171a98c7882a762c"} Jun 15 09:23:01.483778 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.483752 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" event={"ID":"c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c","Type":"ContainerStarted","Data":"28d639c30de6a4f1621e67291b40ff2805e9f128fcbf084a704396d63dc762ca"} Jun 15 09:23:01.483874 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.483813 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:23:01.485199 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.485175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" event={"ID":"7d7a4466-c3c9-4ffe-b367-eb5435b7b38d","Type":"ContainerStarted","Data":"82cc04400fea4caacbf05dce22e964ff1c5e4851916a35d940ed26c16b3aab2e"} Jun 15 09:23:01.486582 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.486560 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" event={"ID":"4e0fc050-0bd9-4324-a909-0d786444c736","Type":"ContainerStarted","Data":"51fa28d761c3323691ab60e582aad4e8f0f4ae0a5cf9184abbcd8acb7db5a75a"} Jun 15 09:23:01.486709 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.486694 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:23:01.536947 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.536884 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" podStartSLOduration=1.457780346 podStartE2EDuration="6.536864053s" totalImagesPullingTime="5.079083707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:01.53528616 +0000 UTC m=+565.495126947" watchObservedRunningTime="2026-06-15 09:23:01.536864053 +0000 UTC m=+565.496704816" Jun 15 09:23:01.554700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.554650 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b6c667b66-kkbr4" podStartSLOduration=1.8131442020000001 podStartE2EDuration="7.554634835s" totalImagesPullingTime="5.741490633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:01.553386566 +0000 UTC m=+565.513227329" watchObservedRunningTime="2026-06-15 09:23:01.554634835 +0000 UTC m=+565.514475597" Jun 15 09:23:01.567689 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:01.567642 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" podStartSLOduration=2.467540338 podStartE2EDuration="7.567625595s" totalImagesPullingTime="5.100085257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:01.566730791 +0000 UTC m=+565.526571553" watchObservedRunningTime="2026-06-15 09:23:01.567625595 +0000 UTC m=+565.527466357" Jun 15 09:23:02.492618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:02.492533 2572 generic.go:356] "Generic (PLEG): container finished" podID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerID="2af6858eae67b693686e48ca21d172d88dfc2dc3c326b6436ccc0619aeb0d34a" exitCode=0 Jun 15 09:23:02.493068 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:02.492629 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" event={"ID":"2587fea5-4a58-46dc-96cd-ca12e511938d","Type":"ContainerDied","Data":"2af6858eae67b693686e48ca21d172d88dfc2dc3c326b6436ccc0619aeb0d34a"} Jun 15 09:23:03.498987 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:03.498953 2572 generic.go:356] "Generic (PLEG): container finished" podID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerID="6691fb2b25591b7be49a0a947ca3b165d0b81e64fa70df8e74cc3deb5d9fe8ee" exitCode=0 Jun 15 09:23:03.499342 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:03.498993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" event={"ID":"2587fea5-4a58-46dc-96cd-ca12e511938d","Type":"ContainerDied","Data":"6691fb2b25591b7be49a0a947ca3b165d0b81e64fa70df8e74cc3deb5d9fe8ee"} Jun 15 09:23:04.636167 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.636145 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:23:04.788206 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.788121 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgctb\" (UniqueName: \"kubernetes.io/projected/2587fea5-4a58-46dc-96cd-ca12e511938d-kube-api-access-cgctb\") pod \"2587fea5-4a58-46dc-96cd-ca12e511938d\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " Jun 15 09:23:04.788206 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.788155 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-bundle\") pod \"2587fea5-4a58-46dc-96cd-ca12e511938d\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " Jun 15 09:23:04.788206 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.788202 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-util\") pod \"2587fea5-4a58-46dc-96cd-ca12e511938d\" (UID: \"2587fea5-4a58-46dc-96cd-ca12e511938d\") " Jun 15 09:23:04.789110 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.789083 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-bundle" (OuterVolumeSpecName: "bundle") pod "2587fea5-4a58-46dc-96cd-ca12e511938d" (UID: "2587fea5-4a58-46dc-96cd-ca12e511938d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:23:04.790291 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.790269 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2587fea5-4a58-46dc-96cd-ca12e511938d-kube-api-access-cgctb" (OuterVolumeSpecName: "kube-api-access-cgctb") pod "2587fea5-4a58-46dc-96cd-ca12e511938d" (UID: "2587fea5-4a58-46dc-96cd-ca12e511938d"). InnerVolumeSpecName "kube-api-access-cgctb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:23:04.796283 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.796252 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-util" (OuterVolumeSpecName: "util") pod "2587fea5-4a58-46dc-96cd-ca12e511938d" (UID: "2587fea5-4a58-46dc-96cd-ca12e511938d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:23:04.888724 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.888687 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:23:04.888724 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.888717 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgctb\" (UniqueName: \"kubernetes.io/projected/2587fea5-4a58-46dc-96cd-ca12e511938d-kube-api-access-cgctb\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:23:04.888724 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:04.888726 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2587fea5-4a58-46dc-96cd-ca12e511938d-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:23:05.178382 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178304 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bzvqq"] Jun 15 09:23:05.178577 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178565 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="pull" Jun 15 09:23:05.178618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178579 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="pull" Jun 15 09:23:05.178618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178595 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="extract" Jun 15 09:23:05.178618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178600 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="extract" Jun 15 09:23:05.178618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178611 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="util" Jun 15 09:23:05.178618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178617 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="util" Jun 15 09:23:05.178800 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.178668 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2587fea5-4a58-46dc-96cd-ca12e511938d" containerName="extract" Jun 15 09:23:05.182040 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.182015 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.185661 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.185644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 15 09:23:05.185877 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.185862 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8pqkq\"" Jun 15 09:23:05.199133 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.199109 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bzvqq"] Jun 15 09:23:05.203201 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.203180 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt"] Jun 15 09:23:05.206080 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.206065 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.209419 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.209395 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 15 09:23:05.210340 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.210324 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rsvtx\"" Jun 15 09:23:05.227792 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.227763 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt"] Jun 15 09:23:05.292649 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.292612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnth8\" (UniqueName: \"kubernetes.io/projected/9ee4b6df-e44c-420a-8296-80abf5c6806d-kube-api-access-hnth8\") pod \"llmisvc-controller-manager-864bfd7bc9-kxzzt\" (UID: \"9ee4b6df-e44c-420a-8296-80abf5c6806d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.292649 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.292658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d56f1e-c992-4394-ba0e-68ca027488ca-cert\") pod \"kserve-controller-manager-69fc866d76-bzvqq\" (UID: \"c2d56f1e-c992-4394-ba0e-68ca027488ca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.292923 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.292686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ee4b6df-e44c-420a-8296-80abf5c6806d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxzzt\" (UID: \"9ee4b6df-e44c-420a-8296-80abf5c6806d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.292923 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.292791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jxf\" (UniqueName: \"kubernetes.io/projected/c2d56f1e-c992-4394-ba0e-68ca027488ca-kube-api-access-77jxf\") pod \"kserve-controller-manager-69fc866d76-bzvqq\" (UID: \"c2d56f1e-c992-4394-ba0e-68ca027488ca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.394018 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.393980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnth8\" (UniqueName: \"kubernetes.io/projected/9ee4b6df-e44c-420a-8296-80abf5c6806d-kube-api-access-hnth8\") pod \"llmisvc-controller-manager-864bfd7bc9-kxzzt\" (UID: \"9ee4b6df-e44c-420a-8296-80abf5c6806d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.394218 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.394033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d56f1e-c992-4394-ba0e-68ca027488ca-cert\") pod \"kserve-controller-manager-69fc866d76-bzvqq\" (UID: \"c2d56f1e-c992-4394-ba0e-68ca027488ca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.394218 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.394067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ee4b6df-e44c-420a-8296-80abf5c6806d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxzzt\" (UID: \"9ee4b6df-e44c-420a-8296-80abf5c6806d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.394218 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.394093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jxf\" (UniqueName: \"kubernetes.io/projected/c2d56f1e-c992-4394-ba0e-68ca027488ca-kube-api-access-77jxf\") pod \"kserve-controller-manager-69fc866d76-bzvqq\" (UID: \"c2d56f1e-c992-4394-ba0e-68ca027488ca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.396538 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.396512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d56f1e-c992-4394-ba0e-68ca027488ca-cert\") pod \"kserve-controller-manager-69fc866d76-bzvqq\" (UID: \"c2d56f1e-c992-4394-ba0e-68ca027488ca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.396637 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.396550 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ee4b6df-e44c-420a-8296-80abf5c6806d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxzzt\" (UID: \"9ee4b6df-e44c-420a-8296-80abf5c6806d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.406342 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.406312 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jxf\" (UniqueName: \"kubernetes.io/projected/c2d56f1e-c992-4394-ba0e-68ca027488ca-kube-api-access-77jxf\") pod \"kserve-controller-manager-69fc866d76-bzvqq\" (UID: \"c2d56f1e-c992-4394-ba0e-68ca027488ca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.406438 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.406356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnth8\" (UniqueName: \"kubernetes.io/projected/9ee4b6df-e44c-420a-8296-80abf5c6806d-kube-api-access-hnth8\") pod \"llmisvc-controller-manager-864bfd7bc9-kxzzt\" (UID: \"9ee4b6df-e44c-420a-8296-80abf5c6806d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.491894 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.491867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:05.509810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.509778 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" event={"ID":"2587fea5-4a58-46dc-96cd-ca12e511938d","Type":"ContainerDied","Data":"f074e3e5f604d45afdca3dd00769cae66f2d0be5d67b5d55171a98c7882a762c"} Jun 15 09:23:05.509810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.509802 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066bdlb" Jun 15 09:23:05.509998 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.509829 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f074e3e5f604d45afdca3dd00769cae66f2d0be5d67b5d55171a98c7882a762c" Jun 15 09:23:05.514880 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.514849 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:05.649767 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.649721 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bzvqq"] Jun 15 09:23:05.651777 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:05.651752 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d56f1e_c992_4394_ba0e_68ca027488ca.slice/crio-8242e14ae60da67963a4cdc03836b3d2958f9784f831e5d6dc3eaf269c01ffbd WatchSource:0}: Error finding container 8242e14ae60da67963a4cdc03836b3d2958f9784f831e5d6dc3eaf269c01ffbd: Status 404 returned error can't find the container with id 8242e14ae60da67963a4cdc03836b3d2958f9784f831e5d6dc3eaf269c01ffbd Jun 15 09:23:05.676045 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:05.676025 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt"] Jun 15 09:23:05.678187 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:05.678165 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9ee4b6df_e44c_420a_8296_80abf5c6806d.slice/crio-5f2a253fa61a87fcc84324877ef8b67c21e848e09a5769f0d25613f0315624ed WatchSource:0}: Error finding container 5f2a253fa61a87fcc84324877ef8b67c21e848e09a5769f0d25613f0315624ed: Status 404 returned error can't find the container with id 5f2a253fa61a87fcc84324877ef8b67c21e848e09a5769f0d25613f0315624ed Jun 15 09:23:06.520519 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:06.520474 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" event={"ID":"9ee4b6df-e44c-420a-8296-80abf5c6806d","Type":"ContainerStarted","Data":"5f2a253fa61a87fcc84324877ef8b67c21e848e09a5769f0d25613f0315624ed"} Jun 15 09:23:06.521979 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:06.521937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" event={"ID":"c2d56f1e-c992-4394-ba0e-68ca027488ca","Type":"ContainerStarted","Data":"8242e14ae60da67963a4cdc03836b3d2958f9784f831e5d6dc3eaf269c01ffbd"} Jun 15 09:23:09.537811 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:09.537776 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" event={"ID":"c2d56f1e-c992-4394-ba0e-68ca027488ca","Type":"ContainerStarted","Data":"3eeaa281edcff7baa8584248186d628c1750d7db87df4a6d0cc2a086c178f0a7"} Jun 15 09:23:09.538278 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:09.537922 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:09.539454 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:09.539427 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" event={"ID":"9ee4b6df-e44c-420a-8296-80abf5c6806d","Type":"ContainerStarted","Data":"c1aa9b3cd61c79b598174c8f5abb6463d7166895a7d7cb3d84fab85b560baecd"} Jun 15 09:23:09.539564 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:09.539493 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:09.555273 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:09.555221 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" podStartSLOduration=1.266277424 podStartE2EDuration="4.555207213s" totalImagesPullingTime="3.288929789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:09.554081734 +0000 UTC m=+573.513922515" watchObservedRunningTime="2026-06-15 09:23:09.555207213 +0000 UTC m=+573.515047975" Jun 15 09:23:09.571478 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:09.571430 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" podStartSLOduration=1.304263089 podStartE2EDuration="4.571414674s" totalImagesPullingTime="3.267151585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:09.569962553 +0000 UTC m=+573.529803317" watchObservedRunningTime="2026-06-15 09:23:09.571414674 +0000 UTC m=+573.531255435" Jun 15 09:23:12.169111 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.169076 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb"] Jun 15 09:23:12.174994 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.174976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.177620 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.177596 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 09:23:12.177770 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.177722 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6vfcw\"" Jun 15 09:23:12.178685 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.178670 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 09:23:12.183978 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.183957 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb"] Jun 15 09:23:12.349788 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.349749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd8wm\" (UniqueName: \"kubernetes.io/projected/7972cc2f-adf1-4e9c-b315-a5f28b249524-kube-api-access-fd8wm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.349788 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.349791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.350000 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.349850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.450970 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.450941 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd8wm\" (UniqueName: \"kubernetes.io/projected/7972cc2f-adf1-4e9c-b315-a5f28b249524-kube-api-access-fd8wm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.451139 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.450980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.451139 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.450997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.451322 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.451307 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.451358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.451339 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.460273 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.460246 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd8wm\" (UniqueName: \"kubernetes.io/projected/7972cc2f-adf1-4e9c-b315-a5f28b249524-kube-api-access-fd8wm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.483997 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.483968 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:12.494871 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.494844 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-72c97" Jun 15 09:23:12.498144 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.498123 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-jsnp5" Jun 15 09:23:12.632086 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:12.632059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb"] Jun 15 09:23:12.634375 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:12.634341 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7972cc2f_adf1_4e9c_b315_a5f28b249524.slice/crio-b3a8268974b3c20735a6f65c4fe5fe62bbe961f9d000a923232cec12b583ae35 WatchSource:0}: Error finding container b3a8268974b3c20735a6f65c4fe5fe62bbe961f9d000a923232cec12b583ae35: Status 404 returned error can't find the container with id b3a8268974b3c20735a6f65c4fe5fe62bbe961f9d000a923232cec12b583ae35 Jun 15 09:23:13.555203 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.555166 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q"] Jun 15 09:23:13.558136 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.558112 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.560961 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.560939 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 15 09:23:13.561627 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.561605 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7g7fb\"" Jun 15 09:23:13.561627 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.561618 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 15 09:23:13.561810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.561638 2572 generic.go:356] "Generic (PLEG): container finished" podID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerID="e7895e7083b78040c6f64346466476ba205e5ecefb2602bdf96554ab87be0970" exitCode=0 Jun 15 09:23:13.561810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.561761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" event={"ID":"7972cc2f-adf1-4e9c-b315-a5f28b249524","Type":"ContainerDied","Data":"e7895e7083b78040c6f64346466476ba205e5ecefb2602bdf96554ab87be0970"} Jun 15 09:23:13.561810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.561807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" event={"ID":"7972cc2f-adf1-4e9c-b315-a5f28b249524","Type":"ContainerStarted","Data":"b3a8268974b3c20735a6f65c4fe5fe62bbe961f9d000a923232cec12b583ae35"} Jun 15 09:23:13.573853 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.573832 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q"] Jun 15 09:23:13.661520 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.661482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/94c852d5-90ce-4239-be49-1906b10cea2e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4lf8q\" (UID: \"94c852d5-90ce-4239-be49-1906b10cea2e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.661709 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.661541 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7g86\" (UniqueName: \"kubernetes.io/projected/94c852d5-90ce-4239-be49-1906b10cea2e-kube-api-access-l7g86\") pod \"servicemesh-operator3-57f65f65fb-4lf8q\" (UID: \"94c852d5-90ce-4239-be49-1906b10cea2e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.762510 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.762414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/94c852d5-90ce-4239-be49-1906b10cea2e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4lf8q\" (UID: \"94c852d5-90ce-4239-be49-1906b10cea2e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.762510 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.762468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7g86\" (UniqueName: \"kubernetes.io/projected/94c852d5-90ce-4239-be49-1906b10cea2e-kube-api-access-l7g86\") pod \"servicemesh-operator3-57f65f65fb-4lf8q\" (UID: \"94c852d5-90ce-4239-be49-1906b10cea2e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.764962 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.764939 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/94c852d5-90ce-4239-be49-1906b10cea2e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4lf8q\" (UID: \"94c852d5-90ce-4239-be49-1906b10cea2e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.771760 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.771718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7g86\" (UniqueName: \"kubernetes.io/projected/94c852d5-90ce-4239-be49-1906b10cea2e-kube-api-access-l7g86\") pod \"servicemesh-operator3-57f65f65fb-4lf8q\" (UID: \"94c852d5-90ce-4239-be49-1906b10cea2e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:13.868090 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:13.868055 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:14.002042 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:14.002018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q"] Jun 15 09:23:14.004536 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:14.004509 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c852d5_90ce_4239_be49_1906b10cea2e.slice/crio-7faa378f757f9ed50063b74557af96ab342c467921e6dd6763faafa1b0fe4811 WatchSource:0}: Error finding container 7faa378f757f9ed50063b74557af96ab342c467921e6dd6763faafa1b0fe4811: Status 404 returned error can't find the container with id 7faa378f757f9ed50063b74557af96ab342c467921e6dd6763faafa1b0fe4811 Jun 15 09:23:14.567912 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:14.567862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" event={"ID":"94c852d5-90ce-4239-be49-1906b10cea2e","Type":"ContainerStarted","Data":"7faa378f757f9ed50063b74557af96ab342c467921e6dd6763faafa1b0fe4811"} Jun 15 09:23:15.575609 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:15.575567 2572 generic.go:356] "Generic (PLEG): container finished" podID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerID="5a5ff5603ada1e70c12e91b38381d67d29c79fde8ebdcb9e91bd0f3394307d4d" exitCode=0 Jun 15 09:23:15.576062 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:15.575657 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" event={"ID":"7972cc2f-adf1-4e9c-b315-a5f28b249524","Type":"ContainerDied","Data":"5a5ff5603ada1e70c12e91b38381d67d29c79fde8ebdcb9e91bd0f3394307d4d"} Jun 15 09:23:16.582798 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:16.582762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" event={"ID":"7972cc2f-adf1-4e9c-b315-a5f28b249524","Type":"ContainerStarted","Data":"2ecc68e766ce5ab0b4dbda4838549a34eb94877c09b05b24e57353b1c0bcbf87"} Jun 15 09:23:16.602786 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:16.602717 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" podStartSLOduration=3.546258569 podStartE2EDuration="4.602701732s" totalImagesPullingTime="1.056443163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:16.601412786 +0000 UTC m=+580.561253564" watchObservedRunningTime="2026-06-15 09:23:16.602701732 +0000 UTC m=+580.562542494" Jun 15 09:23:17.590029 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:17.589994 2572 generic.go:356] "Generic (PLEG): container finished" podID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerID="2ecc68e766ce5ab0b4dbda4838549a34eb94877c09b05b24e57353b1c0bcbf87" exitCode=0 Jun 15 09:23:17.590468 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:17.590076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" event={"ID":"7972cc2f-adf1-4e9c-b315-a5f28b249524","Type":"ContainerDied","Data":"2ecc68e766ce5ab0b4dbda4838549a34eb94877c09b05b24e57353b1c0bcbf87"} Jun 15 09:23:17.591976 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:17.591943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" event={"ID":"94c852d5-90ce-4239-be49-1906b10cea2e","Type":"ContainerStarted","Data":"a8f356261d37e9915062450263dbfad2120f1f0dad9d07a49a5bfdce209cca01"} Jun 15 09:23:17.592124 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:17.591991 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:17.628245 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:17.628199 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" podStartSLOduration=1.952006136 podStartE2EDuration="4.628184535s" totalImagesPullingTime="2.676178399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:17.626193907 +0000 UTC m=+581.586034694" watchObservedRunningTime="2026-06-15 09:23:17.628184535 +0000 UTC m=+581.588025294" Jun 15 09:23:18.732259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.732232 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:18.903777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.903663 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-bundle\") pod \"7972cc2f-adf1-4e9c-b315-a5f28b249524\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " Jun 15 09:23:18.903777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.903715 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-util\") pod \"7972cc2f-adf1-4e9c-b315-a5f28b249524\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " Jun 15 09:23:18.903777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.903758 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd8wm\" (UniqueName: \"kubernetes.io/projected/7972cc2f-adf1-4e9c-b315-a5f28b249524-kube-api-access-fd8wm\") pod \"7972cc2f-adf1-4e9c-b315-a5f28b249524\" (UID: \"7972cc2f-adf1-4e9c-b315-a5f28b249524\") " Jun 15 09:23:18.904546 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.904510 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-bundle" (OuterVolumeSpecName: "bundle") pod "7972cc2f-adf1-4e9c-b315-a5f28b249524" (UID: "7972cc2f-adf1-4e9c-b315-a5f28b249524"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:23:18.905808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.905780 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7972cc2f-adf1-4e9c-b315-a5f28b249524-kube-api-access-fd8wm" (OuterVolumeSpecName: "kube-api-access-fd8wm") pod "7972cc2f-adf1-4e9c-b315-a5f28b249524" (UID: "7972cc2f-adf1-4e9c-b315-a5f28b249524"). InnerVolumeSpecName "kube-api-access-fd8wm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:23:18.908443 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:18.908410 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-util" (OuterVolumeSpecName: "util") pod "7972cc2f-adf1-4e9c-b315-a5f28b249524" (UID: "7972cc2f-adf1-4e9c-b315-a5f28b249524"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:23:19.005315 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:19.005280 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:23:19.005315 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:19.005307 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7972cc2f-adf1-4e9c-b315-a5f28b249524-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:23:19.005315 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:19.005316 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd8wm\" (UniqueName: \"kubernetes.io/projected/7972cc2f-adf1-4e9c-b315-a5f28b249524-kube-api-access-fd8wm\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:23:19.603581 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:19.603544 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" event={"ID":"7972cc2f-adf1-4e9c-b315-a5f28b249524","Type":"ContainerDied","Data":"b3a8268974b3c20735a6f65c4fe5fe62bbe961f9d000a923232cec12b583ae35"} Jun 15 09:23:19.603768 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:19.603594 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3a8268974b3c20735a6f65c4fe5fe62bbe961f9d000a923232cec12b583ae35" Jun 15 09:23:19.603768 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:19.603557 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap4qkb" Jun 15 09:23:24.639039 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639008 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6cb79bc64-xknhh"] Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639286 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="util" Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639297 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="util" Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639306 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="pull" Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639312 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="pull" Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639329 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="extract" Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639334 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="extract" Jun 15 09:23:24.639413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.639384 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7972cc2f-adf1-4e9c-b315-a5f28b249524" containerName="extract" Jun 15 09:23:24.643083 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.643062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.645303 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.645273 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 09:23:24.645303 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.645292 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xpt4f\"" Jun 15 09:23:24.649982 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.649704 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cb79bc64-xknhh"] Jun 15 09:23:24.755109 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.755073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0df7fab3-6b09-4b23-b32b-4a31c6302f49-redirect-config\") pod \"dashboard-redirect-6cb79bc64-xknhh\" (UID: \"0df7fab3-6b09-4b23-b32b-4a31c6302f49\") " pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.755277 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.755116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxn4\" (UniqueName: \"kubernetes.io/projected/0df7fab3-6b09-4b23-b32b-4a31c6302f49-kube-api-access-vwxn4\") pod \"dashboard-redirect-6cb79bc64-xknhh\" (UID: \"0df7fab3-6b09-4b23-b32b-4a31c6302f49\") " pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.855685 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.855647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0df7fab3-6b09-4b23-b32b-4a31c6302f49-redirect-config\") pod \"dashboard-redirect-6cb79bc64-xknhh\" (UID: \"0df7fab3-6b09-4b23-b32b-4a31c6302f49\") " pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.855907 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.855692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxn4\" (UniqueName: \"kubernetes.io/projected/0df7fab3-6b09-4b23-b32b-4a31c6302f49-kube-api-access-vwxn4\") pod \"dashboard-redirect-6cb79bc64-xknhh\" (UID: \"0df7fab3-6b09-4b23-b32b-4a31c6302f49\") " pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.856353 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.856331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0df7fab3-6b09-4b23-b32b-4a31c6302f49-redirect-config\") pod \"dashboard-redirect-6cb79bc64-xknhh\" (UID: \"0df7fab3-6b09-4b23-b32b-4a31c6302f49\") " pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.865092 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.865068 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxn4\" (UniqueName: \"kubernetes.io/projected/0df7fab3-6b09-4b23-b32b-4a31c6302f49-kube-api-access-vwxn4\") pod \"dashboard-redirect-6cb79bc64-xknhh\" (UID: \"0df7fab3-6b09-4b23-b32b-4a31c6302f49\") " pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:24.953952 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:24.953919 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" Jun 15 09:23:25.083426 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:25.083401 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cb79bc64-xknhh"] Jun 15 09:23:25.085501 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:25.085473 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df7fab3_6b09_4b23_b32b_4a31c6302f49.slice/crio-ceff1f02c4cd08fcb839c94b79b4f97bf83fe8eb4a482084a8268d9834a43015 WatchSource:0}: Error finding container ceff1f02c4cd08fcb839c94b79b4f97bf83fe8eb4a482084a8268d9834a43015: Status 404 returned error can't find the container with id ceff1f02c4cd08fcb839c94b79b4f97bf83fe8eb4a482084a8268d9834a43015 Jun 15 09:23:25.639701 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:25.639637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" event={"ID":"0df7fab3-6b09-4b23-b32b-4a31c6302f49","Type":"ContainerStarted","Data":"ceff1f02c4cd08fcb839c94b79b4f97bf83fe8eb4a482084a8268d9834a43015"} Jun 15 09:23:27.650746 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:27.650711 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" event={"ID":"0df7fab3-6b09-4b23-b32b-4a31c6302f49","Type":"ContainerStarted","Data":"5a8e6839aa2e6555a8011bece2b0ce68e80c50a2f8e2aeabf1e32287bcd4530c"} Jun 15 09:23:27.666227 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:27.666182 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6cb79bc64-xknhh" podStartSLOduration=2.042719105 podStartE2EDuration="3.666167067s" totalImagesPullingTime="1.623447962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:27.66499958 +0000 UTC m=+591.624840355" watchObservedRunningTime="2026-06-15 09:23:27.666167067 +0000 UTC m=+591.626007829" Jun 15 09:23:28.598975 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:28.598943 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4lf8q" Jun 15 09:23:36.404380 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:36.404353 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:23:36.404941 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:36.404642 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:23:40.546035 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:40.546003 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxzzt" Jun 15 09:23:40.549347 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:40.549325 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bzvqq" Jun 15 09:23:43.863433 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.863376 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz"] Jun 15 09:23:43.867588 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.867564 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.872335 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.872311 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 09:23:43.872466 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.872355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 15 09:23:43.872466 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.872370 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-62ccj\"" Jun 15 09:23:43.872466 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.872422 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 15 09:23:43.872617 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.872603 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 15 09:23:43.878499 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.878475 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz"] Jun 15 09:23:43.884964 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.884940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99kqb\" (UniqueName: \"kubernetes.io/projected/3df78b61-1258-4959-9b1b-54326f0bbf22-kube-api-access-99kqb\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.885088 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.884975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.885088 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.884999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.885230 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.885094 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3df78b61-1258-4959-9b1b-54326f0bbf22-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.885230 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.885119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.885230 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.885137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.885363 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.885263 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986250 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986227 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986388 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99kqb\" (UniqueName: \"kubernetes.io/projected/3df78b61-1258-4959-9b1b-54326f0bbf22-kube-api-access-99kqb\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986388 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986388 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986388 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3df78b61-1258-4959-9b1b-54326f0bbf22-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986583 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.986583 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.986418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.987063 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.987041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.988888 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.988869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.988980 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.988872 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.989212 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.989192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3df78b61-1258-4959-9b1b-54326f0bbf22-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.989348 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.989333 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3df78b61-1258-4959-9b1b-54326f0bbf22-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.994213 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.994186 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3df78b61-1258-4959-9b1b-54326f0bbf22-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:43.994504 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:43.994485 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99kqb\" (UniqueName: \"kubernetes.io/projected/3df78b61-1258-4959-9b1b-54326f0bbf22-kube-api-access-99kqb\") pod \"istiod-openshift-gateway-75c67f8887-f2dhz\" (UID: \"3df78b61-1258-4959-9b1b-54326f0bbf22\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:44.177400 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:44.177301 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:44.309127 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:44.309105 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz"] Jun 15 09:23:44.311112 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:23:44.311082 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df78b61_1258_4959_9b1b_54326f0bbf22.slice/crio-4017b7291703aceed8ec4dd9a2fb76e0e8683871ced565745eb8ecb05a235697 WatchSource:0}: Error finding container 4017b7291703aceed8ec4dd9a2fb76e0e8683871ced565745eb8ecb05a235697: Status 404 returned error can't find the container with id 4017b7291703aceed8ec4dd9a2fb76e0e8683871ced565745eb8ecb05a235697 Jun 15 09:23:44.313176 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:44.313156 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 09:23:44.731182 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:44.731145 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" event={"ID":"3df78b61-1258-4959-9b1b-54326f0bbf22","Type":"ContainerStarted","Data":"4017b7291703aceed8ec4dd9a2fb76e0e8683871ced565745eb8ecb05a235697"} Jun 15 09:23:46.853232 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:46.853190 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 09:23:46.853523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:46.853263 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 09:23:47.748841 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:47.748800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" event={"ID":"3df78b61-1258-4959-9b1b-54326f0bbf22","Type":"ContainerStarted","Data":"367d4c2e4ac3e0629800107b2b5e23def889dbcce7c324a9626fa6b59fd4079b"} Jun 15 09:23:47.749045 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:47.748920 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:23:47.750818 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:47.750785 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-f2dhz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 15 09:23:47.750930 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:47.750845 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" podUID="3df78b61-1258-4959-9b1b-54326f0bbf22" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 09:23:47.788875 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:47.788816 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" podStartSLOduration=2.249150869 podStartE2EDuration="4.788796488s" totalImagesPullingTime="2.539645619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:23:47.784962464 +0000 UTC m=+611.744803228" watchObservedRunningTime="2026-06-15 09:23:47.788796488 +0000 UTC m=+611.748637250" Jun 15 09:23:48.753747 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:23:48.753706 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f2dhz" Jun 15 09:24:11.109259 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.109218 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns"] Jun 15 09:24:11.119782 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.119753 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns"] Jun 15 09:24:11.119927 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.119855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.121889 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.121864 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wpx4p\"" Jun 15 09:24:11.122022 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.121918 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 09:24:11.122621 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.122601 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 09:24:11.179939 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.179913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.180038 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.179943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.180038 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.179962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcp6z\" (UniqueName: \"kubernetes.io/projected/92080661-d934-4332-8140-9093a7aa2b18-kube-api-access-dcp6z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.280890 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.280860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.280975 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.280900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.280975 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.280927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcp6z\" (UniqueName: \"kubernetes.io/projected/92080661-d934-4332-8140-9093a7aa2b18-kube-api-access-dcp6z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.281221 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.281204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.281268 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.281237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.291774 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.291747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcp6z\" (UniqueName: \"kubernetes.io/projected/92080661-d934-4332-8140-9093a7aa2b18-kube-api-access-dcp6z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.429349 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.429292 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:11.554018 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.553993 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns"] Jun 15 09:24:11.556110 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:24:11.556083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92080661_d934_4332_8140_9093a7aa2b18.slice/crio-19ab4738a64b8ef836055ed03991a6c00b0bf1dfbb877b2a0a3343116f286fc8 WatchSource:0}: Error finding container 19ab4738a64b8ef836055ed03991a6c00b0bf1dfbb877b2a0a3343116f286fc8: Status 404 returned error can't find the container with id 19ab4738a64b8ef836055ed03991a6c00b0bf1dfbb877b2a0a3343116f286fc8 Jun 15 09:24:11.711190 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.711157 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt"] Jun 15 09:24:11.714542 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.714524 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.722219 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.722196 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt"] Jun 15 09:24:11.786248 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.786223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.786346 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.786269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8d6b\" (UniqueName: \"kubernetes.io/projected/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-kube-api-access-z8d6b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.786346 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.786325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.859215 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.859190 2572 generic.go:356] "Generic (PLEG): container finished" podID="92080661-d934-4332-8140-9093a7aa2b18" containerID="6508c242b62134e4a3346c45d0b6aa23bc4bdcd381a81f4086785718d4e4ccaa" exitCode=0 Jun 15 09:24:11.859316 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.859279 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" event={"ID":"92080661-d934-4332-8140-9093a7aa2b18","Type":"ContainerDied","Data":"6508c242b62134e4a3346c45d0b6aa23bc4bdcd381a81f4086785718d4e4ccaa"} Jun 15 09:24:11.859370 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.859325 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" event={"ID":"92080661-d934-4332-8140-9093a7aa2b18","Type":"ContainerStarted","Data":"19ab4738a64b8ef836055ed03991a6c00b0bf1dfbb877b2a0a3343116f286fc8"} Jun 15 09:24:11.887229 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.887205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8d6b\" (UniqueName: \"kubernetes.io/projected/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-kube-api-access-z8d6b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.887341 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.887243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.887341 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.887275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.887553 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.887535 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.887620 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.887587 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:11.895109 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:11.895089 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8d6b\" (UniqueName: \"kubernetes.io/projected/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-kube-api-access-z8d6b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:12.038483 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.038433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:12.116224 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.116194 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt"] Jun 15 09:24:12.120213 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.120187 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.129383 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.129358 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt"] Jun 15 09:24:12.182263 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.182236 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt"] Jun 15 09:24:12.184830 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:24:12.184802 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4a6fc9_72d0_42ee_95ea_4eb93cf0b893.slice/crio-7b3229a88e50be808fc6a90fdd493e3a3a9ebca6262cff6c56576e7cd7c846f5 WatchSource:0}: Error finding container 7b3229a88e50be808fc6a90fdd493e3a3a9ebca6262cff6c56576e7cd7c846f5: Status 404 returned error can't find the container with id 7b3229a88e50be808fc6a90fdd493e3a3a9ebca6262cff6c56576e7cd7c846f5 Jun 15 09:24:12.189872 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.189850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.189955 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.189884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.189993 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.189957 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98shc\" (UniqueName: \"kubernetes.io/projected/09d60c68-6f65-4a12-9e94-e7936003504b-kube-api-access-98shc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.290815 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.290729 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.290815 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.290794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.290975 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.290873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98shc\" (UniqueName: \"kubernetes.io/projected/09d60c68-6f65-4a12-9e94-e7936003504b-kube-api-access-98shc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.291142 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.291110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.291226 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.291177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.299226 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.299201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98shc\" (UniqueName: \"kubernetes.io/projected/09d60c68-6f65-4a12-9e94-e7936003504b-kube-api-access-98shc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.431919 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.431898 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:12.523678 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.523642 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9"] Jun 15 09:24:12.527825 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.527789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.535138 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.535076 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9"] Jun 15 09:24:12.570650 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.570590 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt"] Jun 15 09:24:12.593599 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.593567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.593759 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.593618 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.593759 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.593662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8q9d\" (UniqueName: \"kubernetes.io/projected/e9a725d6-1685-4b10-94e3-f00a2e9ef141-kube-api-access-r8q9d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.606486 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:24:12.606460 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d60c68_6f65_4a12_9e94_e7936003504b.slice/crio-e31ce7502906410468c669861fa1e3e471d2881862babcad950f288c2d1667ac WatchSource:0}: Error finding container e31ce7502906410468c669861fa1e3e471d2881862babcad950f288c2d1667ac: Status 404 returned error can't find the container with id e31ce7502906410468c669861fa1e3e471d2881862babcad950f288c2d1667ac Jun 15 09:24:12.694442 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.694408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.694557 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.694487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8q9d\" (UniqueName: \"kubernetes.io/projected/e9a725d6-1685-4b10-94e3-f00a2e9ef141-kube-api-access-r8q9d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.694640 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.694622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.694794 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.694766 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.695045 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.695022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.703092 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.703067 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8q9d\" (UniqueName: \"kubernetes.io/projected/e9a725d6-1685-4b10-94e3-f00a2e9ef141-kube-api-access-r8q9d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.841646 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.841586 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:12.867625 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.867599 2572 generic.go:356] "Generic (PLEG): container finished" podID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerID="b75cb4adb2f53746797974d2795afd5cdb6cff1832eb6917fe84bde5a3d1396f" exitCode=0 Jun 15 09:24:12.867721 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.867679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" event={"ID":"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893","Type":"ContainerDied","Data":"b75cb4adb2f53746797974d2795afd5cdb6cff1832eb6917fe84bde5a3d1396f"} Jun 15 09:24:12.867808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.867747 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" event={"ID":"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893","Type":"ContainerStarted","Data":"7b3229a88e50be808fc6a90fdd493e3a3a9ebca6262cff6c56576e7cd7c846f5"} Jun 15 09:24:12.869465 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.869423 2572 generic.go:356] "Generic (PLEG): container finished" podID="09d60c68-6f65-4a12-9e94-e7936003504b" containerID="b7696542b93a6e3f5adac574f0776aadd7f13b9a8853fc84400799b335ec36dd" exitCode=0 Jun 15 09:24:12.869560 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.869508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" event={"ID":"09d60c68-6f65-4a12-9e94-e7936003504b","Type":"ContainerDied","Data":"b7696542b93a6e3f5adac574f0776aadd7f13b9a8853fc84400799b335ec36dd"} Jun 15 09:24:12.869623 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.869561 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" event={"ID":"09d60c68-6f65-4a12-9e94-e7936003504b","Type":"ContainerStarted","Data":"e31ce7502906410468c669861fa1e3e471d2881862babcad950f288c2d1667ac"} Jun 15 09:24:12.871669 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.871647 2572 generic.go:356] "Generic (PLEG): container finished" podID="92080661-d934-4332-8140-9093a7aa2b18" containerID="b0cc70568e98bc48367af5256e5b99fde5fd0e51ac3228fa5143a1597998ce6c" exitCode=0 Jun 15 09:24:12.871793 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.871753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" event={"ID":"92080661-d934-4332-8140-9093a7aa2b18","Type":"ContainerDied","Data":"b0cc70568e98bc48367af5256e5b99fde5fd0e51ac3228fa5143a1597998ce6c"} Jun 15 09:24:12.976177 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:12.976155 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9"] Jun 15 09:24:12.977721 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:24:12.977694 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a725d6_1685_4b10_94e3_f00a2e9ef141.slice/crio-b776b133bfda495486ac26ea3953b165a217ce294f2bf84a931ca8af60e6fc8a WatchSource:0}: Error finding container b776b133bfda495486ac26ea3953b165a217ce294f2bf84a931ca8af60e6fc8a: Status 404 returned error can't find the container with id b776b133bfda495486ac26ea3953b165a217ce294f2bf84a931ca8af60e6fc8a Jun 15 09:24:13.878961 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.878934 2572 generic.go:356] "Generic (PLEG): container finished" podID="92080661-d934-4332-8140-9093a7aa2b18" containerID="495e708a9108c76d530dbfb0dc194a4401c34132d1498de1b769be59dcf4dcaf" exitCode=0 Jun 15 09:24:13.879368 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.879014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" event={"ID":"92080661-d934-4332-8140-9093a7aa2b18","Type":"ContainerDied","Data":"495e708a9108c76d530dbfb0dc194a4401c34132d1498de1b769be59dcf4dcaf"} Jun 15 09:24:13.880684 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.880663 2572 generic.go:356] "Generic (PLEG): container finished" podID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerID="faee8e52b512a8a1767b41f1e548d158b2a9e7a13d96cd2d976412e510e00e69" exitCode=0 Jun 15 09:24:13.880811 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.880725 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" event={"ID":"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893","Type":"ContainerDied","Data":"faee8e52b512a8a1767b41f1e548d158b2a9e7a13d96cd2d976412e510e00e69"} Jun 15 09:24:13.882366 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.882339 2572 generic.go:356] "Generic (PLEG): container finished" podID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerID="f58d0e90b4ddf8b3fb4c82b6d7c44f26293953adc1739dbbac9cdc83f6dd33f3" exitCode=0 Jun 15 09:24:13.882477 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.882379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" event={"ID":"e9a725d6-1685-4b10-94e3-f00a2e9ef141","Type":"ContainerDied","Data":"f58d0e90b4ddf8b3fb4c82b6d7c44f26293953adc1739dbbac9cdc83f6dd33f3"} Jun 15 09:24:13.882477 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:13.882438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" event={"ID":"e9a725d6-1685-4b10-94e3-f00a2e9ef141","Type":"ContainerStarted","Data":"b776b133bfda495486ac26ea3953b165a217ce294f2bf84a931ca8af60e6fc8a"} Jun 15 09:24:14.888755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:14.888664 2572 generic.go:356] "Generic (PLEG): container finished" podID="09d60c68-6f65-4a12-9e94-e7936003504b" containerID="6f792ebce1ae0017c8d3ee6960111bfc47aef9036ba08d5ed6dcd53df0fd681f" exitCode=0 Jun 15 09:24:14.889111 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:14.888750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" event={"ID":"09d60c68-6f65-4a12-9e94-e7936003504b","Type":"ContainerDied","Data":"6f792ebce1ae0017c8d3ee6960111bfc47aef9036ba08d5ed6dcd53df0fd681f"} Jun 15 09:24:14.891057 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:14.891032 2572 generic.go:356] "Generic (PLEG): container finished" podID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerID="05eda6672e89569166dea88bb298063d840c1e38f4a8cce7b763fa923d6fef70" exitCode=0 Jun 15 09:24:14.891162 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:14.891086 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" event={"ID":"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893","Type":"ContainerDied","Data":"05eda6672e89569166dea88bb298063d840c1e38f4a8cce7b763fa923d6fef70"} Jun 15 09:24:14.892945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:14.892926 2572 generic.go:356] "Generic (PLEG): container finished" podID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerID="dab1e1262de138ab0cae071bd3ce85e93c4ba1d9fdaf1cab6807b346269723f5" exitCode=0 Jun 15 09:24:14.893025 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:14.892994 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" event={"ID":"e9a725d6-1685-4b10-94e3-f00a2e9ef141","Type":"ContainerDied","Data":"dab1e1262de138ab0cae071bd3ce85e93c4ba1d9fdaf1cab6807b346269723f5"} Jun 15 09:24:15.038325 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.038298 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:15.112799 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.112779 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcp6z\" (UniqueName: \"kubernetes.io/projected/92080661-d934-4332-8140-9093a7aa2b18-kube-api-access-dcp6z\") pod \"92080661-d934-4332-8140-9093a7aa2b18\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " Jun 15 09:24:15.112901 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.112845 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-bundle\") pod \"92080661-d934-4332-8140-9093a7aa2b18\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " Jun 15 09:24:15.112901 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.112866 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-util\") pod \"92080661-d934-4332-8140-9093a7aa2b18\" (UID: \"92080661-d934-4332-8140-9093a7aa2b18\") " Jun 15 09:24:15.113345 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.113320 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-bundle" (OuterVolumeSpecName: "bundle") pod "92080661-d934-4332-8140-9093a7aa2b18" (UID: "92080661-d934-4332-8140-9093a7aa2b18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:15.114900 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.114881 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92080661-d934-4332-8140-9093a7aa2b18-kube-api-access-dcp6z" (OuterVolumeSpecName: "kube-api-access-dcp6z") pod "92080661-d934-4332-8140-9093a7aa2b18" (UID: "92080661-d934-4332-8140-9093a7aa2b18"). InnerVolumeSpecName "kube-api-access-dcp6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:24:15.118113 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.118092 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-util" (OuterVolumeSpecName: "util") pod "92080661-d934-4332-8140-9093a7aa2b18" (UID: "92080661-d934-4332-8140-9093a7aa2b18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:15.213358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.213335 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:15.213358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.213356 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92080661-d934-4332-8140-9093a7aa2b18-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:15.213478 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.213365 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcp6z\" (UniqueName: \"kubernetes.io/projected/92080661-d934-4332-8140-9093a7aa2b18-kube-api-access-dcp6z\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:15.900509 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.900475 2572 generic.go:356] "Generic (PLEG): container finished" podID="09d60c68-6f65-4a12-9e94-e7936003504b" containerID="3f3c13a49697f6fcfc1550c20348160cc4498cca160ffd4976d8a4c42453e53a" exitCode=0 Jun 15 09:24:15.900940 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.900556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" event={"ID":"09d60c68-6f65-4a12-9e94-e7936003504b","Type":"ContainerDied","Data":"3f3c13a49697f6fcfc1550c20348160cc4498cca160ffd4976d8a4c42453e53a"} Jun 15 09:24:15.902369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.902348 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" Jun 15 09:24:15.902369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.902356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns" event={"ID":"92080661-d934-4332-8140-9093a7aa2b18","Type":"ContainerDied","Data":"19ab4738a64b8ef836055ed03991a6c00b0bf1dfbb877b2a0a3343116f286fc8"} Jun 15 09:24:15.902537 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.902386 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19ab4738a64b8ef836055ed03991a6c00b0bf1dfbb877b2a0a3343116f286fc8" Jun 15 09:24:15.904479 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.904461 2572 generic.go:356] "Generic (PLEG): container finished" podID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerID="cdb9be46a2b24267e2882478fcb2b2fd527c35202e2e45c9d7ef3d514198aa24" exitCode=0 Jun 15 09:24:15.904572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:15.904496 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" event={"ID":"e9a725d6-1685-4b10-94e3-f00a2e9ef141","Type":"ContainerDied","Data":"cdb9be46a2b24267e2882478fcb2b2fd527c35202e2e45c9d7ef3d514198aa24"} Jun 15 09:24:16.027727 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.027704 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:16.119069 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.119038 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-util\") pod \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " Jun 15 09:24:16.119241 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.119083 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8d6b\" (UniqueName: \"kubernetes.io/projected/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-kube-api-access-z8d6b\") pod \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " Jun 15 09:24:16.119241 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.119123 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-bundle\") pod \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\" (UID: \"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893\") " Jun 15 09:24:16.119560 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.119537 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-bundle" (OuterVolumeSpecName: "bundle") pod "aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" (UID: "aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:16.121288 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.121268 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-kube-api-access-z8d6b" (OuterVolumeSpecName: "kube-api-access-z8d6b") pod "aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" (UID: "aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893"). InnerVolumeSpecName "kube-api-access-z8d6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:24:16.124496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.124477 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-util" (OuterVolumeSpecName: "util") pod "aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" (UID: "aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:16.219955 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.219926 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:16.219955 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.219955 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8d6b\" (UniqueName: \"kubernetes.io/projected/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-kube-api-access-z8d6b\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:16.220083 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.219966 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:16.911271 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.911203 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" event={"ID":"aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893","Type":"ContainerDied","Data":"7b3229a88e50be808fc6a90fdd493e3a3a9ebca6262cff6c56576e7cd7c846f5"} Jun 15 09:24:16.911271 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.911275 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b3229a88e50be808fc6a90fdd493e3a3a9ebca6262cff6c56576e7cd7c846f5" Jun 15 09:24:16.911801 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:16.911602 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt" Jun 15 09:24:17.068154 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.065037 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:17.070594 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.070574 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:17.128616 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.128589 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-util\") pod \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " Jun 15 09:24:17.128759 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.128623 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98shc\" (UniqueName: \"kubernetes.io/projected/09d60c68-6f65-4a12-9e94-e7936003504b-kube-api-access-98shc\") pod \"09d60c68-6f65-4a12-9e94-e7936003504b\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " Jun 15 09:24:17.128759 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.128644 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8q9d\" (UniqueName: \"kubernetes.io/projected/e9a725d6-1685-4b10-94e3-f00a2e9ef141-kube-api-access-r8q9d\") pod \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " Jun 15 09:24:17.128759 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.128712 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-util\") pod \"09d60c68-6f65-4a12-9e94-e7936003504b\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " Jun 15 09:24:17.128926 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.128783 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-bundle\") pod \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\" (UID: \"e9a725d6-1685-4b10-94e3-f00a2e9ef141\") " Jun 15 09:24:17.128926 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.128846 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-bundle\") pod \"09d60c68-6f65-4a12-9e94-e7936003504b\" (UID: \"09d60c68-6f65-4a12-9e94-e7936003504b\") " Jun 15 09:24:17.129378 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.129341 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-bundle" (OuterVolumeSpecName: "bundle") pod "09d60c68-6f65-4a12-9e94-e7936003504b" (UID: "09d60c68-6f65-4a12-9e94-e7936003504b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:17.129504 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.129479 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-bundle" (OuterVolumeSpecName: "bundle") pod "e9a725d6-1685-4b10-94e3-f00a2e9ef141" (UID: "e9a725d6-1685-4b10-94e3-f00a2e9ef141"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:17.130863 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.130836 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d60c68-6f65-4a12-9e94-e7936003504b-kube-api-access-98shc" (OuterVolumeSpecName: "kube-api-access-98shc") pod "09d60c68-6f65-4a12-9e94-e7936003504b" (UID: "09d60c68-6f65-4a12-9e94-e7936003504b"). InnerVolumeSpecName "kube-api-access-98shc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:24:17.131153 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.131127 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a725d6-1685-4b10-94e3-f00a2e9ef141-kube-api-access-r8q9d" (OuterVolumeSpecName: "kube-api-access-r8q9d") pod "e9a725d6-1685-4b10-94e3-f00a2e9ef141" (UID: "e9a725d6-1685-4b10-94e3-f00a2e9ef141"). InnerVolumeSpecName "kube-api-access-r8q9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:24:17.134875 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.134855 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-util" (OuterVolumeSpecName: "util") pod "09d60c68-6f65-4a12-9e94-e7936003504b" (UID: "09d60c68-6f65-4a12-9e94-e7936003504b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:17.135074 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.135056 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-util" (OuterVolumeSpecName: "util") pod "e9a725d6-1685-4b10-94e3-f00a2e9ef141" (UID: "e9a725d6-1685-4b10-94e3-f00a2e9ef141"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:24:17.229600 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.229577 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:17.229600 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.229599 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:17.229726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.229609 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98shc\" (UniqueName: \"kubernetes.io/projected/09d60c68-6f65-4a12-9e94-e7936003504b-kube-api-access-98shc\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:17.229726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.229619 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8q9d\" (UniqueName: \"kubernetes.io/projected/e9a725d6-1685-4b10-94e3-f00a2e9ef141-kube-api-access-r8q9d\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:17.229726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.229627 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d60c68-6f65-4a12-9e94-e7936003504b-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:17.229726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.229635 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9a725d6-1685-4b10-94e3-f00a2e9ef141-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:24:17.917640 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.917614 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" Jun 15 09:24:17.918031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.917655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9" event={"ID":"e9a725d6-1685-4b10-94e3-f00a2e9ef141","Type":"ContainerDied","Data":"b776b133bfda495486ac26ea3953b165a217ce294f2bf84a931ca8af60e6fc8a"} Jun 15 09:24:17.918031 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.917698 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b776b133bfda495486ac26ea3953b165a217ce294f2bf84a931ca8af60e6fc8a" Jun 15 09:24:17.919683 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.919661 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" event={"ID":"09d60c68-6f65-4a12-9e94-e7936003504b","Type":"ContainerDied","Data":"e31ce7502906410468c669861fa1e3e471d2881862babcad950f288c2d1667ac"} Jun 15 09:24:17.919806 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.919695 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e31ce7502906410468c669861fa1e3e471d2881862babcad950f288c2d1667ac" Jun 15 09:24:17.919806 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:17.919684 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt" Jun 15 09:24:59.681450 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.681410 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j"] Jun 15 09:24:59.682108 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682087 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="pull" Jun 15 09:24:59.682209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682113 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="pull" Jun 15 09:24:59.682209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682157 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="util" Jun 15 09:24:59.682209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682166 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="util" Jun 15 09:24:59.682209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682183 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="pull" Jun 15 09:24:59.682209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682191 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="pull" Jun 15 09:24:59.682209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682205 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682214 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682241 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="pull" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682250 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="pull" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682263 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="util" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682271 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="util" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682287 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="util" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682295 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="util" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682315 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682324 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682334 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682342 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682354 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="util" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682369 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="util" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682377 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="pull" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682385 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="pull" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682406 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="extract" Jun 15 09:24:59.682496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682415 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="extract" Jun 15 09:24:59.683248 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682551 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a725d6-1685-4b10-94e3-f00a2e9ef141" containerName="extract" Jun 15 09:24:59.683248 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682564 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d60c68-6f65-4a12-9e94-e7936003504b" containerName="extract" Jun 15 09:24:59.683248 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682573 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="92080661-d934-4332-8140-9093a7aa2b18" containerName="extract" Jun 15 09:24:59.683248 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.682589 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893" containerName="extract" Jun 15 09:24:59.686525 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.686505 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.689001 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.688983 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4fkvr\"" Jun 15 09:24:59.689106 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.689018 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 09:24:59.689106 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.689018 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 09:24:59.708672 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.708651 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j"] Jun 15 09:24:59.819792 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.819763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krctb\" (UniqueName: \"kubernetes.io/projected/703be547-ca99-4726-a162-6fd046d4baef-kube-api-access-krctb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.819904 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.819800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/703be547-ca99-4726-a162-6fd046d4baef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.920302 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.920263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krctb\" (UniqueName: \"kubernetes.io/projected/703be547-ca99-4726-a162-6fd046d4baef-kube-api-access-krctb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.920302 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.920310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/703be547-ca99-4726-a162-6fd046d4baef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.920642 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.920628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/703be547-ca99-4726-a162-6fd046d4baef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.929476 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.929447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krctb\" (UniqueName: \"kubernetes.io/projected/703be547-ca99-4726-a162-6fd046d4baef-kube-api-access-krctb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:24:59.996630 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:24:59.996602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:00.138840 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.138815 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j"] Jun 15 09:25:00.140756 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:25:00.140712 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703be547_ca99_4726_a162_6fd046d4baef.slice/crio-89fe73bfcb34fa98a484ef6134e5572d19c9d5306ac542aaf57e5cc89069d8d5 WatchSource:0}: Error finding container 89fe73bfcb34fa98a484ef6134e5572d19c9d5306ac542aaf57e5cc89069d8d5: Status 404 returned error can't find the container with id 89fe73bfcb34fa98a484ef6134e5572d19c9d5306ac542aaf57e5cc89069d8d5 Jun 15 09:25:00.319181 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.319098 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j"] Jun 15 09:25:00.323719 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.323691 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j"] Jun 15 09:25:00.342612 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.342586 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs"] Jun 15 09:25:00.346866 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.346844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.357393 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.357367 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs"] Jun 15 09:25:00.423019 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.422986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b08b148-617c-47e1-99d4-443be22afda6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfgqs\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.423175 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.423035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8g8\" (UniqueName: \"kubernetes.io/projected/4b08b148-617c-47e1-99d4-443be22afda6-kube-api-access-8v8g8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfgqs\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.524332 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.524260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b08b148-617c-47e1-99d4-443be22afda6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfgqs\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.524517 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.524348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8g8\" (UniqueName: \"kubernetes.io/projected/4b08b148-617c-47e1-99d4-443be22afda6-kube-api-access-8v8g8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfgqs\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.524717 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.524696 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b08b148-617c-47e1-99d4-443be22afda6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfgqs\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.533430 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.533405 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8g8\" (UniqueName: \"kubernetes.io/projected/4b08b148-617c-47e1-99d4-443be22afda6-kube-api-access-8v8g8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfgqs\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:00.658207 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:00.658133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:01.008796 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:01.008766 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs"] Jun 15 09:25:01.022306 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:25:01.022269 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b08b148_617c_47e1_99d4_443be22afda6.slice/crio-f5fd69c1e720c13c2333564ffb6919bb58ea474930b81723e9fb56e0d2d507b3 WatchSource:0}: Error finding container f5fd69c1e720c13c2333564ffb6919bb58ea474930b81723e9fb56e0d2d507b3: Status 404 returned error can't find the container with id f5fd69c1e720c13c2333564ffb6919bb58ea474930b81723e9fb56e0d2d507b3 Jun 15 09:25:01.133435 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:01.133390 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" event={"ID":"4b08b148-617c-47e1-99d4-443be22afda6","Type":"ContainerStarted","Data":"f5fd69c1e720c13c2333564ffb6919bb58ea474930b81723e9fb56e0d2d507b3"} Jun 15 09:25:05.161519 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.161475 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" podUID="703be547-ca99-4726-a162-6fd046d4baef" containerName="manager" containerID="cri-o://7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992" gracePeriod=2 Jun 15 09:25:05.163187 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.163161 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" event={"ID":"4b08b148-617c-47e1-99d4-443be22afda6","Type":"ContainerStarted","Data":"70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667"} Jun 15 09:25:05.163352 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.163254 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:05.186908 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.186858 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" podStartSLOduration=1.97326707 podStartE2EDuration="5.186839655s" totalImagesPullingTime="3.213572585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:25:05.184493256 +0000 UTC m=+689.144334043" watchObservedRunningTime="2026-06-15 09:25:05.186839655 +0000 UTC m=+689.146680419" Jun 15 09:25:05.400044 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.400021 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:05.402247 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:25:05.402215 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" is forbidden: User \"system:node:ip-10-0-141-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-4.ec2.internal' and this object" podUID="703be547-ca99-4726-a162-6fd046d4baef" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:05.568133 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.568100 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krctb\" (UniqueName: \"kubernetes.io/projected/703be547-ca99-4726-a162-6fd046d4baef-kube-api-access-krctb\") pod \"703be547-ca99-4726-a162-6fd046d4baef\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " Jun 15 09:25:05.568274 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.568167 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/703be547-ca99-4726-a162-6fd046d4baef-extensions-socket-volume\") pod \"703be547-ca99-4726-a162-6fd046d4baef\" (UID: \"703be547-ca99-4726-a162-6fd046d4baef\") " Jun 15 09:25:05.568459 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.568422 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703be547-ca99-4726-a162-6fd046d4baef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "703be547-ca99-4726-a162-6fd046d4baef" (UID: "703be547-ca99-4726-a162-6fd046d4baef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:25:05.570147 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.570121 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/703be547-ca99-4726-a162-6fd046d4baef-kube-api-access-krctb" (OuterVolumeSpecName: "kube-api-access-krctb") pod "703be547-ca99-4726-a162-6fd046d4baef" (UID: "703be547-ca99-4726-a162-6fd046d4baef"). InnerVolumeSpecName "kube-api-access-krctb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:25:05.668699 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.668677 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krctb\" (UniqueName: \"kubernetes.io/projected/703be547-ca99-4726-a162-6fd046d4baef-kube-api-access-krctb\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:25:05.668699 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:05.668697 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/703be547-ca99-4726-a162-6fd046d4baef-extensions-socket-volume\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:25:06.170717 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:06.170678 2572 generic.go:356] "Generic (PLEG): container finished" podID="703be547-ca99-4726-a162-6fd046d4baef" containerID="7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992" exitCode=2 Jun 15 09:25:06.171191 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:06.170721 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:06.171191 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:06.170780 2572 scope.go:117] "RemoveContainer" containerID="7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992" Jun 15 09:25:06.172957 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:25:06.172925 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" is forbidden: User \"system:node:ip-10-0-141-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-4.ec2.internal' and this object" podUID="703be547-ca99-4726-a162-6fd046d4baef" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:06.180451 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:06.180434 2572 scope.go:117] "RemoveContainer" containerID="7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992" Jun 15 09:25:06.180673 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:25:06.180656 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992\": container with ID starting with 7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992 not found: ID does not exist" containerID="7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992" Jun 15 09:25:06.180773 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:06.180685 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992"} err="failed to get container status \"7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992\": rpc error: code = NotFound desc = could not find container \"7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992\": container with ID starting with 7065ddea0100a706517212bc6b1e0e6f8cb79d05946f568d5b67641622d74992 not found: ID does not exist" Jun 15 09:25:06.181238 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:25:06.181218 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" is forbidden: User \"system:node:ip-10-0-141-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-4.ec2.internal' and this object" podUID="703be547-ca99-4726-a162-6fd046d4baef" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:06.437895 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:25:06.437817 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q7v7j\" is forbidden: User \"system:node:ip-10-0-141-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-4.ec2.internal' and this object" podUID="703be547-ca99-4726-a162-6fd046d4baef" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q7v7j" Jun 15 09:25:06.438513 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:06.438494 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="703be547-ca99-4726-a162-6fd046d4baef" path="/var/lib/kubelet/pods/703be547-ca99-4726-a162-6fd046d4baef/volumes" Jun 15 09:25:16.173197 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:16.173163 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:28.722630 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:28.722539 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs"] Jun 15 09:25:28.723102 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:28.722807 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" podUID="4b08b148-617c-47e1-99d4-443be22afda6" containerName="manager" containerID="cri-o://70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667" gracePeriod=10 Jun 15 09:25:28.976258 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:28.976206 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:29.034017 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.033992 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b08b148-617c-47e1-99d4-443be22afda6-extensions-socket-volume\") pod \"4b08b148-617c-47e1-99d4-443be22afda6\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " Jun 15 09:25:29.034166 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.034030 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v8g8\" (UniqueName: \"kubernetes.io/projected/4b08b148-617c-47e1-99d4-443be22afda6-kube-api-access-8v8g8\") pod \"4b08b148-617c-47e1-99d4-443be22afda6\" (UID: \"4b08b148-617c-47e1-99d4-443be22afda6\") " Jun 15 09:25:29.034491 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.034465 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b08b148-617c-47e1-99d4-443be22afda6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4b08b148-617c-47e1-99d4-443be22afda6" (UID: "4b08b148-617c-47e1-99d4-443be22afda6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:25:29.036121 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.036098 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b08b148-617c-47e1-99d4-443be22afda6-kube-api-access-8v8g8" (OuterVolumeSpecName: "kube-api-access-8v8g8") pod "4b08b148-617c-47e1-99d4-443be22afda6" (UID: "4b08b148-617c-47e1-99d4-443be22afda6"). InnerVolumeSpecName "kube-api-access-8v8g8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:25:29.135047 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.135011 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b08b148-617c-47e1-99d4-443be22afda6-extensions-socket-volume\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:25:29.135047 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.135045 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v8g8\" (UniqueName: \"kubernetes.io/projected/4b08b148-617c-47e1-99d4-443be22afda6-kube-api-access-8v8g8\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:25:29.286712 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.286642 2572 generic.go:356] "Generic (PLEG): container finished" podID="4b08b148-617c-47e1-99d4-443be22afda6" containerID="70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667" exitCode=0 Jun 15 09:25:29.286712 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.286705 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" Jun 15 09:25:29.286890 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.286723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" event={"ID":"4b08b148-617c-47e1-99d4-443be22afda6","Type":"ContainerDied","Data":"70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667"} Jun 15 09:25:29.286890 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.286811 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs" event={"ID":"4b08b148-617c-47e1-99d4-443be22afda6","Type":"ContainerDied","Data":"f5fd69c1e720c13c2333564ffb6919bb58ea474930b81723e9fb56e0d2d507b3"} Jun 15 09:25:29.286890 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.286833 2572 scope.go:117] "RemoveContainer" containerID="70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667" Jun 15 09:25:29.296500 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.296482 2572 scope.go:117] "RemoveContainer" containerID="70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667" Jun 15 09:25:29.296763 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:25:29.296720 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667\": container with ID starting with 70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667 not found: ID does not exist" containerID="70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667" Jun 15 09:25:29.296854 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.296770 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667"} err="failed to get container status \"70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667\": rpc error: code = NotFound desc = could not find container \"70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667\": container with ID starting with 70070c43a130fa23e2263a7451dc2b98fe2869275ac4efc7695c4f3824f2e667 not found: ID does not exist" Jun 15 09:25:29.312881 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.312858 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs"] Jun 15 09:25:29.318842 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:29.318822 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfgqs"] Jun 15 09:25:30.437871 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:30.437843 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b08b148-617c-47e1-99d4-443be22afda6" path="/var/lib/kubelet/pods/4b08b148-617c-47e1-99d4-443be22afda6/volumes" Jun 15 09:25:46.596489 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596453 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:25:46.596972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596856 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="703be547-ca99-4726-a162-6fd046d4baef" containerName="manager" Jun 15 09:25:46.596972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596874 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="703be547-ca99-4726-a162-6fd046d4baef" containerName="manager" Jun 15 09:25:46.596972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596894 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b08b148-617c-47e1-99d4-443be22afda6" containerName="manager" Jun 15 09:25:46.596972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596900 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b08b148-617c-47e1-99d4-443be22afda6" containerName="manager" Jun 15 09:25:46.596972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596950 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="703be547-ca99-4726-a162-6fd046d4baef" containerName="manager" Jun 15 09:25:46.596972 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.596957 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b08b148-617c-47e1-99d4-443be22afda6" containerName="manager" Jun 15 09:25:46.601610 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.601588 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.603765 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.603730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wpx4p\"" Jun 15 09:25:46.604109 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.603918 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 09:25:46.604539 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.604519 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 09:25:46.604698 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.604674 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 09:25:46.607376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.607353 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:25:46.633053 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.633031 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:25:46.665521 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.665495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vpk2\" (UniqueName: \"kubernetes.io/projected/40b95e4a-ed4d-476d-8a0d-e1ea0afaf749-kube-api-access-8vpk2\") pod \"limitador-limitador-54d6d988d5-g6qd7\" (UID: \"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.665603 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.665531 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40b95e4a-ed4d-476d-8a0d-e1ea0afaf749-config-file\") pod \"limitador-limitador-54d6d988d5-g6qd7\" (UID: \"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.766186 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.766164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vpk2\" (UniqueName: \"kubernetes.io/projected/40b95e4a-ed4d-476d-8a0d-e1ea0afaf749-kube-api-access-8vpk2\") pod \"limitador-limitador-54d6d988d5-g6qd7\" (UID: \"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.766319 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.766212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40b95e4a-ed4d-476d-8a0d-e1ea0afaf749-config-file\") pod \"limitador-limitador-54d6d988d5-g6qd7\" (UID: \"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.766801 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.766780 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40b95e4a-ed4d-476d-8a0d-e1ea0afaf749-config-file\") pod \"limitador-limitador-54d6d988d5-g6qd7\" (UID: \"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.777442 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.777418 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vpk2\" (UniqueName: \"kubernetes.io/projected/40b95e4a-ed4d-476d-8a0d-e1ea0afaf749-kube-api-access-8vpk2\") pod \"limitador-limitador-54d6d988d5-g6qd7\" (UID: \"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:46.913178 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:46.913112 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:47.066048 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:47.066025 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:25:47.068480 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:25:47.068449 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b95e4a_ed4d_476d_8a0d_e1ea0afaf749.slice/crio-e0a102446af211931c220fab23ecac54e78933717e418de983b36b6ade07564d WatchSource:0}: Error finding container e0a102446af211931c220fab23ecac54e78933717e418de983b36b6ade07564d: Status 404 returned error can't find the container with id e0a102446af211931c220fab23ecac54e78933717e418de983b36b6ade07564d Jun 15 09:25:47.385908 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:47.385880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" event={"ID":"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749","Type":"ContainerStarted","Data":"e0a102446af211931c220fab23ecac54e78933717e418de983b36b6ade07564d"} Jun 15 09:25:50.403129 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:50.403094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" event={"ID":"40b95e4a-ed4d-476d-8a0d-e1ea0afaf749","Type":"ContainerStarted","Data":"9e5f747300a59cf40ad7f8d0e8ac875acb8b34b0d75f586cfe00367ebb4974c0"} Jun 15 09:25:50.403723 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:50.403207 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:25:50.419527 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:25:50.419483 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" podStartSLOduration=1.988176436 podStartE2EDuration="4.419470469s" totalImagesPullingTime="2.431294033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:25:50.418913097 +0000 UTC m=+734.378753893" watchObservedRunningTime="2026-06-15 09:25:50.419470469 +0000 UTC m=+734.379311244" Jun 15 09:26:01.410022 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:01.409992 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g6qd7" Jun 15 09:26:17.476440 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.476400 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp"] Jun 15 09:26:17.484903 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.484878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.487455 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.487440 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 09:26:17.488314 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.488299 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 09:26:17.488377 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.488319 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6vfcw\"" Jun 15 09:26:17.491914 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.491888 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp"] Jun 15 09:26:17.582998 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.582973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.583165 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.583049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.583165 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.583081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82c5s\" (UniqueName: \"kubernetes.io/projected/82f15466-bcae-4578-a304-f06820fc623d-kube-api-access-82c5s\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.683896 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.683861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.684013 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.683903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82c5s\" (UniqueName: \"kubernetes.io/projected/82f15466-bcae-4578-a304-f06820fc623d-kube-api-access-82c5s\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.684082 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.684010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.684206 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.684190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.684302 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.684287 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.693058 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.693035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82c5s\" (UniqueName: \"kubernetes.io/projected/82f15466-bcae-4578-a304-f06820fc623d-kube-api-access-82c5s\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.794235 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.794167 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:17.923239 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:17.923213 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp"] Jun 15 09:26:17.925322 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:26:17.925297 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f15466_bcae_4578_a304_f06820fc623d.slice/crio-c95fc4007ca2c49a885259e77625ec857a9525fe8adbdf6b89b3ace266b1d17e WatchSource:0}: Error finding container c95fc4007ca2c49a885259e77625ec857a9525fe8adbdf6b89b3ace266b1d17e: Status 404 returned error can't find the container with id c95fc4007ca2c49a885259e77625ec857a9525fe8adbdf6b89b3ace266b1d17e Jun 15 09:26:18.540911 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:18.540874 2572 generic.go:356] "Generic (PLEG): container finished" podID="82f15466-bcae-4578-a304-f06820fc623d" containerID="fad301c940c3e0e97462ed54cc3fd53fb8f85b8a240bd568f0f4ee92a30e35de" exitCode=0 Jun 15 09:26:18.541272 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:18.540961 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" event={"ID":"82f15466-bcae-4578-a304-f06820fc623d","Type":"ContainerDied","Data":"fad301c940c3e0e97462ed54cc3fd53fb8f85b8a240bd568f0f4ee92a30e35de"} Jun 15 09:26:18.541272 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:18.541011 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" event={"ID":"82f15466-bcae-4578-a304-f06820fc623d","Type":"ContainerStarted","Data":"c95fc4007ca2c49a885259e77625ec857a9525fe8adbdf6b89b3ace266b1d17e"} Jun 15 09:26:19.551513 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:19.551482 2572 generic.go:356] "Generic (PLEG): container finished" podID="82f15466-bcae-4578-a304-f06820fc623d" containerID="419702c9963cf0388668d19c8f17dc4e5ee5a72b9a55306ac980bb05350ad4b5" exitCode=0 Jun 15 09:26:19.551914 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:19.551581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" event={"ID":"82f15466-bcae-4578-a304-f06820fc623d","Type":"ContainerDied","Data":"419702c9963cf0388668d19c8f17dc4e5ee5a72b9a55306ac980bb05350ad4b5"} Jun 15 09:26:20.558378 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:20.558342 2572 generic.go:356] "Generic (PLEG): container finished" podID="82f15466-bcae-4578-a304-f06820fc623d" containerID="1ea91f2ec01c1f29d35303e9bbd866518583b0bf02d7a3c61256f3084053dea4" exitCode=0 Jun 15 09:26:20.558798 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:20.558425 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" event={"ID":"82f15466-bcae-4578-a304-f06820fc623d","Type":"ContainerDied","Data":"1ea91f2ec01c1f29d35303e9bbd866518583b0bf02d7a3c61256f3084053dea4"} Jun 15 09:26:21.686530 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.686509 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:21.812925 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.812897 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-bundle\") pod \"82f15466-bcae-4578-a304-f06820fc623d\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " Jun 15 09:26:21.813074 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.812969 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-util\") pod \"82f15466-bcae-4578-a304-f06820fc623d\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " Jun 15 09:26:21.813074 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.813039 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82c5s\" (UniqueName: \"kubernetes.io/projected/82f15466-bcae-4578-a304-f06820fc623d-kube-api-access-82c5s\") pod \"82f15466-bcae-4578-a304-f06820fc623d\" (UID: \"82f15466-bcae-4578-a304-f06820fc623d\") " Jun 15 09:26:21.813434 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.813407 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-bundle" (OuterVolumeSpecName: "bundle") pod "82f15466-bcae-4578-a304-f06820fc623d" (UID: "82f15466-bcae-4578-a304-f06820fc623d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:26:21.815076 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.815026 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f15466-bcae-4578-a304-f06820fc623d-kube-api-access-82c5s" (OuterVolumeSpecName: "kube-api-access-82c5s") pod "82f15466-bcae-4578-a304-f06820fc623d" (UID: "82f15466-bcae-4578-a304-f06820fc623d"). InnerVolumeSpecName "kube-api-access-82c5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:26:21.819125 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.819085 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-util" (OuterVolumeSpecName: "util") pod "82f15466-bcae-4578-a304-f06820fc623d" (UID: "82f15466-bcae-4578-a304-f06820fc623d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 09:26:21.914038 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.914012 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-util\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:26:21.914038 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.914033 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82c5s\" (UniqueName: \"kubernetes.io/projected/82f15466-bcae-4578-a304-f06820fc623d-kube-api-access-82c5s\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:26:21.914038 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:21.914044 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f15466-bcae-4578-a304-f06820fc623d-bundle\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:26:22.569483 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:22.569460 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" Jun 15 09:26:22.569483 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:22.569468 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jhnkp" event={"ID":"82f15466-bcae-4578-a304-f06820fc623d","Type":"ContainerDied","Data":"c95fc4007ca2c49a885259e77625ec857a9525fe8adbdf6b89b3ace266b1d17e"} Jun 15 09:26:22.569647 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:22.569505 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c95fc4007ca2c49a885259e77625ec857a9525fe8adbdf6b89b3ace266b1d17e" Jun 15 09:26:40.593283 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593248 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593539 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="util" Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593550 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="util" Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593566 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="extract" Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593572 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="extract" Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593579 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="pull" Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593584 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="pull" Jun 15 09:26:40.593755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.593633 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f15466-bcae-4578-a304-f06820fc623d" containerName="extract" Jun 15 09:26:40.596410 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.596393 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:40.598508 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.598489 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 09:26:40.598601 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.598495 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 09:26:40.598601 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.598495 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rlpxw\"" Jun 15 09:26:40.599299 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.599280 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 09:26:40.604688 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.604665 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:26:40.743840 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.743809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnmk\" (UniqueName: \"kubernetes.io/projected/a983f6bf-6b1b-46c0-a470-4462f7808167-kube-api-access-7tnmk\") pod \"maas-keycloak-0\" (UID: \"a983f6bf-6b1b-46c0-a470-4462f7808167\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:40.844509 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.844423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnmk\" (UniqueName: \"kubernetes.io/projected/a983f6bf-6b1b-46c0-a470-4462f7808167-kube-api-access-7tnmk\") pod \"maas-keycloak-0\" (UID: \"a983f6bf-6b1b-46c0-a470-4462f7808167\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:40.852508 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.852487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnmk\" (UniqueName: \"kubernetes.io/projected/a983f6bf-6b1b-46c0-a470-4462f7808167-kube-api-access-7tnmk\") pod \"maas-keycloak-0\" (UID: \"a983f6bf-6b1b-46c0-a470-4462f7808167\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:40.906532 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:40.906504 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:41.037221 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:41.037188 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:26:41.040175 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:26:41.040147 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda983f6bf_6b1b_46c0_a470_4462f7808167.slice/crio-9d467fd4bebd57d0ed1f62630dcd0cac91c1a01a38f681b623d268504240187e WatchSource:0}: Error finding container 9d467fd4bebd57d0ed1f62630dcd0cac91c1a01a38f681b623d268504240187e: Status 404 returned error can't find the container with id 9d467fd4bebd57d0ed1f62630dcd0cac91c1a01a38f681b623d268504240187e Jun 15 09:26:41.665413 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:41.665375 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a983f6bf-6b1b-46c0-a470-4462f7808167","Type":"ContainerStarted","Data":"9d467fd4bebd57d0ed1f62630dcd0cac91c1a01a38f681b623d268504240187e"} Jun 15 09:26:45.704189 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:45.704146 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a983f6bf-6b1b-46c0-a470-4462f7808167","Type":"ContainerStarted","Data":"e963ca8fc6b8d097353fddb265b44ab39f7b64e18373d5bdf8b5ebf69fae9685"} Jun 15 09:26:45.722605 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:45.722553 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.39654796 podStartE2EDuration="5.722537943s" totalImagesPullingTime="4.325989983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:26:45.721306073 +0000 UTC m=+789.681146836" watchObservedRunningTime="2026-06-15 09:26:45.722537943 +0000 UTC m=+789.682378704" Jun 15 09:26:45.907469 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:45.907429 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:45.909056 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:45.909015 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:46.908036 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:46.907975 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:47.907830 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:47.907787 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:48.907205 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:48.907149 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:49.907228 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:49.907180 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:50.907265 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:50.907219 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:50.908257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:50.907825 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:51.907803 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:51.907757 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:52.908045 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:52.907995 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:53.907222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:53.907160 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:54.907817 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:54.907767 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:55.907370 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:55.907307 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:56.907986 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:56.907937 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:57.907453 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:57.907405 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused" Jun 15 09:26:59.030257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:59.030220 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 09:26:59.048018 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:26:59.047968 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 09:27:09.037282 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:09.037237 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 09:27:16.371098 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.371055 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c6bcbb5c5-s6pjw"] Jun 15 09:27:16.377854 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.377831 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.380662 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.380643 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2d6fq\"" Jun 15 09:27:16.380779 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.380694 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 09:27:16.381649 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.381608 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 09:27:16.384371 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.384348 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6bcbb5c5-s6pjw"] Jun 15 09:27:16.445178 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.445151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-webhook-cert\") pod \"maas-controller-5c6bcbb5c5-s6pjw\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.445304 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.445183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps49h\" (UniqueName: \"kubernetes.io/projected/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-kube-api-access-ps49h\") pod \"maas-controller-5c6bcbb5c5-s6pjw\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.546056 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.546028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-webhook-cert\") pod \"maas-controller-5c6bcbb5c5-s6pjw\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.546187 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.546063 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps49h\" (UniqueName: \"kubernetes.io/projected/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-kube-api-access-ps49h\") pod \"maas-controller-5c6bcbb5c5-s6pjw\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.548499 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.548469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-webhook-cert\") pod \"maas-controller-5c6bcbb5c5-s6pjw\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.555652 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.555632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps49h\" (UniqueName: \"kubernetes.io/projected/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-kube-api-access-ps49h\") pod \"maas-controller-5c6bcbb5c5-s6pjw\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.689339 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.689264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:16.812067 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.812039 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6bcbb5c5-s6pjw"] Jun 15 09:27:16.814099 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:27:16.814074 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903bc4a5_5cc9_4e0a_93e0_2e93f298cd7a.slice/crio-c598d0ff2799cb738aa206a14f34cea7092cb902d678e6a20446c37eca0a1d4b WatchSource:0}: Error finding container c598d0ff2799cb738aa206a14f34cea7092cb902d678e6a20446c37eca0a1d4b: Status 404 returned error can't find the container with id c598d0ff2799cb738aa206a14f34cea7092cb902d678e6a20446c37eca0a1d4b Jun 15 09:27:16.906427 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:16.906400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" event={"ID":"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a","Type":"ContainerStarted","Data":"c598d0ff2799cb738aa206a14f34cea7092cb902d678e6a20446c37eca0a1d4b"} Jun 15 09:27:18.920607 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:18.920573 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" event={"ID":"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a","Type":"ContainerStarted","Data":"6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a"} Jun 15 09:27:18.921097 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:18.920774 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:18.946141 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:18.946090 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" podStartSLOduration=0.969625919 podStartE2EDuration="2.946074891s" totalImagesPullingTime="1.976448972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:27:18.945223603 +0000 UTC m=+822.905064414" watchObservedRunningTime="2026-06-15 09:27:18.946074891 +0000 UTC m=+822.905915653" Jun 15 09:27:29.932307 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:29.932277 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:27:50.468197 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.468148 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-fnwlk"] Jun 15 09:27:50.474391 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.474370 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:27:50.476482 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.476461 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 09:27:50.482695 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.482676 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-fnwlk"] Jun 15 09:27:50.493980 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.493930 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wp7jh"] Jun 15 09:27:50.498993 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.498976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:27:50.501129 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.501105 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8vjk9\"" Jun 15 09:27:50.505991 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.505781 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wp7jh"] Jun 15 09:27:50.623065 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.623034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdk49\" (UniqueName: \"kubernetes.io/projected/5c5542c1-a34e-438d-93dc-2d28f2eabad4-kube-api-access-fdk49\") pod \"payload-pre-processing-579785bc64-fnwlk\" (UID: \"5c5542c1-a34e-438d-93dc-2d28f2eabad4\") " pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:27:50.623222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.623087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6fn\" (UniqueName: \"kubernetes.io/projected/b28b96a8-84c1-462d-b6f8-ada43ece98c1-kube-api-access-2x6fn\") pod \"payload-processing-699b6cd6c-wp7jh\" (UID: \"b28b96a8-84c1-462d-b6f8-ada43ece98c1\") " pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:27:50.721898 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.721823 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:27:50.724545 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.724518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6fn\" (UniqueName: \"kubernetes.io/projected/b28b96a8-84c1-462d-b6f8-ada43ece98c1-kube-api-access-2x6fn\") pod \"payload-processing-699b6cd6c-wp7jh\" (UID: \"b28b96a8-84c1-462d-b6f8-ada43ece98c1\") " pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:27:50.724668 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.724589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk49\" (UniqueName: \"kubernetes.io/projected/5c5542c1-a34e-438d-93dc-2d28f2eabad4-kube-api-access-fdk49\") pod \"payload-pre-processing-579785bc64-fnwlk\" (UID: \"5c5542c1-a34e-438d-93dc-2d28f2eabad4\") " pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:27:50.733263 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.733228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdk49\" (UniqueName: \"kubernetes.io/projected/5c5542c1-a34e-438d-93dc-2d28f2eabad4-kube-api-access-fdk49\") pod \"payload-pre-processing-579785bc64-fnwlk\" (UID: \"5c5542c1-a34e-438d-93dc-2d28f2eabad4\") " pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:27:50.733391 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.733361 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6fn\" (UniqueName: \"kubernetes.io/projected/b28b96a8-84c1-462d-b6f8-ada43ece98c1-kube-api-access-2x6fn\") pod \"payload-processing-699b6cd6c-wp7jh\" (UID: \"b28b96a8-84c1-462d-b6f8-ada43ece98c1\") " pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:27:50.786288 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.786258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:27:50.809297 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.809267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:27:50.939150 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.939119 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-fnwlk"] Jun 15 09:27:50.940911 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:27:50.940877 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5542c1_a34e_438d_93dc_2d28f2eabad4.slice/crio-5106830ea70cb77dbd8a5ab2a2beb811dfad739b83081ad3f6e1fd30e29418dd WatchSource:0}: Error finding container 5106830ea70cb77dbd8a5ab2a2beb811dfad739b83081ad3f6e1fd30e29418dd: Status 404 returned error can't find the container with id 5106830ea70cb77dbd8a5ab2a2beb811dfad739b83081ad3f6e1fd30e29418dd Jun 15 09:27:50.965988 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:50.965956 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wp7jh"] Jun 15 09:27:50.967258 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:27:50.967237 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28b96a8_84c1_462d_b6f8_ada43ece98c1.slice/crio-fa3ecce330ae987f2aafb68dcbbfc939e244fab3bcbb8b1f463ee437fb01bc45 WatchSource:0}: Error finding container fa3ecce330ae987f2aafb68dcbbfc939e244fab3bcbb8b1f463ee437fb01bc45: Status 404 returned error can't find the container with id fa3ecce330ae987f2aafb68dcbbfc939e244fab3bcbb8b1f463ee437fb01bc45 Jun 15 09:27:51.089712 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:51.089642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" event={"ID":"b28b96a8-84c1-462d-b6f8-ada43ece98c1","Type":"ContainerStarted","Data":"fa3ecce330ae987f2aafb68dcbbfc939e244fab3bcbb8b1f463ee437fb01bc45"} Jun 15 09:27:51.090783 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:51.090759 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" event={"ID":"5c5542c1-a34e-438d-93dc-2d28f2eabad4","Type":"ContainerStarted","Data":"5106830ea70cb77dbd8a5ab2a2beb811dfad739b83081ad3f6e1fd30e29418dd"} Jun 15 09:27:54.110800 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:54.110755 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" event={"ID":"5c5542c1-a34e-438d-93dc-2d28f2eabad4","Type":"ContainerStarted","Data":"4d883afe5b051fa4b42c2cdaa593df3b862ea720943b47197a91b75d6a8989b6"} Jun 15 09:27:54.111229 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:54.110966 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:27:54.112467 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:54.112439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" event={"ID":"b28b96a8-84c1-462d-b6f8-ada43ece98c1","Type":"ContainerStarted","Data":"2951ed7abaea118f9dff78c678bb175b6fe4722f6cb8ad7c5c9337620c1f5a4e"} Jun 15 09:27:54.112588 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:54.112560 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:27:54.128702 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:54.128655 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" podStartSLOduration=1.801696331 podStartE2EDuration="4.128644262s" totalImagesPullingTime="2.326947931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:27:54.125505827 +0000 UTC m=+858.085346589" watchObservedRunningTime="2026-06-15 09:27:54.128644262 +0000 UTC m=+858.088485023" Jun 15 09:27:54.142295 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:54.142259 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" podStartSLOduration=1.8343504510000002 podStartE2EDuration="4.142247386s" totalImagesPullingTime="2.307896935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:27:54.139676577 +0000 UTC m=+858.099517357" watchObservedRunningTime="2026-06-15 09:27:54.142247386 +0000 UTC m=+858.102088148" Jun 15 09:27:59.697363 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:59.697329 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:27:59.697757 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:27:59.697550 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" containerID="cri-o://e963ca8fc6b8d097353fddb265b44ab39f7b64e18373d5bdf8b5ebf69fae9685" gracePeriod=30 Jun 15 09:28:01.151102 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:01.151065 2572 generic.go:356] "Generic (PLEG): container finished" podID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerID="e963ca8fc6b8d097353fddb265b44ab39f7b64e18373d5bdf8b5ebf69fae9685" exitCode=143 Jun 15 09:28:01.151527 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:01.151141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a983f6bf-6b1b-46c0-a470-4462f7808167","Type":"ContainerDied","Data":"e963ca8fc6b8d097353fddb265b44ab39f7b64e18373d5bdf8b5ebf69fae9685"} Jun 15 09:28:01.236620 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:01.236596 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:01.405558 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:01.405487 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tnmk\" (UniqueName: \"kubernetes.io/projected/a983f6bf-6b1b-46c0-a470-4462f7808167-kube-api-access-7tnmk\") pod \"a983f6bf-6b1b-46c0-a470-4462f7808167\" (UID: \"a983f6bf-6b1b-46c0-a470-4462f7808167\") " Jun 15 09:28:01.407514 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:01.407492 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a983f6bf-6b1b-46c0-a470-4462f7808167-kube-api-access-7tnmk" (OuterVolumeSpecName: "kube-api-access-7tnmk") pod "a983f6bf-6b1b-46c0-a470-4462f7808167" (UID: "a983f6bf-6b1b-46c0-a470-4462f7808167"). InnerVolumeSpecName "kube-api-access-7tnmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:28:01.506010 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:01.505983 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tnmk\" (UniqueName: \"kubernetes.io/projected/a983f6bf-6b1b-46c0-a470-4462f7808167-kube-api-access-7tnmk\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:28:02.157285 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.157253 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.157674 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.157254 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a983f6bf-6b1b-46c0-a470-4462f7808167","Type":"ContainerDied","Data":"9d467fd4bebd57d0ed1f62630dcd0cac91c1a01a38f681b623d268504240187e"} Jun 15 09:28:02.157674 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.157387 2572 scope.go:117] "RemoveContainer" containerID="e963ca8fc6b8d097353fddb265b44ab39f7b64e18373d5bdf8b5ebf69fae9685" Jun 15 09:28:02.179478 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.179455 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:28:02.196393 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.196362 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:28:02.226787 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.226765 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:28:02.227069 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.227055 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" Jun 15 09:28:02.227116 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.227070 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" Jun 15 09:28:02.227155 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.227131 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" containerName="keycloak" Jun 15 09:28:02.231227 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.231204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.233213 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.233185 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 09:28:02.233410 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.233394 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rlpxw\"" Jun 15 09:28:02.233488 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.233429 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 09:28:02.233647 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.233630 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 09:28:02.233706 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.233691 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 09:28:02.240786 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.240765 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:28:02.414061 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.413982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/46426bcd-b04d-4c2f-978a-0c00764b6814-test-realms\") pod \"maas-keycloak-0\" (UID: \"46426bcd-b04d-4c2f-978a-0c00764b6814\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.414061 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.414056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5dt\" (UniqueName: \"kubernetes.io/projected/46426bcd-b04d-4c2f-978a-0c00764b6814-kube-api-access-fg5dt\") pod \"maas-keycloak-0\" (UID: \"46426bcd-b04d-4c2f-978a-0c00764b6814\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.443308 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.443276 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a983f6bf-6b1b-46c0-a470-4462f7808167" path="/var/lib/kubelet/pods/a983f6bf-6b1b-46c0-a470-4462f7808167/volumes" Jun 15 09:28:02.514503 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.514468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/46426bcd-b04d-4c2f-978a-0c00764b6814-test-realms\") pod \"maas-keycloak-0\" (UID: \"46426bcd-b04d-4c2f-978a-0c00764b6814\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.514657 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.514529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5dt\" (UniqueName: \"kubernetes.io/projected/46426bcd-b04d-4c2f-978a-0c00764b6814-kube-api-access-fg5dt\") pod \"maas-keycloak-0\" (UID: \"46426bcd-b04d-4c2f-978a-0c00764b6814\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.515209 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.515185 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/46426bcd-b04d-4c2f-978a-0c00764b6814-test-realms\") pod \"maas-keycloak-0\" (UID: \"46426bcd-b04d-4c2f-978a-0c00764b6814\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.523955 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.523937 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5dt\" (UniqueName: \"kubernetes.io/projected/46426bcd-b04d-4c2f-978a-0c00764b6814-kube-api-access-fg5dt\") pod \"maas-keycloak-0\" (UID: \"46426bcd-b04d-4c2f-978a-0c00764b6814\") " pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.541826 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.541807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:02.671103 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:02.671079 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 09:28:02.673064 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:28:02.673022 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46426bcd_b04d_4c2f_978a_0c00764b6814.slice/crio-a433134a8eaf1521d3709f64c724d5e97a61bcfd68fbe62e22b0defd9db8fde1 WatchSource:0}: Error finding container a433134a8eaf1521d3709f64c724d5e97a61bcfd68fbe62e22b0defd9db8fde1: Status 404 returned error can't find the container with id a433134a8eaf1521d3709f64c724d5e97a61bcfd68fbe62e22b0defd9db8fde1 Jun 15 09:28:03.167970 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:03.167938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"46426bcd-b04d-4c2f-978a-0c00764b6814","Type":"ContainerStarted","Data":"427a726048f0add63e7dfdac69bd68796975be36f2f84ebac2db7577480ebae0"} Jun 15 09:28:03.168404 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:03.167991 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"46426bcd-b04d-4c2f-978a-0c00764b6814","Type":"ContainerStarted","Data":"a433134a8eaf1521d3709f64c724d5e97a61bcfd68fbe62e22b0defd9db8fde1"} Jun 15 09:28:03.186617 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:03.186561 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.855013542 podStartE2EDuration="1.186544023s" totalImagesPullingTime="331.530481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:28:03.184952155 +0000 UTC m=+867.144792937" watchObservedRunningTime="2026-06-15 09:28:03.186544023 +0000 UTC m=+867.146384784" Jun 15 09:28:03.542422 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:03.542385 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:03.544000 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:03.543967 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:04.542758 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:04.542679 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:05.120155 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:05.120116 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-wp7jh" Jun 15 09:28:05.120783 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:05.120729 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-fnwlk" Jun 15 09:28:05.542587 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:05.542547 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:06.543167 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:06.543117 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:07.543034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:07.542988 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:08.542791 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:08.542712 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:09.542771 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:09.542700 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:10.543173 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:10.543122 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:11.542485 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:11.542439 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:12.542755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:12.542703 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:12.543376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:12.543006 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:13.543267 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:13.543215 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:14.542307 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:14.542255 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:15.543049 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:15.543001 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 15 09:28:16.660886 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:16.660861 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:16.679565 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:16.679519 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="46426bcd-b04d-4c2f-978a-0c00764b6814" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 09:28:26.668059 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:26.667982 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 09:28:36.439301 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:36.439273 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:28:36.441245 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:36.441211 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:28:48.559867 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.559833 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48"] Jun 15 09:28:48.563697 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.563677 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.565869 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.565848 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 09:28:48.566693 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.566674 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ttqtt\"" Jun 15 09:28:48.566831 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.566674 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 09:28:48.566831 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.566677 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 09:28:48.574471 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.574447 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48"] Jun 15 09:28:48.717628 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.717596 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hb4\" (UniqueName: \"kubernetes.io/projected/86363bef-57e8-4683-a2f0-0fb47c5d5238-kube-api-access-v9hb4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.717831 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.717642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86363bef-57e8-4683-a2f0-0fb47c5d5238-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.717831 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.717662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.717831 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.717787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.717997 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.717846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.717997 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.717889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hb4\" (UniqueName: \"kubernetes.io/projected/86363bef-57e8-4683-a2f0-0fb47c5d5238-kube-api-access-v9hb4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86363bef-57e8-4683-a2f0-0fb47c5d5238-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818522 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818808 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818971 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.818971 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.818952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.819067 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.819016 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.820929 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.820912 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86363bef-57e8-4683-a2f0-0fb47c5d5238-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.821097 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.821082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86363bef-57e8-4683-a2f0-0fb47c5d5238-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.826370 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.826352 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hb4\" (UniqueName: \"kubernetes.io/projected/86363bef-57e8-4683-a2f0-0fb47c5d5238-kube-api-access-v9hb4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48\" (UID: \"86363bef-57e8-4683-a2f0-0fb47c5d5238\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:48.876142 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:48.876120 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:28:49.016374 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:49.016345 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48"] Jun 15 09:28:49.017702 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:28:49.017677 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86363bef_57e8_4683_a2f0_0fb47c5d5238.slice/crio-059bd3888558f918877c262be3f96d539af6751913f147d6a7b4c202bc1f7e46 WatchSource:0}: Error finding container 059bd3888558f918877c262be3f96d539af6751913f147d6a7b4c202bc1f7e46: Status 404 returned error can't find the container with id 059bd3888558f918877c262be3f96d539af6751913f147d6a7b4c202bc1f7e46 Jun 15 09:28:49.019647 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:49.019625 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 09:28:49.337266 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:49.337231 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:28:49.461203 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:49.461166 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" event={"ID":"86363bef-57e8-4683-a2f0-0fb47c5d5238","Type":"ContainerStarted","Data":"059bd3888558f918877c262be3f96d539af6751913f147d6a7b4c202bc1f7e46"} Jun 15 09:28:53.485210 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:28:53.485167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" event={"ID":"86363bef-57e8-4683-a2f0-0fb47c5d5238","Type":"ContainerStarted","Data":"013feed0be3e99b71b2c313293b0f543d1f3782a6fcd155938fc9e3862059ed5"} Jun 15 09:29:01.743806 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.743762 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb"] Jun 15 09:29:01.747772 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.747745 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:01.749875 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.749853 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 09:29:01.757624 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.757600 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb"] Jun 15 09:29:01.926872 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.926838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:01.927034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.926881 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:01.927034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.926909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:01.927034 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.927009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d848da13-a4a1-4883-91bc-4d906aef28f0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:01.927160 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.927041 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:01.927160 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:01.927071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbt7m\" (UniqueName: \"kubernetes.io/projected/d848da13-a4a1-4883-91bc-4d906aef28f0-kube-api-access-fbt7m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.028033 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.027951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.028033 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.028015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbt7m\" (UniqueName: \"kubernetes.io/projected/d848da13-a4a1-4883-91bc-4d906aef28f0-kube-api-access-fbt7m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.028237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.028060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.028237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.028109 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.028237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.028156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.028237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.028229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d848da13-a4a1-4883-91bc-4d906aef28f0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.031497 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.031465 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d848da13-a4a1-4883-91bc-4d906aef28f0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.031833 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.031810 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.033993 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.033965 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.034207 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.034030 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.034794 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.034775 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d848da13-a4a1-4883-91bc-4d906aef28f0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.039984 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.039958 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbt7m\" (UniqueName: \"kubernetes.io/projected/d848da13-a4a1-4883-91bc-4d906aef28f0-kube-api-access-fbt7m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bx6hb\" (UID: \"d848da13-a4a1-4883-91bc-4d906aef28f0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.058825 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.058803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:29:02.188690 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.188665 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb"] Jun 15 09:29:02.190595 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:29:02.190570 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd848da13_a4a1_4883_91bc_4d906aef28f0.slice/crio-d44d540c7555753ca0a0880f41ae0c4259d61cb96402b822562755d0bf2409ef WatchSource:0}: Error finding container d44d540c7555753ca0a0880f41ae0c4259d61cb96402b822562755d0bf2409ef: Status 404 returned error can't find the container with id d44d540c7555753ca0a0880f41ae0c4259d61cb96402b822562755d0bf2409ef Jun 15 09:29:02.535146 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.535110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" event={"ID":"d848da13-a4a1-4883-91bc-4d906aef28f0","Type":"ContainerStarted","Data":"d6d592ae80dfdb8424a0203bfea5bb423ff640e51092c647635a0f4d2864cc53"} Jun 15 09:29:02.535329 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.535164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" event={"ID":"d848da13-a4a1-4883-91bc-4d906aef28f0","Type":"ContainerStarted","Data":"d44d540c7555753ca0a0880f41ae0c4259d61cb96402b822562755d0bf2409ef"} Jun 15 09:29:02.542129 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:02.542098 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:29:11.754755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:11.754706 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:29:17.386721 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.386674 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l"] Jun 15 09:29:17.397037 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.397014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.399756 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.399589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 15 09:29:17.403842 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.402648 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l"] Jun 15 09:29:17.441431 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.441396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.441596 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.441437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.441596 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.441466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.441714 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.441648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqgd2\" (UniqueName: \"kubernetes.io/projected/95799f76-73dc-44bb-900b-a3b58989fa76-kube-api-access-dqgd2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.441714 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.441707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.441856 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.441760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95799f76-73dc-44bb-900b-a3b58989fa76-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543255 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543210 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543416 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95799f76-73dc-44bb-900b-a3b58989fa76-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543416 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543508 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543430 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543508 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543477 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543595 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqgd2\" (UniqueName: \"kubernetes.io/projected/95799f76-73dc-44bb-900b-a3b58989fa76-kube-api-access-dqgd2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543773 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543721 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.543947 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.544069 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.543814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.545580 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.545560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95799f76-73dc-44bb-900b-a3b58989fa76-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.545917 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.545900 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95799f76-73dc-44bb-900b-a3b58989fa76-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.554521 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.554496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqgd2\" (UniqueName: \"kubernetes.io/projected/95799f76-73dc-44bb-900b-a3b58989fa76-kube-api-access-dqgd2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l\" (UID: \"95799f76-73dc-44bb-900b-a3b58989fa76\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.709980 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.709949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:17.850126 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:17.850097 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l"] Jun 15 09:29:17.850305 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:29:17.850275 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95799f76_73dc_44bb_900b_a3b58989fa76.slice/crio-36a46c8e58e94e9ea0d8ad3a491e93e538178667525a74d3290a0379d44e90c2 WatchSource:0}: Error finding container 36a46c8e58e94e9ea0d8ad3a491e93e538178667525a74d3290a0379d44e90c2: Status 404 returned error can't find the container with id 36a46c8e58e94e9ea0d8ad3a491e93e538178667525a74d3290a0379d44e90c2 Jun 15 09:29:18.538411 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:18.538363 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:29:18.620957 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:18.620916 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" event={"ID":"95799f76-73dc-44bb-900b-a3b58989fa76","Type":"ContainerStarted","Data":"99fbbcf02da6787c8b39552b3f29460d714835c7c0d73258e975f94a2a88c0b3"} Jun 15 09:29:18.621134 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:18.620971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" event={"ID":"95799f76-73dc-44bb-900b-a3b58989fa76","Type":"ContainerStarted","Data":"36a46c8e58e94e9ea0d8ad3a491e93e538178667525a74d3290a0379d44e90c2"} Jun 15 09:29:20.632030 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:20.631991 2572 generic.go:356] "Generic (PLEG): container finished" podID="95799f76-73dc-44bb-900b-a3b58989fa76" containerID="99fbbcf02da6787c8b39552b3f29460d714835c7c0d73258e975f94a2a88c0b3" exitCode=0 Jun 15 09:29:20.632434 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:20.632063 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" event={"ID":"95799f76-73dc-44bb-900b-a3b58989fa76","Type":"ContainerDied","Data":"99fbbcf02da6787c8b39552b3f29460d714835c7c0d73258e975f94a2a88c0b3"} Jun 15 09:29:22.647388 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:22.647311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" event={"ID":"95799f76-73dc-44bb-900b-a3b58989fa76","Type":"ContainerStarted","Data":"38243dac5f7c1a264a3ef040acb641c65b0a0be775a662560a1d74e335c384aa"} Jun 15 09:29:22.667815 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:22.667763 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" podStartSLOduration=2.243163418 podStartE2EDuration="5.667748662s" totalImagesPullingTime="1.595464115s" totalInitContainerRuntime="1.829121129s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:29:22.664593654 +0000 UTC m=+946.624434418" watchObservedRunningTime="2026-06-15 09:29:22.667748662 +0000 UTC m=+946.627589415" Jun 15 09:29:26.259158 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.259126 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c"] Jun 15 09:29:26.266336 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.266302 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.269469 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.269404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 15 09:29:26.278500 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.278475 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c"] Jun 15 09:29:26.315102 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.315077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.315220 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.315115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.315220 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.315133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.315220 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.315163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.315220 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.315200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gxmx\" (UniqueName: \"kubernetes.io/projected/e3540c3e-d28a-44b9-98c8-ab7110a5f938-kube-api-access-2gxmx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.315356 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.315288 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3540c3e-d28a-44b9-98c8-ab7110a5f938-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.415636 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.415608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.415795 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.415649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.415795 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.415669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.415882 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.415791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.415882 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.415827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gxmx\" (UniqueName: \"kubernetes.io/projected/e3540c3e-d28a-44b9-98c8-ab7110a5f938-kube-api-access-2gxmx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.415882 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.415864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3540c3e-d28a-44b9-98c8-ab7110a5f938-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.416112 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.416091 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.416160 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.416110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.416200 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.416170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.417959 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.417941 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3540c3e-d28a-44b9-98c8-ab7110a5f938-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.418385 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.418364 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3540c3e-d28a-44b9-98c8-ab7110a5f938-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.423890 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.423868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gxmx\" (UniqueName: \"kubernetes.io/projected/e3540c3e-d28a-44b9-98c8-ab7110a5f938-kube-api-access-2gxmx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c\" (UID: \"e3540c3e-d28a-44b9-98c8-ab7110a5f938\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.579372 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.579312 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:29:26.716016 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:26.715988 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c"] Jun 15 09:29:26.717143 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:29:26.717117 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3540c3e_d28a_44b9_98c8_ab7110a5f938.slice/crio-dfc8280a410fddb124ef815bcb9905be7255fe874b3585382866de074ccbd8ec WatchSource:0}: Error finding container dfc8280a410fddb124ef815bcb9905be7255fe874b3585382866de074ccbd8ec: Status 404 returned error can't find the container with id dfc8280a410fddb124ef815bcb9905be7255fe874b3585382866de074ccbd8ec Jun 15 09:29:27.054543 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:27.054507 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:29:27.675905 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:27.675866 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" event={"ID":"e3540c3e-d28a-44b9-98c8-ab7110a5f938","Type":"ContainerStarted","Data":"c352757524fa6008bac1e6681dd834955fbdd86ddc4211dcf4517f20a56563bb"} Jun 15 09:29:27.676314 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:27.675921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" event={"ID":"e3540c3e-d28a-44b9-98c8-ab7110a5f938","Type":"ContainerStarted","Data":"dfc8280a410fddb124ef815bcb9905be7255fe874b3585382866de074ccbd8ec"} Jun 15 09:29:27.710361 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:27.710333 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:27.710514 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:27.710393 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:27.722916 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:27.722894 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:28.692142 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:28.692114 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l" Jun 15 09:29:36.441193 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:36.441161 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:29:45.776787 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:45.776754 2572 generic.go:356] "Generic (PLEG): container finished" podID="86363bef-57e8-4683-a2f0-0fb47c5d5238" containerID="013feed0be3e99b71b2c313293b0f543d1f3782a6fcd155938fc9e3862059ed5" exitCode=0 Jun 15 09:29:45.777159 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:45.776805 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" event={"ID":"86363bef-57e8-4683-a2f0-0fb47c5d5238","Type":"ContainerDied","Data":"013feed0be3e99b71b2c313293b0f543d1f3782a6fcd155938fc9e3862059ed5"} Jun 15 09:29:46.789298 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:46.789265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" event={"ID":"86363bef-57e8-4683-a2f0-0fb47c5d5238","Type":"ContainerStarted","Data":"d3e46c1cea9aeeb4c872cd8cb947bd294bc1ca02256ad6e3e0cc81af2aa6174d"} Jun 15 09:29:46.809977 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:46.809922 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" podStartSLOduration=2.34878134 podStartE2EDuration="58.809906037s" totalImagesPullingTime="4.082540051s" totalInitContainerRuntime="52.378584646s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:28:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:29:46.806832652 +0000 UTC m=+970.766673406" watchObservedRunningTime="2026-06-15 09:29:46.809906037 +0000 UTC m=+970.769746798" Jun 15 09:29:48.877180 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:48.877149 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:29:48.877571 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:48.877202 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:29:48.890227 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:48.890203 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:29:49.816428 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:49.816399 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48" Jun 15 09:29:54.834362 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:54.834272 2572 generic.go:356] "Generic (PLEG): container finished" podID="d848da13-a4a1-4883-91bc-4d906aef28f0" containerID="d6d592ae80dfdb8424a0203bfea5bb423ff640e51092c647635a0f4d2864cc53" exitCode=0 Jun 15 09:29:54.834362 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:54.834336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" event={"ID":"d848da13-a4a1-4883-91bc-4d906aef28f0","Type":"ContainerDied","Data":"d6d592ae80dfdb8424a0203bfea5bb423ff640e51092c647635a0f4d2864cc53"} Jun 15 09:29:55.841899 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:55.841863 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" event={"ID":"d848da13-a4a1-4883-91bc-4d906aef28f0","Type":"ContainerStarted","Data":"51b53b73e938907ca43290d6d4a6710e14d60b773b59a4788c1e8ad07014f804"} Jun 15 09:29:55.861394 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:29:55.861345 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" podStartSLOduration=2.3620843000000002 podStartE2EDuration="54.861330438s" totalImagesPullingTime="220.726106ms" totalInitContainerRuntime="52.278520032s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:29:55.859854535 +0000 UTC m=+979.819695297" watchObservedRunningTime="2026-06-15 09:29:55.861330438 +0000 UTC m=+979.821171200" Jun 15 09:30:02.059211 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:02.059173 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:30:02.059653 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:02.059256 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:30:02.072064 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:02.072037 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:30:02.896099 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:02.896067 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bx6hb" Jun 15 09:30:28.023088 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:28.023055 2572 generic.go:356] "Generic (PLEG): container finished" podID="e3540c3e-d28a-44b9-98c8-ab7110a5f938" containerID="c352757524fa6008bac1e6681dd834955fbdd86ddc4211dcf4517f20a56563bb" exitCode=0 Jun 15 09:30:28.023523 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:28.023135 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" event={"ID":"e3540c3e-d28a-44b9-98c8-ab7110a5f938","Type":"ContainerDied","Data":"c352757524fa6008bac1e6681dd834955fbdd86ddc4211dcf4517f20a56563bb"} Jun 15 09:30:33.051708 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:33.051675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" event={"ID":"e3540c3e-d28a-44b9-98c8-ab7110a5f938","Type":"ContainerStarted","Data":"d0bcde279767a8ac06326795e64d589f28a2d45819c3c317ca8b9dd1040e541c"} Jun 15 09:30:33.072590 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:33.072532 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" podStartSLOduration=2.118108604 podStartE2EDuration="1m7.072517649s" totalImagesPullingTime="4.371569177s" totalInitContainerRuntime="1m0.582839868s" isStatefulPod=false podCreationTimestamp="2026-06-15 09:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:30:33.069030065 +0000 UTC m=+1017.028870829" watchObservedRunningTime="2026-06-15 09:30:33.072517649 +0000 UTC m=+1017.032358410" Jun 15 09:30:36.580210 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:36.580176 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:30:36.580646 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:36.580236 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:30:36.592786 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:36.592760 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:30:37.085092 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:30:37.085062 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c" Jun 15 09:31:28.549065 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:31:28.548986 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:31:37.142181 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:31:37.142149 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:31:47.636939 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:31:47.636902 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:31:56.643057 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:31:56.643017 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:32:07.144952 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:07.144918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:32:16.659186 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:16.659149 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:32:24.329258 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.329223 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c6bcbb5c5-s6pjw"] Jun 15 09:32:24.329729 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.329448 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" podUID="903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" containerName="manager" containerID="cri-o://6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a" gracePeriod=30 Jun 15 09:32:24.582386 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.582333 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:32:24.659077 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.659046 2572 generic.go:356] "Generic (PLEG): container finished" podID="903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" containerID="6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a" exitCode=0 Jun 15 09:32:24.659229 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.659094 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" Jun 15 09:32:24.659229 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.659095 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" event={"ID":"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a","Type":"ContainerDied","Data":"6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a"} Jun 15 09:32:24.659229 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.659216 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6bcbb5c5-s6pjw" event={"ID":"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a","Type":"ContainerDied","Data":"c598d0ff2799cb738aa206a14f34cea7092cb902d678e6a20446c37eca0a1d4b"} Jun 15 09:32:24.659349 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.659243 2572 scope.go:117] "RemoveContainer" containerID="6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a" Jun 15 09:32:24.669909 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.669891 2572 scope.go:117] "RemoveContainer" containerID="6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a" Jun 15 09:32:24.670181 ip-10-0-141-4 kubenswrapper[2572]: E0615 09:32:24.670163 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a\": container with ID starting with 6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a not found: ID does not exist" containerID="6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a" Jun 15 09:32:24.670251 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.670188 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a"} err="failed to get container status \"6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a\": rpc error: code = NotFound desc = could not find container \"6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a\": container with ID starting with 6a0fdb733a82caa0aff693e37ffdce215633a3d75a246c1472877ad666fafb5a not found: ID does not exist" Jun 15 09:32:24.706496 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.706470 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps49h\" (UniqueName: \"kubernetes.io/projected/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-kube-api-access-ps49h\") pod \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " Jun 15 09:32:24.706587 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.706540 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-webhook-cert\") pod \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\" (UID: \"903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a\") " Jun 15 09:32:24.708810 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.708785 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" (UID: "903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 09:32:24.708903 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.708812 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-kube-api-access-ps49h" (OuterVolumeSpecName: "kube-api-access-ps49h") pod "903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" (UID: "903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a"). InnerVolumeSpecName "kube-api-access-ps49h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 09:32:24.807582 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.807561 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps49h\" (UniqueName: \"kubernetes.io/projected/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-kube-api-access-ps49h\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:32:24.807582 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.807581 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a-webhook-cert\") on node \"ip-10-0-141-4.ec2.internal\" DevicePath \"\"" Jun 15 09:32:24.982561 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.982529 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c6bcbb5c5-s6pjw"] Jun 15 09:32:24.989330 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:24.989309 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c6bcbb5c5-s6pjw"] Jun 15 09:32:26.438550 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:26.438512 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" path="/var/lib/kubelet/pods/903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a/volumes" Jun 15 09:32:50.744395 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:50.744357 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:32:53.644784 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:32:53.644751 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:33:30.442046 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:33:30.442009 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:33:36.474623 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:33:36.474594 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:33:36.477535 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:33:36.477511 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:33:46.640726 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:33:46.640690 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:34:25.562471 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:34:25.562421 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:34:42.335581 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:34:42.335495 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:34:57.656680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:34:57.656644 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:35:14.363458 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:35:14.363414 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:36:14.956362 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:36:14.956324 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:36:24.056503 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:36:24.056468 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:36:40.767525 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:36:40.767488 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:36:49.334971 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:36:49.334934 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:37:06.845838 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:37:06.845809 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:37:15.636060 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:37:15.636023 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:37:47.737393 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:37:47.737311 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:37:56.442945 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:37:56.442909 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:04.639319 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:04.639284 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:12.940816 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:12.940782 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:21.460680 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:21.460648 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:30.439502 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:30.439472 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:34.451755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:34.446845 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:36.510875 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:36.510848 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:38:36.518554 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:36.518531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:38:47.147167 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:47.147125 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:38:59.431521 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:38:59.431446 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:39:27.044146 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:39:27.044105 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:39:29.851344 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:39:29.851301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:39:47.856791 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:39:47.856752 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:39:54.359848 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:39:54.359810 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:13.643298 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:13.643261 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:18.743253 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:18.743219 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:22.459148 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:22.459116 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:32.651923 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:32.651840 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:40.166000 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:40.165965 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:50.660104 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:50.660067 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:40:58.259069 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:40:58.259032 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:41:08.054951 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:41:08.054915 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:41:15.448942 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:41:15.448905 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:41:23.843338 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:41:23.843296 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:41:32.052098 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:41:32.052059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:43:36.552985 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:43:36.552960 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:43:36.562436 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:43:36.562415 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:45:15.776079 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:45:15.776043 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:45:20.849329 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:45:20.849283 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:45:28.244376 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:45:28.244334 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:45:38.843271 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:45:38.843226 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:45:47.645275 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:45:47.645232 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:45:57.848589 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:45:57.848552 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:46:07.232174 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:46:07.232141 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:46:17.640150 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:46:17.640116 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:46:26.538619 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:46:26.538534 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:46:37.244948 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:46:37.244913 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:46:46.240579 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:46:46.240543 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:47:19.145991 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:47:19.145952 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:02.172601 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:02.172520 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:10.144513 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:10.144476 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:19.746433 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:19.746397 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:28.242005 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:28.241966 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:36.597405 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:36.597378 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:48:36.607244 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:36.607221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:48:36.944796 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:36.944764 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:49.748358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:49.748322 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:48:58.666310 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:48:58.666271 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:49:04.020461 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:49:04.020422 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:49:11.141658 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:49:11.141622 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:49:19.453421 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:49:19.453381 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:49:27.843638 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:49:27.843545 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:49:38.247973 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:49:38.247927 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:49:56.346647 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:49:56.346615 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:50:04.846818 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:50:04.846779 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:50:13.738687 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:50:13.738647 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:50:22.145866 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:50:22.145826 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:50:39.342341 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:50:39.342306 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:50:47.636804 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:50:47.636773 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:50:56.541755 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:50:56.541659 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:51:04.149255 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:51:04.149217 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:51:14.045757 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:51:14.045713 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:51:22.250764 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:51:22.248722 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:51:31.679485 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:51:31.679450 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:51:42.551386 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:51:42.551355 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:51:51.942598 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:51:51.942559 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:03.045166 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:03.045139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:12.339280 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:12.339241 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:17.277586 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:17.277546 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:24.754567 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:24.754534 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:30.142568 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:30.142481 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:44.839193 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:44.839151 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:52:53.649090 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:52:53.649053 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:53:03.051133 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:53:03.051100 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:53:08.955976 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:53:08.955944 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:53:30.949711 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:53:30.949669 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:53:36.633490 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:53:36.633455 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:53:36.643559 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:53:36.643537 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_244c5a6c-9683-4cdf-90a6-a70f39c018ef/ovn-acl-logging/0.log" Jun 15 09:53:43.235686 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:53:43.235649 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g6qd7"] Jun 15 09:54:23.369585 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:23.369550 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cb79bc64-xknhh_0df7fab3-6b09-4b23-b32b-4a31c6302f49/nginx/0.log" Jun 15 09:54:23.487310 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:23.487282 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bzvqq_c2d56f1e-c992-4394-ba0e-68ca027488ca/manager/0.log" Jun 15 09:54:23.611417 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:23.611391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kxzzt_9ee4b6df-e44c-420a-8296-80abf5c6806d/manager/0.log" Jun 15 09:54:24.242137 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:24.242104 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-jsnp5_4e0fc050-0bd9-4324-a909-0d786444c736/server/0.log" Jun 15 09:54:24.378399 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:24.378369 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-72c97_c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c/manager/0.log" Jun 15 09:54:24.759815 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:24.759788 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp_04159138-804b-4008-86eb-50cc2e251f6e/copy-manifests/0.log" Jun 15 09:54:24.772789 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:24.772765 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp_04159138-804b-4008-86eb-50cc2e251f6e/manager/0.log" Jun 15 09:54:25.736700 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:25.736668 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt_09d60c68-6f65-4a12-9e94-e7936003504b/util/0.log" Jun 15 09:54:25.743519 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:25.743485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt_09d60c68-6f65-4a12-9e94-e7936003504b/pull/0.log" Jun 15 09:54:25.750055 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:25.750035 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt_09d60c68-6f65-4a12-9e94-e7936003504b/extract/0.log" Jun 15 09:54:25.874262 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:25.874243 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt_aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893/util/0.log" Jun 15 09:54:25.882597 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:25.882579 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt_aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893/pull/0.log" Jun 15 09:54:25.889837 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:25.889815 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt_aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893/extract/0.log" Jun 15 09:54:26.011815 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:26.011760 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9_e9a725d6-1685-4b10-94e3-f00a2e9ef141/util/0.log" Jun 15 09:54:26.018656 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:26.018638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9_e9a725d6-1685-4b10-94e3-f00a2e9ef141/pull/0.log" Jun 15 09:54:26.025714 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:26.025695 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9_e9a725d6-1685-4b10-94e3-f00a2e9ef141/extract/0.log" Jun 15 09:54:26.144588 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:26.144566 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns_92080661-d934-4332-8140-9093a7aa2b18/util/0.log" Jun 15 09:54:26.153053 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:26.153031 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns_92080661-d934-4332-8140-9093a7aa2b18/pull/0.log" Jun 15 09:54:26.160332 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:26.160313 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns_92080661-d934-4332-8140-9093a7aa2b18/extract/0.log" Jun 15 09:54:27.075789 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:27.075760 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g6qd7_40b95e4a-ed4d-476d-8a0d-e1ea0afaf749/limitador/0.log" Jun 15 09:54:27.707650 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:27.707615 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f2dhz_3df78b61-1258-4959-9b1b-54326f0bbf22/discovery/0.log" Jun 15 09:54:27.830429 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:27.830396 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6c667b66-kkbr4_7d7a4466-c3c9-4ffe-b367-eb5435b7b38d/kube-auth-proxy/0.log" Jun 15 09:54:28.206453 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:28.206423 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-fnwlk_5c5542c1-a34e-438d-93dc-2d28f2eabad4/payload-pre-processing/0.log" Jun 15 09:54:28.325337 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:28.325282 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wp7jh_b28b96a8-84c1-462d-b6f8-ada43ece98c1/payload-processing/0.log" Jun 15 09:54:28.826002 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:28.825976 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48_86363bef-57e8-4683-a2f0-0fb47c5d5238/storage-initializer/0.log" Jun 15 09:54:28.834027 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:28.834006 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-k8w48_86363bef-57e8-4683-a2f0-0fb47c5d5238/main/0.log" Jun 15 09:54:28.958070 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:28.958047 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bx6hb_d848da13-a4a1-4883-91bc-4d906aef28f0/storage-initializer/0.log" Jun 15 09:54:28.965884 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:28.965864 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bx6hb_d848da13-a4a1-4883-91bc-4d906aef28f0/main/0.log" Jun 15 09:54:29.221703 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:29.221683 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l_95799f76-73dc-44bb-900b-a3b58989fa76/storage-initializer/0.log" Jun 15 09:54:29.230136 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:29.230105 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c7d74l_95799f76-73dc-44bb-900b-a3b58989fa76/main/0.log" Jun 15 09:54:29.354312 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:29.354289 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c_e3540c3e-d28a-44b9-98c8-ab7110a5f938/storage-initializer/0.log" Jun 15 09:54:29.362257 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:29.362234 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-6rw2c_e3540c3e-d28a-44b9-98c8-ab7110a5f938/main/0.log" Jun 15 09:54:36.998601 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:36.998575 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m568z_8b25bf6e-22ab-43d7-b225-e4f1b4a504b7/global-pull-secret-syncer/0.log" Jun 15 09:54:37.123618 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:37.123588 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pngx4_316df621-9c9f-42c8-9765-323288a7f85a/konnectivity-agent/0.log" Jun 15 09:54:37.196830 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:37.196804 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-4.ec2.internal_8921aa51ea1d7702a00f526b6904c809/haproxy/0.log" Jun 15 09:54:40.199169 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.199135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt_09d60c68-6f65-4a12-9e94-e7936003504b/extract/0.log" Jun 15 09:54:40.223163 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.223141 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt_09d60c68-6f65-4a12-9e94-e7936003504b/util/0.log" Jun 15 09:54:40.245273 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.245233 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597q8nt_09d60c68-6f65-4a12-9e94-e7936003504b/pull/0.log" Jun 15 09:54:40.279093 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.279070 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt_aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893/extract/0.log" Jun 15 09:54:40.311179 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.311156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt_aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893/util/0.log" Jun 15 09:54:40.340882 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.340857 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9vlt_aa4a6fc9-72d0-42ee-95ea-4eb93cf0b893/pull/0.log" Jun 15 09:54:40.369125 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.369105 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9_e9a725d6-1685-4b10-94e3-f00a2e9ef141/extract/0.log" Jun 15 09:54:40.400061 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.400042 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9_e9a725d6-1685-4b10-94e3-f00a2e9ef141/util/0.log" Jun 15 09:54:40.424529 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.424511 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382rs9_e9a725d6-1685-4b10-94e3-f00a2e9ef141/pull/0.log" Jun 15 09:54:40.455777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.455708 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns_92080661-d934-4332-8140-9093a7aa2b18/extract/0.log" Jun 15 09:54:40.479358 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.479341 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns_92080661-d934-4332-8140-9093a7aa2b18/util/0.log" Jun 15 09:54:40.505778 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:40.505760 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kk6ns_92080661-d934-4332-8140-9093a7aa2b18/pull/0.log" Jun 15 09:54:41.097281 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:41.097250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-4lf8q_94c852d5-90ce-4239-be49-1906b10cea2e/sail-operator/0.log" Jun 15 09:54:41.186096 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:41.186071 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g6qd7_40b95e4a-ed4d-476d-8a0d-e1ea0afaf749/limitador/0.log" Jun 15 09:54:43.858633 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:43.858600 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6zjm_80ba47b7-4570-4e62-87fc-9291b8bbaaaa/node-exporter/0.log" Jun 15 09:54:43.879343 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:43.879321 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6zjm_80ba47b7-4570-4e62-87fc-9291b8bbaaaa/kube-rbac-proxy/0.log" Jun 15 09:54:43.904666 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:43.904645 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6zjm_80ba47b7-4570-4e62-87fc-9291b8bbaaaa/init-textfile/0.log" Jun 15 09:54:46.422950 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:46.422916 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-lnwqc_157076da-2dc6-471f-a92a-1ec7199c39f3/networking-console-plugin/0.log" Jun 15 09:54:49.172826 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.172793 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt"] Jun 15 09:54:49.173294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.173139 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" containerName="manager" Jun 15 09:54:49.173294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.173150 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" containerName="manager" Jun 15 09:54:49.173294 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.173231 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="903bc4a5-5cc9-4e0a-93e0-2e93f298cd7a" containerName="manager" Jun 15 09:54:49.176201 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.176184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.178300 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.178277 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h4wnj\"/\"kube-root-ca.crt\"" Jun 15 09:54:49.178585 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.178567 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h4wnj\"/\"openshift-service-ca.crt\"" Jun 15 09:54:49.179155 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.179140 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h4wnj\"/\"default-dockercfg-7d859\"" Jun 15 09:54:49.186369 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.186345 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt"] Jun 15 09:54:49.296250 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.296220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/e4b1312f-068e-4755-9a51-4d1e33036ce4-kube-api-access-5prxr\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.296385 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.296256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-podres\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.296385 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.296274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-proc\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.296385 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.296301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-sys\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.296385 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.296344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-lib-modules\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397565 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/e4b1312f-068e-4755-9a51-4d1e33036ce4-kube-api-access-5prxr\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397702 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-podres\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397702 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-proc\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397702 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-sys\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397702 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397633 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-lib-modules\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397702 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-proc\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397920 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-sys\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397920 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-podres\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.397920 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.397811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4b1312f-068e-4755-9a51-4d1e33036ce4-lib-modules\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.406132 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.406112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/e4b1312f-068e-4755-9a51-4d1e33036ce4-kube-api-access-5prxr\") pod \"perf-node-gather-daemonset-5vvkt\" (UID: \"e4b1312f-068e-4755-9a51-4d1e33036ce4\") " pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.486215 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.486193 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.628086 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.628054 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt"] Jun 15 09:54:49.629311 ip-10-0-141-4 kubenswrapper[2572]: W0615 09:54:49.629284 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4b1312f_068e_4755_9a51_4d1e33036ce4.slice/crio-1d59dcbaef2ef987ff1db4ce617b5ad022687bfa0b0a7908ed8342dc311eaa7c WatchSource:0}: Error finding container 1d59dcbaef2ef987ff1db4ce617b5ad022687bfa0b0a7908ed8342dc311eaa7c: Status 404 returned error can't find the container with id 1d59dcbaef2ef987ff1db4ce617b5ad022687bfa0b0a7908ed8342dc311eaa7c Jun 15 09:54:49.732857 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.732833 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6nxv9_9aa4f83a-1cc9-490e-857d-8f7108c065d7/dns/0.log" Jun 15 09:54:49.764775 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.764684 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6nxv9_9aa4f83a-1cc9-490e-857d-8f7108c065d7/kube-rbac-proxy/0.log" Jun 15 09:54:49.937192 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.937155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" event={"ID":"e4b1312f-068e-4755-9a51-4d1e33036ce4","Type":"ContainerStarted","Data":"8459a1135b463c6ec9a3c3e4c56129161179790a350d4606cc6990e0f7537ee9"} Jun 15 09:54:49.937331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.937211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" event={"ID":"e4b1312f-068e-4755-9a51-4d1e33036ce4","Type":"ContainerStarted","Data":"1d59dcbaef2ef987ff1db4ce617b5ad022687bfa0b0a7908ed8342dc311eaa7c"} Jun 15 09:54:49.937331 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.937269 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:49.954981 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.954934 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" podStartSLOduration=0.95491959 podStartE2EDuration="954.91959ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 09:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 09:54:49.951623646 +0000 UTC m=+2473.911464407" watchObservedRunningTime="2026-06-15 09:54:49.95491959 +0000 UTC m=+2473.914760352" Jun 15 09:54:49.999393 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:49.999372 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zp9wx_81f0f2eb-a1c6-4853-89a9-7549e0ebbacc/dns-node-resolver/0.log" Jun 15 09:54:50.578089 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:50.578056 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d8pd6_f863db5e-dfa7-4d46-89ad-bcc425f0333c/node-ca/0.log" Jun 15 09:54:51.673905 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:51.673874 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f2dhz_3df78b61-1258-4959-9b1b-54326f0bbf22/discovery/0.log" Jun 15 09:54:51.699571 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:51.699553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6c667b66-kkbr4_7d7a4466-c3c9-4ffe-b367-eb5435b7b38d/kube-auth-proxy/0.log" Jun 15 09:54:51.854365 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:51.854342 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-fnwlk_5c5542c1-a34e-438d-93dc-2d28f2eabad4/payload-pre-processing/0.log" Jun 15 09:54:51.912212 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:51.912193 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wp7jh_b28b96a8-84c1-462d-b6f8-ada43ece98c1/payload-processing/0.log" Jun 15 09:54:52.593572 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:52.593522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ndd7t_6355dea9-d914-42da-999a-bb54fbfdcfa2/serve-healthcheck-canary/0.log" Jun 15 09:54:53.396485 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:53.396456 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbckg_7edc68f5-6516-4e19-9443-48747149b6c2/kube-rbac-proxy/0.log" Jun 15 09:54:53.432960 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:53.432938 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbckg_7edc68f5-6516-4e19-9443-48747149b6c2/exporter/0.log" Jun 15 09:54:53.482356 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:53.482317 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbckg_7edc68f5-6516-4e19-9443-48747149b6c2/extractor/0.log" Jun 15 09:54:55.782237 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:55.782213 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cb79bc64-xknhh_0df7fab3-6b09-4b23-b32b-4a31c6302f49/nginx/0.log" Jun 15 09:54:55.806986 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:55.806963 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bzvqq_c2d56f1e-c992-4394-ba0e-68ca027488ca/manager/0.log" Jun 15 09:54:55.889836 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:55.889811 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kxzzt_9ee4b6df-e44c-420a-8296-80abf5c6806d/manager/0.log" Jun 15 09:54:55.952645 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:55.952622 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h4wnj/perf-node-gather-daemonset-5vvkt" Jun 15 09:54:56.095049 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:56.094983 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-jsnp5_4e0fc050-0bd9-4324-a909-0d786444c736/server/0.log" Jun 15 09:54:56.146655 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:56.146626 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-72c97_c2b3ba20-3fb5-4bc8-80d9-6882e09fee0c/manager/0.log" Jun 15 09:54:56.336509 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:56.336479 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp_04159138-804b-4008-86eb-50cc2e251f6e/manager/0.log" Jun 15 09:54:56.353274 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:54:56.353215 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5ffbc4b4-zwllp_04159138-804b-4008-86eb-50cc2e251f6e/copy-manifests/0.log" Jun 15 09:55:01.993556 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:01.993520 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f2dhz_3df78b61-1258-4959-9b1b-54326f0bbf22/discovery/0.log" Jun 15 09:55:02.005417 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:02.005376 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6c667b66-kkbr4_7d7a4466-c3c9-4ffe-b367-eb5435b7b38d/kube-auth-proxy/0.log" Jun 15 09:55:02.154698 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:02.154670 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-fnwlk_5c5542c1-a34e-438d-93dc-2d28f2eabad4/payload-pre-processing/0.log" Jun 15 09:55:02.208073 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:02.208048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wp7jh_b28b96a8-84c1-462d-b6f8-ada43ece98c1/payload-processing/0.log" Jun 15 09:55:03.513309 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:03.513281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f2dhz_3df78b61-1258-4959-9b1b-54326f0bbf22/discovery/0.log" Jun 15 09:55:03.525222 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:03.525201 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6c667b66-kkbr4_7d7a4466-c3c9-4ffe-b367-eb5435b7b38d/kube-auth-proxy/0.log" Jun 15 09:55:03.652190 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:03.652164 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-fnwlk_5c5542c1-a34e-438d-93dc-2d28f2eabad4/payload-pre-processing/0.log" Jun 15 09:55:03.705102 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:03.705077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wp7jh_b28b96a8-84c1-462d-b6f8-ada43ece98c1/payload-processing/0.log" Jun 15 09:55:05.456111 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.456079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f2dhz_3df78b61-1258-4959-9b1b-54326f0bbf22/discovery/0.log" Jun 15 09:55:05.460232 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.460215 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/kube-multus-additional-cni-plugins/0.log" Jun 15 09:55:05.465484 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.465450 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6c667b66-kkbr4_7d7a4466-c3c9-4ffe-b367-eb5435b7b38d/kube-auth-proxy/0.log" Jun 15 09:55:05.482254 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.482237 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/egress-router-binary-copy/0.log" Jun 15 09:55:05.504377 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.504352 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/cni-plugins/0.log" Jun 15 09:55:05.526704 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.526683 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/bond-cni-plugin/0.log" Jun 15 09:55:05.552944 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.552926 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/routeoverride-cni/0.log" Jun 15 09:55:05.577425 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.577404 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/whereabouts-cni-bincopy/0.log" Jun 15 09:55:05.591701 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.591682 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-fnwlk_5c5542c1-a34e-438d-93dc-2d28f2eabad4/payload-pre-processing/0.log" Jun 15 09:55:05.601235 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.601214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9l7t_653d3b81-5827-4082-8d58-1e08e86add96/whereabouts-cni/0.log" Jun 15 09:55:05.639640 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.639616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wp7jh_b28b96a8-84c1-462d-b6f8-ada43ece98c1/payload-processing/0.log" Jun 15 09:55:05.837794 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.837700 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w8mmc_874cf913-64bf-4f20-81a5-b7aa67b38486/kube-multus/0.log" Jun 15 09:55:05.994228 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:05.994197 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cvd6z_0b1550fb-2331-4d01-8b86-4762fb506edb/network-metrics-daemon/0.log" Jun 15 09:55:06.015777 ip-10-0-141-4 kubenswrapper[2572]: I0615 09:55:06.015754 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cvd6z_0b1550fb-2331-4d01-8b86-4762fb506edb/kube-rbac-proxy/0.log"