Jun 14 14:37:13.739908 ip-10-0-136-235 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 14:37:13.739921 ip-10-0-136-235 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 14:37:13.739931 ip-10-0-136-235 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 14:37:13.740245 ip-10-0-136-235 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 14:37:23.914302 ip-10-0-136-235 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 14:37:23.914323 ip-10-0-136-235 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fc2da6f9b5d243a98bb1041bdc872825 -- Jun 14 14:39:34.500867 ip-10-0-136-235 systemd[1]: Starting Kubernetes Kubelet... Jun 14 14:39:35.002799 ip-10-0-136-235 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:35.002799 ip-10-0-136-235 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 14:39:35.002799 ip-10-0-136-235 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:35.002799 ip-10-0-136-235 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 14:39:35.002799 ip-10-0-136-235 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:35.005775 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.005695 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 14:39:35.010558 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010542 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:35.010558 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010570 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010574 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010578 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010580 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010583 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010586 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010588 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010591 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010594 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010596 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010599 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010601 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010604 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010606 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010609 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010612 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010615 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010617 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010627 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010630 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:35.010636 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010632 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010635 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010638 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010641 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010645 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010649 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010652 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010655 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010658 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010662 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010665 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010668 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010671 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010673 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010677 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010680 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010683 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010686 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010690 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:35.011110 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010693 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010695 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010698 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010701 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010703 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010706 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010708 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010712 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010715 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010717 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010720 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010722 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010725 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010728 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010731 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010734 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010737 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010740 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010742 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:35.011622 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010745 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010747 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010750 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010752 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010755 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010758 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010760 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010763 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010765 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010767 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010770 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010772 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010776 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010778 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010781 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010783 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010786 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010788 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010790 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010793 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:35.012084 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010797 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010799 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010802 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010804 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010807 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010809 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010812 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010814 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010817 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010820 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010823 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010825 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010828 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010830 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010833 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010835 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010838 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010840 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010843 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.010845 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:35.012572 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011540 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011547 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011549 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011552 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011555 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011558 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011575 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011578 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011581 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011583 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011586 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011589 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011592 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011594 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011597 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011600 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011603 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011605 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011608 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011610 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:35.013062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011613 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011616 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011619 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011621 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011624 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011627 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011629 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011632 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011635 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011637 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011640 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011642 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011645 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011647 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011652 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011655 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011659 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011661 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011664 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:35.013675 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011669 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011672 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011675 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011678 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011681 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011683 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011686 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011689 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011691 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011694 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011696 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011699 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011701 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011704 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011707 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011709 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011712 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011715 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011717 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011720 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:35.014174 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011723 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011726 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011729 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011733 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011736 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011739 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011742 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011745 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011747 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011750 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011752 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011755 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011759 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011761 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011764 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011766 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011769 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011771 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011774 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011776 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:35.014702 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011779 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011782 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011784 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011787 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011789 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011792 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011794 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011797 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011799 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011802 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011804 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011807 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011810 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011813 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011815 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011818 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011820 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011823 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011826 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.011828 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:35.015191 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012225 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012230 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012232 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012235 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012239 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012241 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012244 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012246 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012249 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012251 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012254 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012257 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012260 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012262 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012265 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012268 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012271 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012273 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012276 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:35.015693 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012279 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012281 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012284 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012287 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012290 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012293 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012297 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012300 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012302 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012305 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012307 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012310 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012313 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012315 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012318 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012320 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012323 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012325 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012328 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012331 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:35.016153 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012336 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012339 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012341 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012344 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012346 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012349 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012352 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012354 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012357 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012360 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012363 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012365 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012368 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012370 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012373 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012375 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012378 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012380 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012383 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012386 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:35.016648 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012388 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012390 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012393 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012395 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012398 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012401 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012403 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012405 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012408 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012410 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012413 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012415 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012420 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012422 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012424 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012429 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012433 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012436 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012438 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:35.017136 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012441 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012444 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012447 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012450 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012453 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012455 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012458 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012461 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012464 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012468 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012472 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012474 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012477 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012480 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012483 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012485 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012488 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012490 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012493 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012495 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:35.017607 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.012498 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012582 2549 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012589 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012596 2549 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012600 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012612 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012616 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012627 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012631 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012634 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012637 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012641 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012644 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012647 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012651 2549 flags.go:64] FLAG: --cgroup-root="" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012654 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012657 2549 flags.go:64] FLAG: --client-ca-file="" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012660 2549 flags.go:64] FLAG: --cloud-provider="external" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012663 2549 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012667 2549 flags.go:64] FLAG: --cluster-domain="" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012670 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012674 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012677 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012681 2549 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 14:39:35.018112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012684 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012687 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012690 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012693 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012697 2549 flags.go:64] FLAG: --contention-profiling="false" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012700 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012702 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012705 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012708 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012712 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012715 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012718 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012721 2549 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012725 2549 flags.go:64] FLAG: --enable-server="true" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012728 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012735 2549 flags.go:64] FLAG: --event-burst="100" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012738 2549 flags.go:64] FLAG: --event-qps="50" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012741 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012744 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012747 2549 flags.go:64] FLAG: --eviction-hard="" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012750 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012753 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012757 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012760 2549 flags.go:64] FLAG: --eviction-soft="" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012763 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 14:39:35.018732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012766 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012769 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012772 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012775 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012777 2549 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012780 2549 flags.go:64] FLAG: --feature-gates="" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012784 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012787 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012790 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012793 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012796 2549 flags.go:64] FLAG: --healthz-port="10248" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012799 2549 flags.go:64] FLAG: --help="false" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012802 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012805 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012808 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012811 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012814 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012817 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012820 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012823 2549 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012827 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012830 2549 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012838 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012841 2549 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 14:39:35.019382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012844 2549 flags.go:64] FLAG: --kube-reserved="" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012847 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012850 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012853 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012855 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012860 2549 flags.go:64] FLAG: --lock-file="" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012862 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012865 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012869 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012874 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012877 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012880 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012883 2549 flags.go:64] FLAG: --logging-format="text" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012885 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012888 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012891 2549 flags.go:64] FLAG: --manifest-url="" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012894 2549 flags.go:64] FLAG: --manifest-url-header="" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012898 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012901 2549 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012909 2549 flags.go:64] FLAG: --max-pods="110" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012911 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012914 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012917 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012920 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012923 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 14:39:35.019986 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012926 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012929 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012935 2549 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012940 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012943 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012946 2549 flags.go:64] FLAG: --pod-cidr="" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012954 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012961 2549 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012964 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012967 2549 flags.go:64] FLAG: --pods-per-core="0" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012970 2549 flags.go:64] FLAG: --port="10250" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012973 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012977 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ed7567df37ed0716" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012980 2549 flags.go:64] FLAG: --qos-reserved="" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012983 2549 flags.go:64] FLAG: --read-only-port="10255" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012986 2549 flags.go:64] FLAG: --register-node="true" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012989 2549 flags.go:64] FLAG: --register-with-taints="" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012993 2549 flags.go:64] FLAG: --registry-burst="10" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012996 2549 flags.go:64] FLAG: --registry-qps="5" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.012998 2549 flags.go:64] FLAG: --reserved-cpus="" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013001 2549 flags.go:64] FLAG: --reserved-memory="" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013005 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013008 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013011 2549 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013014 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 14:39:35.020635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013017 2549 flags.go:64] FLAG: --runonce="false" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013019 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013022 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013025 2549 flags.go:64] FLAG: --seccomp-default="false" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013028 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013031 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013034 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013036 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013039 2549 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013042 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013045 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013049 2549 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013051 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013054 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013058 2549 flags.go:64] FLAG: --system-cgroups="" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013061 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013066 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013069 2549 flags.go:64] FLAG: --tls-cert-file="" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013072 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013082 2549 flags.go:64] FLAG: --tls-min-version="" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013085 2549 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013088 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013091 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013094 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013097 2549 flags.go:64] FLAG: --v="2" Jun 14 14:39:35.021316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013101 2549 flags.go:64] FLAG: --version="false" Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013105 2549 flags.go:64] FLAG: --vmodule="" Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013108 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.013111 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013222 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013226 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013229 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013231 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013234 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013237 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013240 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013242 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013245 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013247 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013250 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013253 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013255 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013258 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013261 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013263 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:35.021951 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013266 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013269 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013272 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013275 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013277 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013280 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013284 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013286 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013289 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013291 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013294 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013296 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013299 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013301 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013304 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013307 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013309 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013312 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013314 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:35.022445 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013318 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013322 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013325 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013328 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013330 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013333 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013337 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013339 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013342 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013345 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013347 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013350 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013352 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013355 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013357 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013360 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013364 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013367 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013370 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:35.022939 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013374 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013377 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013380 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013383 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013386 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013389 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013392 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013394 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013397 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013400 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013402 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013405 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013407 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013410 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013412 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013415 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013417 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013419 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013422 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013425 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:35.023429 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013427 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013430 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013432 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013435 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013437 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013440 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013442 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013445 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013447 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013450 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013453 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013455 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013459 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013461 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013464 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013466 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013469 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013471 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013474 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013476 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:35.023941 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013479 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013481 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013485 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013488 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.013491 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.014171 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.022400 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.022414 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.023378 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.023386 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023454 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023459 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023463 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023466 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:35.024438 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023469 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023472 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023474 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023477 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023479 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023482 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023485 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023487 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023490 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023493 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023496 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023498 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023501 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023503 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023506 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023508 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023511 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023514 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023516 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023519 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:35.024826 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023521 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023524 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023527 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023529 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023532 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023536 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023539 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023541 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023544 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023547 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023549 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023552 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023554 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023557 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023575 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023579 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023582 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023585 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023587 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023590 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:35.025305 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023593 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023595 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023598 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023601 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023603 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023606 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023609 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023612 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023614 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023618 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023622 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023624 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023627 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023630 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023633 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023636 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023639 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023642 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023646 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:35.025832 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023648 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023651 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023653 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023656 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023658 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023661 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023663 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023666 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023668 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023671 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023673 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023675 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023679 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023683 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023685 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023688 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023690 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023693 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023696 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023698 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:35.026294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023701 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023703 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023706 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023708 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023711 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023713 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023717 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023720 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023723 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023726 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023729 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023732 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023734 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023737 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023740 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:35.026837 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023742 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.023747 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023870 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023875 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023878 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023881 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023883 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023886 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023890 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023892 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023895 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023898 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023903 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023907 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:35.027236 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023910 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023912 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023915 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023918 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023921 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023924 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023927 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023929 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023932 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023934 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023937 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023939 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023942 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023945 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023948 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023950 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023954 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023956 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023959 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:35.027595 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023961 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023965 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023968 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023971 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023974 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023976 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023978 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023981 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023984 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023986 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023988 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023991 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023994 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023997 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.023999 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024002 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024004 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024007 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024009 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:35.028063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024012 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024014 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024017 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024019 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024022 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024025 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024027 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024030 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024032 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024035 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024037 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024040 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024043 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024046 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024048 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024052 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024056 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024060 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024064 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024068 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:35.028517 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024071 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024074 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024077 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024080 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024083 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024085 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024088 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024091 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024093 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024096 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024099 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024101 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024104 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024106 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024109 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024111 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024114 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024116 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024119 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024121 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:35.029062 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024123 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024126 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024128 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024131 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024137 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024139 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024142 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024144 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:35.024147 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.024152 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.024258 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.026657 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.028774 2549 server.go:1019] "Starting client certificate rotation" Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.028886 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:39:35.029557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.028946 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:39:35.031969 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.031955 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:39:35.039168 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.039145 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:39:35.049984 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.049967 2549 log.go:25] "Validated CRI v1 runtime API" Jun 14 14:39:35.053387 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.053369 2549 log.go:25] "Validated CRI v1 image API" Jun 14 14:39:35.054264 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.054249 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 14:39:35.058221 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.058194 2549 fs.go:135] Filesystem UUIDs: map[18598bdd-2840-405d-a98c-453f65543b15:/dev/nvme0n1p3 3d427dbb-8e5d-4844-afa9-518e78ea5762:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 14 14:39:35.058291 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.058221 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 14:39:35.063939 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.063828 2549 manager.go:216] Machine: {Timestamp:2026-06-14 14:39:35.062332749 +0000 UTC m=+0.415710708 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099811 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a6833debd23c50a2feced93a291d SystemUUID:ec28a683-3deb-d23c-50a2-feced93a291d BootID:fc2da6f9-b5d2-43a9-8bb1-041bdc872825 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:5f:4e:ed:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:5f:4e:ed:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:43:d8:9d:df:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 14:39:35.063939 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.063931 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 14:39:35.064079 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.064003 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 14:39:35.064586 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.064554 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:39:35.068234 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.068207 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 14:39:35.068364 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.068233 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 14:39:35.068997 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.068987 2549 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 14:39:35.069028 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.069000 2549 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 14:39:35.069028 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.069007 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:39:35.070143 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.070133 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:39:35.072003 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.071993 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 14:39:35.075507 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075497 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:39:35.075629 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075619 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 14:39:35.075662 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075649 2549 kubelet.go:486] "Attempting to sync node with API server" Jun 14 14:39:35.075662 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075659 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 14:39:35.075720 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075674 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 14:39:35.075720 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075684 2549 kubelet.go:398] "Adding apiserver pod source" Jun 14 14:39:35.075720 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.075692 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 14:39:35.076039 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.076027 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:39:35.076082 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.076046 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:39:35.078688 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.078673 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 14:39:35.080387 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080371 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 14:39:35.080478 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080410 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 14:39:35.080626 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080613 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 14:39:35.080696 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080642 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 14:39:35.080696 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080653 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 14:39:35.080696 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080662 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 14:39:35.080696 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080674 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 14:39:35.080696 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.080683 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 14:39:35.081391 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.081381 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 14:39:35.081444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.081394 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 14:39:35.081444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.081404 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 14:39:35.081444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.081412 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 14:39:35.081444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.081432 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 14:39:35.081444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.081444 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 14:39:35.082719 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.082707 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 14:39:35.082774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.082722 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 14:39:35.084693 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.084671 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 14:39:35.084771 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.084709 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 14:39:35.084771 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.084714 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 14:39:35.087021 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.087001 2549 server.go:1268] "Started kubelet" Jun 14 14:39:35.087115 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.087072 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 14:39:35.087175 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.087141 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 14:39:35.087249 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.087062 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 14:39:35.088044 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.088027 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5wbj4" Jun 14 14:39:35.088223 ip-10-0-136-235 systemd[1]: Started Kubernetes Kubelet. Jun 14 14:39:35.089373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.089347 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 14:39:35.090637 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.090619 2549 server.go:310] "Adding debug handlers to kubelet server" Jun 14 14:39:35.093136 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.093119 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5wbj4" Jun 14 14:39:35.098387 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.098367 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 14:39:35.100134 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.100116 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 14:39:35.100134 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.100127 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 14:39:35.100254 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.100194 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.101088 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.100945 2549 factory.go:55] Registering systemd factory Jun 14 14:39:35.101193 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101183 2549 factory.go:223] Registration of the systemd container factory successfully Jun 14 14:39:35.101247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101085 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 14:39:35.101247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101124 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 14:39:35.101247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101233 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 14:39:35.101378 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101299 2549 reconstruct.go:97] "Volume reconstruction finished" Jun 14 14:39:35.101378 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101308 2549 reconciler.go:29] "Reconciler: start to sync state" Jun 14 14:39:35.101460 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101438 2549 factory.go:153] Registering CRI-O factory Jun 14 14:39:35.101460 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101450 2549 factory.go:223] Registration of the crio container factory successfully Jun 14 14:39:35.101550 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101530 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 14:39:35.101613 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101558 2549 factory.go:103] Registering Raw factory Jun 14 14:39:35.101613 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101591 2549 manager.go:1196] Started watching for new ooms in manager Jun 14 14:39:35.101946 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.101929 2549 manager.go:349] Starting recovery of all containers Jun 14 14:39:35.107308 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.107290 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:35.111404 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.111380 2549 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-235.ec2.internal\" not found" node="ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.111995 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.111980 2549 manager.go:354] Recovery completed Jun 14 14:39:35.115970 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.115959 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.117886 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.117868 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.117955 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.117903 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.117955 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.117917 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.118401 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.118388 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 14:39:35.118401 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.118400 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 14:39:35.118482 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.118417 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:39:35.118482 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.118427 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.119241 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.119228 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.119285 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.119253 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.119285 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.119263 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.119962 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.119951 2549 policy_none.go:49] "None policy: Start" Jun 14 14:39:35.120000 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.119966 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 14:39:35.120000 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.119977 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 14:39:35.121096 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.121086 2549 policy_none.go:47] "Start" Jun 14 14:39:35.159147 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159131 2549 manager.go:337] "Starting Device Plugin manager" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.159169 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159178 2549 server.go:87] "Starting device plugin registration server" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159407 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159418 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159522 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159627 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.159639 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.160287 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.160322 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.170710 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.171841 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.171880 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.171896 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.171924 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 14:39:35.179041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.173349 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:35.260003 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.259931 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.260890 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.260873 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.260938 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.260906 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.260938 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.260920 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.260997 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.260945 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.269213 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.269200 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.269271 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.269220 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-235.ec2.internal\": node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.272481 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.272462 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"] Jun 14 14:39:35.272537 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.272525 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.275245 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.275234 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.275296 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.275260 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.275296 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.275275 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.276544 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.276533 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.276656 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.276641 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.276689 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.276679 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.277239 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.277227 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.277239 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.277237 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.277337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.277253 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.277337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.277260 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.277337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.277275 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.277337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.277264 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.278704 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.278691 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.278756 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.278715 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:35.282233 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.282209 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.282629 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.282615 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:35.282701 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.282640 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:35.282701 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.282649 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:35.292075 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.292054 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-235.ec2.internal\" not found" node="ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.297121 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.297105 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-235.ec2.internal\" not found" node="ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.302850 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.302834 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d8e55ef14373ec2db270f794a4f312f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-235.ec2.internal\" (UID: \"4d8e55ef14373ec2db270f794a4f312f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.302925 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.302857 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f42a1ec90ca503715cfc4476314eff66-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"f42a1ec90ca503715cfc4476314eff66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.302925 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.302875 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f42a1ec90ca503715cfc4476314eff66-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"f42a1ec90ca503715cfc4476314eff66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.383246 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.383223 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.403311 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.403289 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d8e55ef14373ec2db270f794a4f312f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-235.ec2.internal\" (UID: \"4d8e55ef14373ec2db270f794a4f312f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.403395 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.403316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f42a1ec90ca503715cfc4476314eff66-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"f42a1ec90ca503715cfc4476314eff66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.403395 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.403333 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f42a1ec90ca503715cfc4476314eff66-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"f42a1ec90ca503715cfc4476314eff66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.403395 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.403377 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f42a1ec90ca503715cfc4476314eff66-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"f42a1ec90ca503715cfc4476314eff66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.403395 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.403387 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d8e55ef14373ec2db270f794a4f312f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-235.ec2.internal\" (UID: \"4d8e55ef14373ec2db270f794a4f312f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.403522 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.403399 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f42a1ec90ca503715cfc4476314eff66-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"f42a1ec90ca503715cfc4476314eff66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.483924 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.483890 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.584727 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.584690 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.594861 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.594841 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.601201 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:35.601180 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:35.685139 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.685108 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.785599 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.785524 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.886065 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.886040 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:35.986608 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:35.986581 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:36.027003 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.026966 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 14:39:36.027593 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.027122 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:39:36.027593 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.027125 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:39:36.051520 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:36.051482 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8e55ef14373ec2db270f794a4f312f.slice/crio-61caa7a21ee7a898d54ff595093c8ca4a0c290089a943b65c6691dd90a40c638 WatchSource:0}: Error finding container 61caa7a21ee7a898d54ff595093c8ca4a0c290089a943b65c6691dd90a40c638: Status 404 returned error can't find the container with id 61caa7a21ee7a898d54ff595093c8ca4a0c290089a943b65c6691dd90a40c638 Jun 14 14:39:36.051707 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:36.051692 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42a1ec90ca503715cfc4476314eff66.slice/crio-72ae9fb87715703069bcc0ddcc6413e370686534689f20198dd7bd9cc510a62f WatchSource:0}: Error finding container 72ae9fb87715703069bcc0ddcc6413e370686534689f20198dd7bd9cc510a62f: Status 404 returned error can't find the container with id 72ae9fb87715703069bcc0ddcc6413e370686534689f20198dd7bd9cc510a62f Jun 14 14:39:36.055985 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.055963 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:39:36.087341 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:36.087314 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:36.099256 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.099229 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 14:34:35 +0000 UTC" deadline="2027-11-15 11:05:09.835428888 +0000 UTC" Jun 14 14:39:36.099256 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.099252 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12452h25m33.736180137s" Jun 14 14:39:36.123588 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.123550 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:36.174719 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.174672 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" event={"ID":"4d8e55ef14373ec2db270f794a4f312f","Type":"ContainerStarted","Data":"61caa7a21ee7a898d54ff595093c8ca4a0c290089a943b65c6691dd90a40c638"} Jun 14 14:39:36.175595 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.175576 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"f42a1ec90ca503715cfc4476314eff66","Type":"ContainerStarted","Data":"72ae9fb87715703069bcc0ddcc6413e370686534689f20198dd7bd9cc510a62f"} Jun 14 14:39:36.187713 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:36.187692 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:36.288261 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:36.288236 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:36.388806 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:36.388732 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:36.489312 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:36.489272 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found" Jun 14 14:39:36.544336 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.544306 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:36.600941 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.600912 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" Jun 14 14:39:36.610280 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.610256 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:36.611466 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.611444 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" Jun 14 14:39:36.620913 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.620891 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:36.888322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:36.888296 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:37.077140 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.077099 2549 apiserver.go:52] "Watching apiserver" Jun 14 14:39:37.085032 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.085005 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 14:39:37.088366 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.088325 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dfqhx","openshift-ovn-kubernetes/ovnkube-node-cpt5m","kube-system/global-pull-secret-syncer-r4lfw","kube-system/konnectivity-agent-kxgh4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj","openshift-image-registry/node-ca-fdrcg","openshift-multus/multus-z5k49","openshift-multus/network-metrics-daemon-sz6xx","openshift-network-diagnostics/network-check-target-bn8n7","openshift-network-operator/iptables-alerter-ftfgc","kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m4gn6","openshift-dns/node-resolver-x4wkv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"] Jun 14 14:39:37.090151 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.090127 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.091302 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.091282 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.092576 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.092539 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.092936 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.092698 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:37.092936 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.092806 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6r9ck\"" Jun 14 14:39:37.092936 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.092877 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.092936 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.092900 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 14:39:37.093186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.093012 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 14:39:37.093186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.093103 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.093498 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.093478 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.093822 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.093803 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.093924 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.093866 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h96q6\"" Jun 14 14:39:37.094176 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.094159 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.095244 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.095226 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.096308 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.096290 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 14:39:37.096390 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.096338 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 14:39:37.096497 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.096478 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-88nbh\"" Jun 14 14:39:37.096718 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.096703 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.097342 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.097322 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.097520 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.097500 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 14:39:37.097649 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.097544 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jzk65\"" Jun 14 14:39:37.097728 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.097508 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.098007 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.097992 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:37.098081 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.098062 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:37.099173 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.098982 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 14:39:37.099173 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.099041 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.099173 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.099047 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f9xbs\"" Jun 14 14:39:37.099173 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.099085 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.099753 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.099606 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.100832 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.100813 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 14:39:37.100956 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.100942 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.102800 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.102363 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 14:39:37.102800 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.102405 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bssvr\"" Jun 14 14:39:37.102800 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.102407 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.102800 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.102541 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 14:39:37.103085 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.103070 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.104065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.104048 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.104704 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.104353 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:37.105922 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.105903 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.107498 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.107476 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 14:39:37.108186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.108167 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 14:39:37.108271 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.108224 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 14:39:37.108271 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.108236 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.109024 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109005 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 14:39:37.109124 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109005 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 14:39:37.109124 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109012 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zb7w9\"" Jun 14 14:39:37.109268 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109253 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.109353 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109334 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l2qhr\"" Jun 14 14:39:37.109477 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109361 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.109477 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109473 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 14:39:37.109606 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109433 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vn789\"" Jun 14 14:39:37.109606 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.109378 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:39:37.113375 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-cni-bin\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.113493 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113432 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff456538-2dff-49c6-ba8c-2165bfb34524-host\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.113493 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113461 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7m99\" (UniqueName: \"kubernetes.io/projected/ff456538-2dff-49c6-ba8c-2165bfb34524-kube-api-access-k7m99\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.113493 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113485 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-log-socket\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113514 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-system-cni-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113538 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113576 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46e14277-2301-4e1d-b52b-3b5e56cafa91-host-slash\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113599 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113621 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff456538-2dff-49c6-ba8c-2165bfb34524-serviceca\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113644 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-ovnkube-config\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-cni-multus\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.113692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113689 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-cni-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113713 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp54w\" (UniqueName: \"kubernetes.io/projected/2c9857c3-f246-4bed-933b-cca1b2821e8a-kube-api-access-tp54w\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113736 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113759 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2743a642-0c17-44e6-89e4-6742c52f0afd-kubelet-config\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113781 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-cni-netd\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113805 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113830 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8m7c\" (UniqueName: \"kubernetes.io/projected/c0bed816-8b69-48a3-978b-16bc53bd7057-kube-api-access-n8m7c\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-kubelet\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113881 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-cnibin\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113920 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.113960 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1799981e-244f-4549-8197-20784024ec11-ovn-node-metrics-cert\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-k8s-cni-cncf-io\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114037 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-conf-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114065 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0bed816-8b69-48a3-978b-16bc53bd7057-tmp-dir\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114092 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b13cdf5-8297-45d7-9404-8363a9543ebf-konnectivity-ca\") pod \"konnectivity-agent-kxgh4\" (UID: \"9b13cdf5-8297-45d7-9404-8363a9543ebf\") " pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114120 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114147 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114170 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46e14277-2301-4e1d-b52b-3b5e56cafa91-iptables-alerter-script\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114191 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2743a642-0c17-44e6-89e4-6742c52f0afd-dbus\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114219 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-hostroot\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114240 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-os-release\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114267 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-registration-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114293 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-sys-fs\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114322 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-etc-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114344 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qds8b\" (UniqueName: \"kubernetes.io/projected/1799981e-244f-4549-8197-20784024ec11-kube-api-access-qds8b\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114404 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0bed816-8b69-48a3-978b-16bc53bd7057-hosts-file\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114426 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b13cdf5-8297-45d7-9404-8363a9543ebf-agent-certs\") pod \"konnectivity-agent-kxgh4\" (UID: \"9b13cdf5-8297-45d7-9404-8363a9543ebf\") " pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114449 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-socket-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-systemd\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114512 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-node-log\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114542 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-ovnkube-script-lib\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-os-release\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.114931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114623 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkxp8\" (UniqueName: \"kubernetes.io/projected/46e14277-2301-4e1d-b52b-3b5e56cafa91-kube-api-access-bkxp8\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114647 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e00ea18-3fae-4969-83a8-246e316e2ede-cni-binary-copy\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114669 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-daemon-config\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114692 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114714 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-etc-kubernetes\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114735 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114776 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-run-netns\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-system-cni-dir\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114836 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-netns\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-cnibin\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114900 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-device-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114929 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-slash\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114955 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-ovn\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.114987 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115020 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnwv\" (UniqueName: \"kubernetes.io/projected/2b605f07-528a-44b9-96c7-85214b00c9e0-kube-api-access-6bnwv\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.115639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115051 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-kubelet\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115074 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-multus-certs\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115098 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-systemd-units\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-env-overrides\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115129 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4n9\" (UniqueName: \"kubernetes.io/projected/5e00ea18-3fae-4969-83a8-246e316e2ede-kube-api-access-st4n9\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115184 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-socket-dir-parent\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-var-lib-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115251 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-cni-bin\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.116198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.115984 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:39:37.133900 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.133883 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rs8zm" Jun 14 14:39:37.139052 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.139002 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rs8zm" Jun 14 14:39:37.202164 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.202135 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 14:39:37.215636 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215608 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46e14277-2301-4e1d-b52b-3b5e56cafa91-iptables-alerter-script\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.215774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215647 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2743a642-0c17-44e6-89e4-6742c52f0afd-dbus\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.215774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215677 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-hostroot\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.215774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-systemd\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.215774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-lib-modules\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.215774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215751 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-host\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.215774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215774 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-os-release\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215797 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-registration-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215826 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-sys-fs\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215823 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2743a642-0c17-44e6-89e4-6742c52f0afd-dbus\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215841 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-etc-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215856 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qds8b\" (UniqueName: \"kubernetes.io/projected/1799981e-244f-4549-8197-20784024ec11-kube-api-access-qds8b\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215877 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-registration-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215887 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-os-release\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215901 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-sys-fs\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215939 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-var-lib-kubelet\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215946 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-etc-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.215981 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0bed816-8b69-48a3-978b-16bc53bd7057-hosts-file\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216021 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b13cdf5-8297-45d7-9404-8363a9543ebf-agent-certs\") pod \"konnectivity-agent-kxgh4\" (UID: \"9b13cdf5-8297-45d7-9404-8363a9543ebf\") " pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216032 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0bed816-8b69-48a3-978b-16bc53bd7057-hosts-file\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216045 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-socket-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216069 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-systemd\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216092 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-node-log\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-ovnkube-script-lib\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216145 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-os-release\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216155 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-systemd\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216169 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkxp8\" (UniqueName: \"kubernetes.io/projected/46e14277-2301-4e1d-b52b-3b5e56cafa91-kube-api-access-bkxp8\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216189 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-socket-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216196 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216222 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-kubernetes\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216245 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-node-log\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216252 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216245 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysctl-d\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216291 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e00ea18-3fae-4969-83a8-246e316e2ede-cni-binary-copy\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216315 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46e14277-2301-4e1d-b52b-3b5e56cafa91-iptables-alerter-script\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216314 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-os-release\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-daemon-config\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216530 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-sys\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.216884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216576 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634f424a-4194-4ec3-be15-c831808b7701-tmp\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216606 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-etc-kubernetes\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216629 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216649 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-run-netns\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216670 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-system-cni-dir\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216690 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/634f424a-4194-4ec3-be15-c831808b7701-etc-tuned\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216709 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-netns\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216738 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-cnibin\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216762 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216782 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-device-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216793 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-ovnkube-script-lib\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216801 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-slash\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216815 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-run-netns\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216822 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-ovn\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216870 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-system-cni-dir\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216873 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e00ea18-3fae-4969-83a8-246e316e2ede-cni-binary-copy\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216874 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-netns\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216909 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-ovn\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.217699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216918 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-cnibin\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216899 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-daemon-config\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216934 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-run-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216950 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-etc-kubernetes\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216958 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-device-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216970 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-slash\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216977 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.216998 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c9857c3-f246-4bed-933b-cca1b2821e8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217005 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-hostroot\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217022 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnwv\" (UniqueName: \"kubernetes.io/projected/2b605f07-528a-44b9-96c7-85214b00c9e0-kube-api-access-6bnwv\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-kubelet\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217078 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-multus-certs\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217113 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-multus-certs\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217113 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-kubelet\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217134 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-systemd-units\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217238 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-systemd-units\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.218672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-env-overrides\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217271 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4n9\" (UniqueName: \"kubernetes.io/projected/5e00ea18-3fae-4969-83a8-246e316e2ede-kube-api-access-st4n9\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217299 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-socket-dir-parent\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217315 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-var-lib-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217333 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-cni-bin\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217352 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-cni-bin\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217371 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff456538-2dff-49c6-ba8c-2165bfb34524-host\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217385 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7m99\" (UniqueName: \"kubernetes.io/projected/ff456538-2dff-49c6-ba8c-2165bfb34524-kube-api-access-k7m99\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217399 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-log-socket\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217422 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysconfig\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217439 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-system-cni-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217462 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217478 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46e14277-2301-4e1d-b52b-3b5e56cafa91-host-slash\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217498 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzjct\" (UniqueName: \"kubernetes.io/projected/3810f95e-5de0-45a5-b079-0d507102215c-kube-api-access-zzjct\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217519 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217520 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff456538-2dff-49c6-ba8c-2165bfb34524-host\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217536 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff456538-2dff-49c6-ba8c-2165bfb34524-serviceca\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.219496 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217599 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-socket-dir-parent\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217637 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217656 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-ovnkube-config\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217684 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-cni-multus\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217697 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-cni-bin\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217711 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-cni-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217708 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-env-overrides\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217736 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-var-lib-openvswitch\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217779 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-cni-multus\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217796 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-cni-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217827 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-system-cni-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217839 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-var-lib-cni-bin\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217888 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46e14277-2301-4e1d-b52b-3b5e56cafa91-host-slash\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.217975 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff456538-2dff-49c6-ba8c-2165bfb34524-serviceca\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218044 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-log-socket\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.218076 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218081 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp54w\" (UniqueName: \"kubernetes.io/projected/2c9857c3-f246-4bed-933b-cca1b2821e8a-kube-api-access-tp54w\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218109 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:37.219994 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218130 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysctl-conf\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218154 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1799981e-244f-4549-8197-20784024ec11-ovnkube-config\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.218161 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:39:37.718124921 +0000 UTC m=+3.071502853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218214 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m84h\" (UniqueName: \"kubernetes.io/projected/634f424a-4194-4ec3-be15-c831808b7701-kube-api-access-6m84h\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218246 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2743a642-0c17-44e6-89e4-6742c52f0afd-kubelet-config\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218272 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-cni-netd\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218296 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218323 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8m7c\" (UniqueName: \"kubernetes.io/projected/c0bed816-8b69-48a3-978b-16bc53bd7057-kube-api-access-n8m7c\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218338 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218346 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-kubelet\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218386 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-cni-netd\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218389 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-kubelet\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218404 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-cnibin\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218421 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218437 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218467 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-modprobe-d\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.220479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218482 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2743a642-0c17-44e6-89e4-6742c52f0afd-kubelet-config\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-run\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218440 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-cnibin\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218520 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1799981e-244f-4549-8197-20784024ec11-ovn-node-metrics-cert\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218544 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-k8s-cni-cncf-io\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218590 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-conf-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218614 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0bed816-8b69-48a3-978b-16bc53bd7057-tmp-dir\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218635 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b13cdf5-8297-45d7-9404-8363a9543ebf-konnectivity-ca\") pod \"konnectivity-agent-kxgh4\" (UID: \"9b13cdf5-8297-45d7-9404-8363a9543ebf\") " pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218659 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218660 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b605f07-528a-44b9-96c7-85214b00c9e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218679 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218748 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-host-run-k8s-cni-cncf-io\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e00ea18-3fae-4969-83a8-246e316e2ede-multus-conf-dir\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.218969 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1799981e-244f-4549-8197-20784024ec11-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.219037 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0bed816-8b69-48a3-978b-16bc53bd7057-tmp-dir\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.219552 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b13cdf5-8297-45d7-9404-8363a9543ebf-konnectivity-ca\") pod \"konnectivity-agent-kxgh4\" (UID: \"9b13cdf5-8297-45d7-9404-8363a9543ebf\") " pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.219691 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b605f07-528a-44b9-96c7-85214b00c9e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.220947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.219937 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b13cdf5-8297-45d7-9404-8363a9543ebf-agent-certs\") pod \"konnectivity-agent-kxgh4\" (UID: \"9b13cdf5-8297-45d7-9404-8363a9543ebf\") " pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.221441 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.220685 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1799981e-244f-4549-8197-20784024ec11-ovn-node-metrics-cert\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.223820 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.223800 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qds8b\" (UniqueName: \"kubernetes.io/projected/1799981e-244f-4549-8197-20784024ec11-kube-api-access-qds8b\") pod \"ovnkube-node-cpt5m\" (UID: \"1799981e-244f-4549-8197-20784024ec11\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.224010 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.223992 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkxp8\" (UniqueName: \"kubernetes.io/projected/46e14277-2301-4e1d-b52b-3b5e56cafa91-kube-api-access-bkxp8\") pod \"iptables-alerter-ftfgc\" (UID: \"46e14277-2301-4e1d-b52b-3b5e56cafa91\") " pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.226681 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.226661 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:37.226800 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.226685 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:37.226800 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.226697 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:37.226800 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.226765 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:37.726748671 +0000 UTC m=+3.080126612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:37.228675 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.228631 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnwv\" (UniqueName: \"kubernetes.io/projected/2b605f07-528a-44b9-96c7-85214b00c9e0-kube-api-access-6bnwv\") pod \"multus-additional-cni-plugins-dfqhx\" (UID: \"2b605f07-528a-44b9-96c7-85214b00c9e0\") " pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.229585 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.229526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4n9\" (UniqueName: \"kubernetes.io/projected/5e00ea18-3fae-4969-83a8-246e316e2ede-kube-api-access-st4n9\") pod \"multus-z5k49\" (UID: \"5e00ea18-3fae-4969-83a8-246e316e2ede\") " pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.229920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.229900 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7m99\" (UniqueName: \"kubernetes.io/projected/ff456538-2dff-49c6-ba8c-2165bfb34524-kube-api-access-k7m99\") pod \"node-ca-fdrcg\" (UID: \"ff456538-2dff-49c6-ba8c-2165bfb34524\") " pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.230170 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.230067 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp54w\" (UniqueName: \"kubernetes.io/projected/2c9857c3-f246-4bed-933b-cca1b2821e8a-kube-api-access-tp54w\") pod \"aws-ebs-csi-driver-node-tzlvj\" (UID: \"2c9857c3-f246-4bed-933b-cca1b2821e8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.230604 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.230581 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8m7c\" (UniqueName: \"kubernetes.io/projected/c0bed816-8b69-48a3-978b-16bc53bd7057-kube-api-access-n8m7c\") pod \"node-resolver-x4wkv\" (UID: \"c0bed816-8b69-48a3-978b-16bc53bd7057\") " pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.319160 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319128 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m84h\" (UniqueName: \"kubernetes.io/projected/634f424a-4194-4ec3-be15-c831808b7701-kube-api-access-6m84h\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319160 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319165 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-modprobe-d\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319181 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-run\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319209 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-systemd\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319231 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-lib-modules\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319252 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-host\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319275 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-var-lib-kubelet\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319278 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-run\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319333 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-modprobe-d\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319331 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-systemd\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319346 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-lib-modules\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319373 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319355 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-kubernetes\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.319380 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319395 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-host\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319397 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-var-lib-kubelet\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319403 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-kubernetes\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319418 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysctl-d\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.319434 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:39:37.819414759 +0000 UTC m=+3.172792686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319500 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysctl-d\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319502 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-sys\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319533 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634f424a-4194-4ec3-be15-c831808b7701-tmp\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319545 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-sys\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319559 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/634f424a-4194-4ec3-be15-c831808b7701-etc-tuned\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319616 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysconfig\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319643 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzjct\" (UniqueName: \"kubernetes.io/projected/3810f95e-5de0-45a5-b079-0d507102215c-kube-api-access-zzjct\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319682 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysconfig\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319692 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysctl-conf\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.319920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.319821 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/634f424a-4194-4ec3-be15-c831808b7701-etc-sysctl-conf\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.322154 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.322127 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634f424a-4194-4ec3-be15-c831808b7701-tmp\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.322255 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.322172 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/634f424a-4194-4ec3-be15-c831808b7701-etc-tuned\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.327637 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.327615 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m84h\" (UniqueName: \"kubernetes.io/projected/634f424a-4194-4ec3-be15-c831808b7701-kube-api-access-6m84h\") pod \"tuned-m4gn6\" (UID: \"634f424a-4194-4ec3-be15-c831808b7701\") " pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.328213 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.328196 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzjct\" (UniqueName: \"kubernetes.io/projected/3810f95e-5de0-45a5-b079-0d507102215c-kube-api-access-zzjct\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.387355 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.387330 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:37.402384 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.402329 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5k49" Jun 14 14:39:37.410708 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.410686 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x4wkv" Jun 14 14:39:37.417489 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.417471 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:39:37.424444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.424428 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" Jun 14 14:39:37.430177 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.430161 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fdrcg" Jun 14 14:39:37.437279 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.437261 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" Jun 14 14:39:37.444490 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.444473 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:39:37.451168 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.451152 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ftfgc" Jun 14 14:39:37.457287 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.457265 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" Jun 14 14:39:37.722271 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.722230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:37.722440 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.722379 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:37.722495 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.722450 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:39:38.722430786 +0000 UTC m=+4.075808720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:37.822813 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.822778 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:37.822991 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:37.822848 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:37.822991 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.822964 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:37.822991 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.822975 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:37.822991 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.822988 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:37.823211 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.823003 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:37.823211 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.823043 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:39:38.823022069 +0000 UTC m=+4.176399999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:37.823211 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:37.823062 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:38.823052146 +0000 UTC m=+4.176430080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:37.875075 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.874909 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e00ea18_3fae_4969_83a8_246e316e2ede.slice/crio-04d2412b939da3fd1fffe5491aa5d3ed08abc52dd6cc5ae794c01ff9b418bc2b WatchSource:0}: Error finding container 04d2412b939da3fd1fffe5491aa5d3ed08abc52dd6cc5ae794c01ff9b418bc2b: Status 404 returned error can't find the container with id 04d2412b939da3fd1fffe5491aa5d3ed08abc52dd6cc5ae794c01ff9b418bc2b Jun 14 14:39:37.876710 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.876685 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b13cdf5_8297_45d7_9404_8363a9543ebf.slice/crio-180a6061d28d9ed93cb3f3640f2e9099551eadc28d88d17c2ff1276371ae80d6 WatchSource:0}: Error finding container 180a6061d28d9ed93cb3f3640f2e9099551eadc28d88d17c2ff1276371ae80d6: Status 404 returned error can't find the container with id 180a6061d28d9ed93cb3f3640f2e9099551eadc28d88d17c2ff1276371ae80d6 Jun 14 14:39:37.879747 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.879725 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b605f07_528a_44b9_96c7_85214b00c9e0.slice/crio-2bbde237d4e3919aaca247e77a4f9e2ea0f1fd3ea4ce7b8563e06fccd6d5981d WatchSource:0}: Error finding container 2bbde237d4e3919aaca247e77a4f9e2ea0f1fd3ea4ce7b8563e06fccd6d5981d: Status 404 returned error can't find the container with id 2bbde237d4e3919aaca247e77a4f9e2ea0f1fd3ea4ce7b8563e06fccd6d5981d Jun 14 14:39:37.880863 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.880842 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bed816_8b69_48a3_978b_16bc53bd7057.slice/crio-ae67c266bd5cf1db1363eb36a78879a2af73525d4d8eb6f38a55cde25c51f196 WatchSource:0}: Error finding container ae67c266bd5cf1db1363eb36a78879a2af73525d4d8eb6f38a55cde25c51f196: Status 404 returned error can't find the container with id ae67c266bd5cf1db1363eb36a78879a2af73525d4d8eb6f38a55cde25c51f196 Jun 14 14:39:37.881257 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.881236 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634f424a_4194_4ec3_be15_c831808b7701.slice/crio-f2505b4affe2f9fa12e1724c4116fe432a77fb960e9b7b9a57d0a725a6afd587 WatchSource:0}: Error finding container f2505b4affe2f9fa12e1724c4116fe432a77fb960e9b7b9a57d0a725a6afd587: Status 404 returned error can't find the container with id f2505b4affe2f9fa12e1724c4116fe432a77fb960e9b7b9a57d0a725a6afd587 Jun 14 14:39:37.882056 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.882037 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1799981e_244f_4549_8197_20784024ec11.slice/crio-31ff83216404c9bf9d1b7e9453ef26226540471c2a2a78488ce8eb6da58ca00f WatchSource:0}: Error finding container 31ff83216404c9bf9d1b7e9453ef26226540471c2a2a78488ce8eb6da58ca00f: Status 404 returned error can't find the container with id 31ff83216404c9bf9d1b7e9453ef26226540471c2a2a78488ce8eb6da58ca00f Jun 14 14:39:37.883745 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.883727 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9857c3_f246_4bed_933b_cca1b2821e8a.slice/crio-70cc0b8daf7c06d595ffdc5b4f9c33142b44722ec2c3df4582fe451ada61f335 WatchSource:0}: Error finding container 70cc0b8daf7c06d595ffdc5b4f9c33142b44722ec2c3df4582fe451ada61f335: Status 404 returned error can't find the container with id 70cc0b8daf7c06d595ffdc5b4f9c33142b44722ec2c3df4582fe451ada61f335 Jun 14 14:39:37.886052 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:39:37.886019 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff456538_2dff_49c6_ba8c_2165bfb34524.slice/crio-d442bc865072cfbe4522daf0fad44d2deab68a055ac03751ab3a00844712cd23 WatchSource:0}: Error finding container d442bc865072cfbe4522daf0fad44d2deab68a055ac03751ab3a00844712cd23: Status 404 returned error can't find the container with id d442bc865072cfbe4522daf0fad44d2deab68a055ac03751ab3a00844712cd23 Jun 14 14:39:38.141242 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.141197 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:34:37 +0000 UTC" deadline="2028-02-17 18:16:22.255240268 +0000 UTC" Jun 14 14:39:38.141242 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.141238 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14715h36m44.114004193s" Jun 14 14:39:38.179264 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.179229 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fdrcg" event={"ID":"ff456538-2dff-49c6-ba8c-2165bfb34524","Type":"ContainerStarted","Data":"d442bc865072cfbe4522daf0fad44d2deab68a055ac03751ab3a00844712cd23"} Jun 14 14:39:38.180247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.180221 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" event={"ID":"2c9857c3-f246-4bed-933b-cca1b2821e8a","Type":"ContainerStarted","Data":"70cc0b8daf7c06d595ffdc5b4f9c33142b44722ec2c3df4582fe451ada61f335"} Jun 14 14:39:38.182913 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.182879 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerStarted","Data":"2bbde237d4e3919aaca247e77a4f9e2ea0f1fd3ea4ce7b8563e06fccd6d5981d"} Jun 14 14:39:38.184608 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.184558 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5k49" event={"ID":"5e00ea18-3fae-4969-83a8-246e316e2ede","Type":"ContainerStarted","Data":"04d2412b939da3fd1fffe5491aa5d3ed08abc52dd6cc5ae794c01ff9b418bc2b"} Jun 14 14:39:38.185843 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.185822 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ftfgc" event={"ID":"46e14277-2301-4e1d-b52b-3b5e56cafa91","Type":"ContainerStarted","Data":"37e235178a439a58219e27baea9ee4ef2577ef6fccc93bfd900b9396419914d0"} Jun 14 14:39:38.186937 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.186914 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"31ff83216404c9bf9d1b7e9453ef26226540471c2a2a78488ce8eb6da58ca00f"} Jun 14 14:39:38.187951 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.187930 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" event={"ID":"634f424a-4194-4ec3-be15-c831808b7701","Type":"ContainerStarted","Data":"f2505b4affe2f9fa12e1724c4116fe432a77fb960e9b7b9a57d0a725a6afd587"} Jun 14 14:39:38.189216 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.189185 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x4wkv" event={"ID":"c0bed816-8b69-48a3-978b-16bc53bd7057","Type":"ContainerStarted","Data":"ae67c266bd5cf1db1363eb36a78879a2af73525d4d8eb6f38a55cde25c51f196"} Jun 14 14:39:38.190222 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.190200 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxgh4" event={"ID":"9b13cdf5-8297-45d7-9404-8363a9543ebf","Type":"ContainerStarted","Data":"180a6061d28d9ed93cb3f3640f2e9099551eadc28d88d17c2ff1276371ae80d6"} Jun 14 14:39:38.195232 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.195210 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" event={"ID":"4d8e55ef14373ec2db270f794a4f312f","Type":"ContainerStarted","Data":"9f8b327f34d6ec8c93a86d579de656eebc6767034054223cc1105860cc3eb58d"} Jun 14 14:39:38.197108 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.197080 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"f42a1ec90ca503715cfc4476314eff66","Type":"ContainerStarted","Data":"2cdfb98e8671f47662e6b6c6ef522c0917cde9122e9e8eed24fbe0659cfb9546"} Jun 14 14:39:38.220907 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.220868 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" podStartSLOduration=2.220855265 podStartE2EDuration="2.220855265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:38.208329077 +0000 UTC m=+3.561707027" watchObservedRunningTime="2026-06-14 14:39:38.220855265 +0000 UTC m=+3.574233218" Jun 14 14:39:38.731695 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.730987 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:38.731695 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.731169 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:38.731695 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.731234 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:39:40.731216393 +0000 UTC m=+6.084594322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:38.832186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.832147 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:38.832351 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:38.832243 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:38.832412 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.832375 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:38.832412 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.832394 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:38.832412 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.832406 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:38.832586 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.832465 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:40.832446459 +0000 UTC m=+6.185824385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:38.832906 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.832885 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:38.833015 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:38.832941 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:39:40.832926734 +0000 UTC m=+6.186304674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:39.142626 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.142528 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:34:37 +0000 UTC" deadline="2027-12-31 04:12:26.188733749 +0000 UTC" Jun 14 14:39:39.142626 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.142580 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13549h32m47.046159242s" Jun 14 14:39:39.175513 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.175480 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:39.175692 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:39.175624 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:39.175757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.175706 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:39.175812 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:39.175780 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:39.175864 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.175844 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:39.175938 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:39.175920 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:39.217283 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.216005 2549 generic.go:356] "Generic (PLEG): container finished" podID="f42a1ec90ca503715cfc4476314eff66" containerID="2cdfb98e8671f47662e6b6c6ef522c0917cde9122e9e8eed24fbe0659cfb9546" exitCode=0 Jun 14 14:39:39.217283 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:39.217077 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"f42a1ec90ca503715cfc4476314eff66","Type":"ContainerDied","Data":"2cdfb98e8671f47662e6b6c6ef522c0917cde9122e9e8eed24fbe0659cfb9546"} Jun 14 14:39:40.234007 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:40.233969 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"f42a1ec90ca503715cfc4476314eff66","Type":"ContainerStarted","Data":"875e0c3ac0a55fef9aa45f7885223edda7e83f9603ecdd7d9c700961ebe8b0f8"} Jun 14 14:39:40.749653 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:40.749511 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:40.749831 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.749685 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:40.749831 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.749759 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:39:44.749739055 +0000 UTC m=+10.103116983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:40.850709 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:40.850677 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:40.850885 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:40.850738 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:40.850885 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.850853 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:40.850988 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.850912 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:39:44.850893006 +0000 UTC m=+10.204270951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:40.851551 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.851531 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:40.851673 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.851557 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:40.851673 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.851588 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:40.851673 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:40.851638 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:44.85162086 +0000 UTC m=+10.204998792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:41.172637 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:41.172172 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:41.172637 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:41.172178 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:41.172637 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:41.172296 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:41.172637 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:41.172318 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:41.172637 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:41.172418 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:41.172637 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:41.172497 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:43.173252 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:43.173217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:43.173724 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:43.173353 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:43.173724 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:43.173217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:43.173724 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:43.173474 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:43.173724 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:43.173517 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:43.173724 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:43.173611 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:44.784120 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:44.784071 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:44.784589 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.784269 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:44.784589 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.784347 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:39:52.784326828 +0000 UTC m=+18.137704777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:44.885309 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:44.885273 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:44.885462 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:44.885382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:44.885670 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.885489 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:44.885670 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.885505 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:44.885670 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.885524 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:44.885670 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.885537 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:44.885670 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.885580 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:39:52.885544555 +0000 UTC m=+18.238922491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:44.885670 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:44.885604 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:52.885588757 +0000 UTC m=+18.238966708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:45.175980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:45.175531 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:45.175980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:45.175878 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:45.176188 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:45.175974 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:45.176246 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:45.176203 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:45.176246 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:45.175882 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:45.178598 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:45.177047 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:47.172710 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:47.172680 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:47.173154 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:47.172720 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:47.173154 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:47.172683 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:47.173154 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:47.172811 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:47.173154 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:47.172891 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:47.173154 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:47.172966 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:49.172352 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:49.172285 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:49.172352 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:49.172301 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:49.172858 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:49.172415 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:49.172858 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:49.172441 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:49.172955 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:49.172903 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:49.173338 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:49.173037 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:51.172841 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:51.172809 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:51.173302 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:51.172809 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:51.173302 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:51.172927 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:51.173302 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:51.172810 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:51.173302 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:51.173096 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:51.173302 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:51.173192 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:52.844455 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:52.844420 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:52.844918 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.844595 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:52.844918 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.844661 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:40:08.84464093 +0000 UTC m=+34.198018863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:52.945638 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:52.945607 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:52.945808 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:52.945693 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:52.945808 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.945769 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:52.945924 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.945826 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:52.945924 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.945841 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:40:08.945820045 +0000 UTC m=+34.299197984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:52.945924 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.945844 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:52.945924 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.945859 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:52.945924 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:52.945907 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:08.945889998 +0000 UTC m=+34.299267942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:53.173083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:53.172998 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:53.173083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:53.173035 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:53.173297 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:53.173004 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:53.173297 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:53.173123 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:53.173297 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:53.173199 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:53.173297 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:53.173278 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:55.172901 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:55.172863 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:55.173391 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:55.172973 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:55.173391 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:55.172975 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:55.173391 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:55.173088 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:55.173391 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:55.173111 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:55.173391 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:55.173193 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:56.265172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:56.265017 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxgh4" event={"ID":"9b13cdf5-8297-45d7-9404-8363a9543ebf","Type":"ContainerStarted","Data":"119bcf41d1570395f6bbcca7a51541d78bc1a2fccba5ffda095e62c337bc5085"} Jun 14 14:39:57.173426 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.173129 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:57.173534 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:57.173419 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:57.173534 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.173191 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:57.173534 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:57.173518 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:57.173534 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.173135 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:57.173774 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:57.173614 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:57.242682 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.242662 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 14:39:57.268115 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.268087 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fdrcg" event={"ID":"ff456538-2dff-49c6-ba8c-2165bfb34524","Type":"ContainerStarted","Data":"a8a1b8dc05b1cce2fea4ff64ce906c223731c870f88e1487a02de51041d2d91b"} Jun 14 14:39:57.269689 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.269670 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" event={"ID":"2c9857c3-f246-4bed-933b-cca1b2821e8a","Type":"ContainerStarted","Data":"b298fd13e660554563cf7cb2f755b7d8b8a8aca0fb07944679d2c002c59e5800"} Jun 14 14:39:57.269780 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.269715 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" event={"ID":"2c9857c3-f246-4bed-933b-cca1b2821e8a","Type":"ContainerStarted","Data":"9e16fa2c49b433e851ade23b8ffe9e1229a76b5bf807ce5b4d701f9495751346"} Jun 14 14:39:57.271037 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.271010 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b605f07-528a-44b9-96c7-85214b00c9e0" containerID="57dfde0b649a3e6912dd98e7cdd42909707713f1bc85174e929187d94d578d74" exitCode=0 Jun 14 14:39:57.271126 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.271072 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerDied","Data":"57dfde0b649a3e6912dd98e7cdd42909707713f1bc85174e929187d94d578d74"} Jun 14 14:39:57.272522 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.272498 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5k49" event={"ID":"5e00ea18-3fae-4969-83a8-246e316e2ede","Type":"ContainerStarted","Data":"20caf15b3bf144911389dce6fb167aba3bfe271c40ca160a42b318705313b56d"} Jun 14 14:39:57.275149 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275132 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:39:57.275436 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275419 2549 generic.go:356] "Generic (PLEG): container finished" podID="1799981e-244f-4549-8197-20784024ec11" containerID="22388de981fd9cd267eedee79f889e7bcb4f7b8d1b56532cf93ca8eab1055e89" exitCode=1 Jun 14 14:39:57.275506 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275481 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"d163d40881e63ae97516212cada413376d8d7311fe9cae0f177763faf43f2207"} Jun 14 14:39:57.275547 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275526 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"c370e9d2dcf316c069d89e2760c09bd8a6443be87e50a8046b0b976ebd5b3ba9"} Jun 14 14:39:57.275608 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275592 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"a829f930272e54508a3b608f51bedfe75c28daa5fa6bd0a07a8a454cc34ebd48"} Jun 14 14:39:57.275641 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"b389316c0c9e5240f16f3d8005a0ea7c4f4086a90d342a31b08bfd3f387fb9d7"} Jun 14 14:39:57.275684 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerDied","Data":"22388de981fd9cd267eedee79f889e7bcb4f7b8d1b56532cf93ca8eab1055e89"} Jun 14 14:39:57.275723 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.275708 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"cf1fe45a17fdaa6cdd33caf9c6190e0e817e635c6ae4a6b104d80c9523ba9b54"} Jun 14 14:39:57.277151 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.277130 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" event={"ID":"634f424a-4194-4ec3-be15-c831808b7701","Type":"ContainerStarted","Data":"4d67b09390fd30c3fa440a6ce532c925efac05b0f895573546d281bf25dbc215"} Jun 14 14:39:57.278281 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.278262 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x4wkv" event={"ID":"c0bed816-8b69-48a3-978b-16bc53bd7057","Type":"ContainerStarted","Data":"d59894c32eb8419db0e561de83102bc253213e1f23307a7597d00063e69fe6b1"} Jun 14 14:39:57.281834 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.281801 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" podStartSLOduration=21.281791502 podStartE2EDuration="21.281791502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:40.249824671 +0000 UTC m=+5.603202622" watchObservedRunningTime="2026-06-14 14:39:57.281791502 +0000 UTC m=+22.635169450" Jun 14 14:39:57.282146 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.282126 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fdrcg" podStartSLOduration=4.060079549 podStartE2EDuration="22.282121066s" totalImagesPullingTime="18.222041517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:57.281502762 +0000 UTC m=+22.634880701" watchObservedRunningTime="2026-06-14 14:39:57.282121066 +0000 UTC m=+22.635499014" Jun 14 14:39:57.295536 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.295506 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxgh4" podStartSLOduration=4.141431555 podStartE2EDuration="22.295495376s" totalImagesPullingTime="18.154063821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:57.295005646 +0000 UTC m=+22.648383595" watchObservedRunningTime="2026-06-14 14:39:57.295495376 +0000 UTC m=+22.648873324" Jun 14 14:39:57.311865 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.311825 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m4gn6" podStartSLOduration=4.081268056 podStartE2EDuration="22.31181382s" totalImagesPullingTime="18.230545764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:57.311806508 +0000 UTC m=+22.665184449" watchObservedRunningTime="2026-06-14 14:39:57.31181382 +0000 UTC m=+22.665191766" Jun 14 14:39:57.350881 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.350845 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z5k49" podStartSLOduration=3.862394915 podStartE2EDuration="22.350834906s" totalImagesPullingTime="18.488439991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:57.350824782 +0000 UTC m=+22.704202730" watchObservedRunningTime="2026-06-14 14:39:57.350834906 +0000 UTC m=+22.704212854" Jun 14 14:39:57.370887 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:57.370831 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x4wkv" podStartSLOduration=4.220827612 podStartE2EDuration="22.370821057s" totalImagesPullingTime="18.149993445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:57.370739149 +0000 UTC m=+22.724117168" watchObservedRunningTime="2026-06-14 14:39:57.370821057 +0000 UTC m=+22.724199006" Jun 14 14:39:58.173709 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:58.173433 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T14:39:57.242676718Z","UUID":"10b2161c-8d06-43c6-9e53-c30dafad948c","Handler":null,"Name":"","Endpoint":""} Jun 14 14:39:58.175198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:58.175170 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 14:39:58.175336 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:58.175212 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 14:39:58.282662 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:58.282622 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ftfgc" event={"ID":"46e14277-2301-4e1d-b52b-3b5e56cafa91","Type":"ContainerStarted","Data":"fd3ee470681b150c04d048edd4484fca11e648b3d86000085ee45af17c3fe688"} Jun 14 14:39:58.300083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:58.300033 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ftfgc" podStartSLOduration=5.074216698 podStartE2EDuration="23.300013137s" totalImagesPullingTime="18.225796439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:58.299283295 +0000 UTC m=+23.652661255" watchObservedRunningTime="2026-06-14 14:39:58.300013137 +0000 UTC m=+23.653391088" Jun 14 14:39:59.173219 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.173138 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:39:59.173219 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.173168 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:39:59.173410 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.173140 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:39:59.173410 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:59.173268 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:39:59.173410 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:59.173380 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:39:59.173518 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:39:59.173469 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:39:59.287107 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.287075 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" event={"ID":"2c9857c3-f246-4bed-933b-cca1b2821e8a","Type":"ContainerStarted","Data":"7ac01ba6f9cd04768d1d7812ff79428ba0d33c337d90c9df275759e0ccdaad28"} Jun 14 14:39:59.290482 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.290451 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:39:59.290920 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.290896 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"bd00662903d52146e6154b6a5b92fc6dc1db7654093b74e86556d40748f47a97"} Jun 14 14:39:59.303748 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:39:59.303709 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tzlvj" podStartSLOduration=4.248149642 podStartE2EDuration="24.303695853s" totalImagesPullingTime="20.055546211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:59.303403356 +0000 UTC m=+24.656781296" watchObservedRunningTime="2026-06-14 14:39:59.303695853 +0000 UTC m=+24.657073801" Jun 14 14:40:00.360541 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:00.360512 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:40:00.361346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:00.361326 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:40:01.172660 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.172633 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:01.172660 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.172653 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:01.172790 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:01.172716 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:40:01.172790 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:01.172774 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:40:01.172867 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.172812 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:01.172903 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:01.172869 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:40:01.297341 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.297195 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerStarted","Data":"d1b27224819b21233b01ece4def16f44b9c67835e30ec2248bfba8d8e8bee2c9"} Jun 14 14:40:01.301008 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.300992 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:40:01.301420 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.301395 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"d59a1912cb0780884dcdabffd4e30cd107b7f07c169fbdc3434340514315b199"} Jun 14 14:40:01.301530 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.301500 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:40:01.301872 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.301857 2549 scope.go:117] "RemoveContainer" containerID="22388de981fd9cd267eedee79f889e7bcb4f7b8d1b56532cf93ca8eab1055e89" Jun 14 14:40:01.302205 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:01.302183 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxgh4" Jun 14 14:40:02.305559 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.305526 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b605f07-528a-44b9-96c7-85214b00c9e0" containerID="d1b27224819b21233b01ece4def16f44b9c67835e30ec2248bfba8d8e8bee2c9" exitCode=0 Jun 14 14:40:02.306209 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.305626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerDied","Data":"d1b27224819b21233b01ece4def16f44b9c67835e30ec2248bfba8d8e8bee2c9"} Jun 14 14:40:02.310076 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.310053 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:40:02.310588 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.310544 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" event={"ID":"1799981e-244f-4549-8197-20784024ec11","Type":"ContainerStarted","Data":"a354322bc5e6b7cb9b258c78cf72b8224c2aadc19d995472268b9c371ce4401c"} Jun 14 14:40:02.310923 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.310902 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:40:02.311028 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.310978 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:40:02.311085 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.311034 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:40:02.327619 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.327597 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:40:02.327944 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.327923 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:40:02.352816 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:02.351473 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" podStartSLOduration=9.094104901 podStartE2EDuration="27.351456491s" totalImagesPullingTime="18.25735159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:02.349865214 +0000 UTC m=+27.703243163" watchObservedRunningTime="2026-06-14 14:40:02.351456491 +0000 UTC m=+27.704834443" Jun 14 14:40:03.131486 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.131336 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bn8n7"] Jun 14 14:40:03.131633 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.131620 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:03.131719 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:03.131702 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:40:03.134249 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.134229 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sz6xx"] Jun 14 14:40:03.134367 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.134346 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:03.134467 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:03.134449 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:40:03.142624 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.142600 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r4lfw"] Jun 14 14:40:03.142719 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.142699 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:03.142796 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:03.142780 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:40:03.314883 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.314852 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b605f07-528a-44b9-96c7-85214b00c9e0" containerID="1c3211a8a44247f634c6f86a3256d889e1e521a65aece03b32fd3cbd871fafcf" exitCode=0 Jun 14 14:40:03.315393 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:03.314933 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerDied","Data":"1c3211a8a44247f634c6f86a3256d889e1e521a65aece03b32fd3cbd871fafcf"} Jun 14 14:40:04.318466 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:04.318437 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b605f07-528a-44b9-96c7-85214b00c9e0" containerID="9b3acef713ba343f8d83f98aeb375a45fb36e48cc31524c94d983abd74f0dcd3" exitCode=0 Jun 14 14:40:04.319000 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:04.318520 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerDied","Data":"9b3acef713ba343f8d83f98aeb375a45fb36e48cc31524c94d983abd74f0dcd3"} Jun 14 14:40:05.173485 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:05.173464 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:05.173597 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:05.173543 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:40:05.173665 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:05.173592 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:05.173665 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:05.173624 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:05.173756 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:05.173735 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:40:05.173854 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:05.173836 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:40:07.173144 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:07.173110 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:07.173144 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:07.173126 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:07.173933 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:07.173111 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:07.173933 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:07.173233 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bn8n7" podUID="8227c27e-4435-4d9b-879b-18a9894d5412" Jun 14 14:40:07.173933 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:07.173341 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:40:07.173933 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:07.173434 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4lfw" podUID="2743a642-0c17-44e6-89e4-6742c52f0afd" Jun 14 14:40:08.874304 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.874276 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:08.874685 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.874396 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:40:08.874685 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.874448 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret podName:2743a642-0c17-44e6-89e4-6742c52f0afd nodeName:}" failed. No retries permitted until 2026-06-14 14:40:40.874433999 +0000 UTC m=+66.227811927 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret") pod "global-pull-secret-syncer-r4lfw" (UID: "2743a642-0c17-44e6-89e4-6742c52f0afd") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:40:08.890725 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.890706 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeReady" Jun 14 14:40:08.890834 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.890825 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 14:40:08.931715 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.931689 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-64t25"] Jun 14 14:40:08.957694 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.957541 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-98gb7"] Jun 14 14:40:08.957788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.957645 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64t25" Jun 14 14:40:08.960352 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.960335 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 14:40:08.960418 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.960368 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 14:40:08.960599 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.960587 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwvk2\"" Jun 14 14:40:08.975446 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.975421 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:08.975577 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.975489 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:08.975648 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.975622 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:40:08.975648 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.975629 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:40:08.975745 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.975654 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:40:08.975745 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.975668 2549 projected.go:196] Error preparing data for projected volume kube-api-access-s5xz6 for pod openshift-network-diagnostics/network-check-target-bn8n7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:40:08.975745 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.975677 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:40:40.975663465 +0000 UTC m=+66.329041393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:40:08.975745 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:08.975714 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6 podName:8227c27e-4435-4d9b-879b-18a9894d5412 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:40.975700056 +0000 UTC m=+66.329078001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5xz6" (UniqueName: "kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6") pod "network-check-target-bn8n7" (UID: "8227c27e-4435-4d9b-879b-18a9894d5412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:40:08.977416 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.977397 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64t25"] Jun 14 14:40:08.977504 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.977440 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98gb7"] Jun 14 14:40:08.977555 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.977516 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:08.980029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.980013 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 14:40:08.980243 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.980227 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 14:40:08.980294 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.980227 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4f8bs\"" Jun 14 14:40:08.980294 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:08.980266 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 14:40:09.076638 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.076604 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.076780 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.076666 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqflt\" (UniqueName: \"kubernetes.io/projected/abe1cd8c-a676-4724-a1eb-af13b2846734-kube-api-access-pqflt\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.076780 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.076703 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/abe1cd8c-a676-4724-a1eb-af13b2846734-config-volume\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.076780 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.076729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe1cd8c-a676-4724-a1eb-af13b2846734-tmp-dir\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.076780 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.076766 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc5sd\" (UniqueName: \"kubernetes.io/projected/73e20078-7202-4805-9a8e-206563bcf94f-kube-api-access-nc5sd\") pod \"ingress-canary-98gb7\" (UID: \"73e20078-7202-4805-9a8e-206563bcf94f\") " pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.076949 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.076823 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73e20078-7202-4805-9a8e-206563bcf94f-cert\") pod \"ingress-canary-98gb7\" (UID: \"73e20078-7202-4805-9a8e-206563bcf94f\") " pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.172619 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.172592 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:09.172733 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.172699 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:09.172786 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.172592 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:09.176220 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.176191 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:40:09.177090 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.176440 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pmmn\"" Jun 14 14:40:09.177090 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.176487 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:40:09.177090 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.176530 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:40:09.177090 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.176808 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8smd\"" Jun 14 14:40:09.177442 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177097 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:40:09.177442 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177332 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.177581 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177535 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqflt\" (UniqueName: \"kubernetes.io/projected/abe1cd8c-a676-4724-a1eb-af13b2846734-kube-api-access-pqflt\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.177689 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:09.177527 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:09.177762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177642 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/abe1cd8c-a676-4724-a1eb-af13b2846734-config-volume\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.177762 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:09.177745 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:09.677702803 +0000 UTC m=+35.031080730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:09.177869 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177793 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe1cd8c-a676-4724-a1eb-af13b2846734-tmp-dir\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.177869 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177850 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc5sd\" (UniqueName: \"kubernetes.io/projected/73e20078-7202-4805-9a8e-206563bcf94f-kube-api-access-nc5sd\") pod \"ingress-canary-98gb7\" (UID: \"73e20078-7202-4805-9a8e-206563bcf94f\") " pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.177997 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.177900 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73e20078-7202-4805-9a8e-206563bcf94f-cert\") pod \"ingress-canary-98gb7\" (UID: \"73e20078-7202-4805-9a8e-206563bcf94f\") " pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.178455 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.178431 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abe1cd8c-a676-4724-a1eb-af13b2846734-tmp-dir\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.178746 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.178725 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/abe1cd8c-a676-4724-a1eb-af13b2846734-config-volume\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.182740 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.182718 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73e20078-7202-4805-9a8e-206563bcf94f-cert\") pod \"ingress-canary-98gb7\" (UID: \"73e20078-7202-4805-9a8e-206563bcf94f\") " pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.185825 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.185807 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqflt\" (UniqueName: \"kubernetes.io/projected/abe1cd8c-a676-4724-a1eb-af13b2846734-kube-api-access-pqflt\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.186239 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.186219 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc5sd\" (UniqueName: \"kubernetes.io/projected/73e20078-7202-4805-9a8e-206563bcf94f-kube-api-access-nc5sd\") pod \"ingress-canary-98gb7\" (UID: \"73e20078-7202-4805-9a8e-206563bcf94f\") " pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.297960 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.297903 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98gb7" Jun 14 14:40:09.333481 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.333454 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b605f07-528a-44b9-96c7-85214b00c9e0" containerID="fea40b96ba73967da2232e361bc1ba54ac5ec481523866f901c9f581aab034d7" exitCode=0 Jun 14 14:40:09.333594 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.333496 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerDied","Data":"fea40b96ba73967da2232e361bc1ba54ac5ec481523866f901c9f581aab034d7"} Jun 14 14:40:09.502574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.502497 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98gb7"] Jun 14 14:40:09.506723 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:40:09.506700 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e20078_7202_4805_9a8e_206563bcf94f.slice/crio-1b6414f3d0a4be7e1100ea0790dad7e7698b18ec7e4e13c3563541c9a26d776a WatchSource:0}: Error finding container 1b6414f3d0a4be7e1100ea0790dad7e7698b18ec7e4e13c3563541c9a26d776a: Status 404 returned error can't find the container with id 1b6414f3d0a4be7e1100ea0790dad7e7698b18ec7e4e13c3563541c9a26d776a Jun 14 14:40:09.681972 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:09.681900 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:09.682101 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:09.682016 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:09.682101 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:09.682067 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:10.682052996 +0000 UTC m=+36.035430927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:10.339832 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:10.339800 2549 generic.go:356] "Generic (PLEG): container finished" podID="2b605f07-528a-44b9-96c7-85214b00c9e0" containerID="976e038751a805a314b38d8e53538109d4d5fdcf02eb088b19bbc7339b809308" exitCode=0 Jun 14 14:40:10.340318 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:10.339882 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerDied","Data":"976e038751a805a314b38d8e53538109d4d5fdcf02eb088b19bbc7339b809308"} Jun 14 14:40:10.341275 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:10.341094 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98gb7" event={"ID":"73e20078-7202-4805-9a8e-206563bcf94f","Type":"ContainerStarted","Data":"1b6414f3d0a4be7e1100ea0790dad7e7698b18ec7e4e13c3563541c9a26d776a"} Jun 14 14:40:10.691922 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:10.691725 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:10.692105 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:10.691891 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:10.692105 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:10.692021 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:12.692001249 +0000 UTC m=+38.045379195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:11.347093 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:11.347052 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" event={"ID":"2b605f07-528a-44b9-96c7-85214b00c9e0","Type":"ContainerStarted","Data":"773eef3783b97f1afb6db0b9040c5cebdfddb0287107e16cf4be18373c5b359c"} Jun 14 14:40:11.369351 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:11.369307 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dfqhx" podStartSLOduration=8.502712459 podStartE2EDuration="36.369290307s" totalImagesPullingTime="27.866577848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:11.367918216 +0000 UTC m=+36.721296175" watchObservedRunningTime="2026-06-14 14:40:11.369290307 +0000 UTC m=+36.722668257" Jun 14 14:40:12.350703 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:12.350671 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98gb7" event={"ID":"73e20078-7202-4805-9a8e-206563bcf94f","Type":"ContainerStarted","Data":"4902468b999cac94427ed66e8ecdcc18ec74bc34f5a22f9df913b5014b835191"} Jun 14 14:40:12.365231 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:12.365184 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-98gb7" podStartSLOduration=2.401557275 podStartE2EDuration="4.365167802s" totalImagesPullingTime="1.963610527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:12.364156236 +0000 UTC m=+37.717534186" watchObservedRunningTime="2026-06-14 14:40:12.365167802 +0000 UTC m=+37.718545770" Jun 14 14:40:12.706579 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:12.706529 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:12.706693 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:12.706659 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:12.706741 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:12.706717 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:16.706702716 +0000 UTC m=+42.060080659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:16.733616 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:16.733576 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:16.734054 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:16.733674 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:16.734054 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:16.733736 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:24.733720501 +0000 UTC m=+50.087098442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:24.784055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:24.784011 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:24.784520 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:24.784136 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:24.784520 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:24.784209 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:40.78419522 +0000 UTC m=+66.137573151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:34.330158 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:34.330131 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpt5m" Jun 14 14:40:40.788854 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.788823 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:40:40.789219 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:40.788923 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:40.789219 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:40.788995 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:41:12.788980091 +0000 UTC m=+98.142358019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:40:40.889975 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.889946 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:40.892861 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.892844 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:40:40.903862 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.903841 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2743a642-0c17-44e6-89e4-6742c52f0afd-original-pull-secret\") pod \"global-pull-secret-syncer-r4lfw\" (UID: \"2743a642-0c17-44e6-89e4-6742c52f0afd\") " pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:40.990607 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.990582 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:40.990707 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.990650 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:40:40.993641 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.993623 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:40:40.993748 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.993730 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:40:40.998710 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:40.998695 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4lfw" Jun 14 14:40:41.001819 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:41.001803 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:40:41.001887 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:40:41.001874 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:41:45.001854394 +0000 UTC m=+130.355232338 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : secret "metrics-daemon-secret" not found Jun 14 14:40:41.003859 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.003845 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:40:41.014335 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.014307 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xz6\" (UniqueName: \"kubernetes.io/projected/8227c27e-4435-4d9b-879b-18a9894d5412-kube-api-access-s5xz6\") pod \"network-check-target-bn8n7\" (UID: \"8227c27e-4435-4d9b-879b-18a9894d5412\") " pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:41.143853 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.143826 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r4lfw"] Jun 14 14:40:41.147095 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:40:41.147072 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2743a642_0c17_44e6_89e4_6742c52f0afd.slice/crio-0d0609d1344997d4b5b3544453b0f1acdb298a4bdeafb0289a9d4cead1092886 WatchSource:0}: Error finding container 0d0609d1344997d4b5b3544453b0f1acdb298a4bdeafb0289a9d4cead1092886: Status 404 returned error can't find the container with id 0d0609d1344997d4b5b3544453b0f1acdb298a4bdeafb0289a9d4cead1092886 Jun 14 14:40:41.297165 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.297142 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8smd\"" Jun 14 14:40:41.304267 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.304244 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:41.415639 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.415605 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r4lfw" event={"ID":"2743a642-0c17-44e6-89e4-6742c52f0afd","Type":"ContainerStarted","Data":"0d0609d1344997d4b5b3544453b0f1acdb298a4bdeafb0289a9d4cead1092886"} Jun 14 14:40:41.439148 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:41.439124 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bn8n7"] Jun 14 14:40:41.441980 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:40:41.441949 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8227c27e_4435_4d9b_879b_18a9894d5412.slice/crio-94765300005f4cf2f393c2f0f49cda50e3cf2ca6fd1bfc51bab6465ed10cf7c5 WatchSource:0}: Error finding container 94765300005f4cf2f393c2f0f49cda50e3cf2ca6fd1bfc51bab6465ed10cf7c5: Status 404 returned error can't find the container with id 94765300005f4cf2f393c2f0f49cda50e3cf2ca6fd1bfc51bab6465ed10cf7c5 Jun 14 14:40:42.420663 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:42.420628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bn8n7" event={"ID":"8227c27e-4435-4d9b-879b-18a9894d5412","Type":"ContainerStarted","Data":"94765300005f4cf2f393c2f0f49cda50e3cf2ca6fd1bfc51bab6465ed10cf7c5"} Jun 14 14:40:46.432106 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:46.432070 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r4lfw" event={"ID":"2743a642-0c17-44e6-89e4-6742c52f0afd","Type":"ContainerStarted","Data":"ceb593718d281fd5c3dafda7084cca07c1ad0b6cfa3a4b4b8e0ded9b11b94575"} Jun 14 14:40:46.433412 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:46.433386 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bn8n7" event={"ID":"8227c27e-4435-4d9b-879b-18a9894d5412","Type":"ContainerStarted","Data":"f3cf083a3e5f3ad537bc60312553106326a03eb00b4231c000e845d004c07d09"} Jun 14 14:40:46.433543 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:46.433525 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:40:46.446210 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:46.446168 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r4lfw" podStartSLOduration=66.95914923 podStartE2EDuration="1m11.446157062s" totalImagesPullingTime="4.487007832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:46.445316236 +0000 UTC m=+71.798694186" watchObservedRunningTime="2026-06-14 14:40:46.446157062 +0000 UTC m=+71.799535020" Jun 14 14:40:46.458867 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:46.458832 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bn8n7" podStartSLOduration=67.270325508 podStartE2EDuration="1m11.458821876s" totalImagesPullingTime="4.188496368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:46.4584095 +0000 UTC m=+71.811787450" watchObservedRunningTime="2026-06-14 14:40:46.458821876 +0000 UTC m=+71.812199859" Jun 14 14:40:54.571102 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.571002 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd"] Jun 14 14:40:54.572838 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.572823 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.575258 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.575237 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 14:40:54.575376 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.575272 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 14:40:54.576242 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.576225 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 14:40:54.576306 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.576228 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 14:40:54.580724 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.579699 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9"] Jun 14 14:40:54.583725 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.583705 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.585136 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.585101 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd"] Jun 14 14:40:54.586721 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.586685 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 14:40:54.586823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.586785 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 14:40:54.586910 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.586888 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 14:40:54.587001 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.586988 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 14:40:54.590555 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.590534 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9"] Jun 14 14:40:54.681979 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.681955 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdcaa630-537e-437b-b29f-5d51d974924a-tmp\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.682065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.681984 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-hub\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.682065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682002 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-ca\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.682065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682018 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6zh\" (UniqueName: \"kubernetes.io/projected/bdcaa630-537e-437b-b29f-5d51d974924a-kube-api-access-fj6zh\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.682065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682041 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.682065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682062 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlq2\" (UniqueName: \"kubernetes.io/projected/c53d7f48-2d33-42af-89a9-53895ef23f85-kube-api-access-9qlq2\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.682241 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682080 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdcaa630-537e-437b-b29f-5d51d974924a-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.682241 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682099 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c53d7f48-2d33-42af-89a9-53895ef23f85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.682241 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.682162 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.782599 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782558 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.782677 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782610 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdcaa630-537e-437b-b29f-5d51d974924a-tmp\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.782677 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782629 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-hub\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.782677 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782644 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-ca\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.782828 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782693 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6zh\" (UniqueName: \"kubernetes.io/projected/bdcaa630-537e-437b-b29f-5d51d974924a-kube-api-access-fj6zh\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.782874 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782842 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.782922 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlq2\" (UniqueName: \"kubernetes.io/projected/c53d7f48-2d33-42af-89a9-53895ef23f85-kube-api-access-9qlq2\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.782922 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782907 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdcaa630-537e-437b-b29f-5d51d974924a-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.783029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.782997 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdcaa630-537e-437b-b29f-5d51d974924a-tmp\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.783166 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.783138 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c53d7f48-2d33-42af-89a9-53895ef23f85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.783879 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.783854 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c53d7f48-2d33-42af-89a9-53895ef23f85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.785159 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.785129 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-ca\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.785252 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.785229 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.785312 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.785293 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-hub\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.785781 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.785760 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdcaa630-537e-437b-b29f-5d51d974924a-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.785847 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.785767 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c53d7f48-2d33-42af-89a9-53895ef23f85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.790197 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.790176 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6zh\" (UniqueName: \"kubernetes.io/projected/bdcaa630-537e-437b-b29f-5d51d974924a-kube-api-access-fj6zh\") pod \"klusterlet-addon-workmgr-56c7dfcc9b-6ndkd\" (UID: \"bdcaa630-537e-437b-b29f-5d51d974924a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.790268 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.790249 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlq2\" (UniqueName: \"kubernetes.io/projected/c53d7f48-2d33-42af-89a9-53895ef23f85-kube-api-access-9qlq2\") pod \"cluster-proxy-proxy-agent-68bfb964cd-svqz9\" (UID: \"c53d7f48-2d33-42af-89a9-53895ef23f85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:54.884321 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.884272 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:40:54.901017 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:54.900998 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:40:55.007277 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:55.007250 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd"] Jun 14 14:40:55.009961 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:40:55.009935 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcaa630_537e_437b_b29f_5d51d974924a.slice/crio-06bfe2f95f75ef848e8aabfc46dcf36b35b0e59fb1912f1488328e06ce2a4f6c WatchSource:0}: Error finding container 06bfe2f95f75ef848e8aabfc46dcf36b35b0e59fb1912f1488328e06ce2a4f6c: Status 404 returned error can't find the container with id 06bfe2f95f75ef848e8aabfc46dcf36b35b0e59fb1912f1488328e06ce2a4f6c Jun 14 14:40:55.022536 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:55.022514 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9"] Jun 14 14:40:55.025364 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:40:55.025340 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc53d7f48_2d33_42af_89a9_53895ef23f85.slice/crio-c946784da88f22478263d2a8265d07048807464292f62231682e7df4727942fa WatchSource:0}: Error finding container c946784da88f22478263d2a8265d07048807464292f62231682e7df4727942fa: Status 404 returned error can't find the container with id c946784da88f22478263d2a8265d07048807464292f62231682e7df4727942fa Jun 14 14:40:55.455626 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:55.455594 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" event={"ID":"c53d7f48-2d33-42af-89a9-53895ef23f85","Type":"ContainerStarted","Data":"c946784da88f22478263d2a8265d07048807464292f62231682e7df4727942fa"} Jun 14 14:40:55.456609 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:40:55.456558 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" event={"ID":"bdcaa630-537e-437b-b29f-5d51d974924a","Type":"ContainerStarted","Data":"06bfe2f95f75ef848e8aabfc46dcf36b35b0e59fb1912f1488328e06ce2a4f6c"} Jun 14 14:41:01.476088 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.476050 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" event={"ID":"bdcaa630-537e-437b-b29f-5d51d974924a","Type":"ContainerStarted","Data":"1d00dd781faff6e82f4d2b11f83eda0209f6b4632a4c4c6bdea8bb273947b50c"} Jun 14 14:41:01.476593 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.476237 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:41:01.477813 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.477795 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:41:01.478182 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.478166 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" event={"ID":"c53d7f48-2d33-42af-89a9-53895ef23f85","Type":"ContainerStarted","Data":"4163bdbfb1dfab2ce298ed572f06c16479588b35250f7ac580ee0bcd048ed76f"} Jun 14 14:41:01.478255 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.478190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" event={"ID":"c53d7f48-2d33-42af-89a9-53895ef23f85","Type":"ContainerStarted","Data":"6f8586cd0b69ded06929ce381ccd5a079efcd54ef21244c14b217ccc7f1f8f46"} Jun 14 14:41:01.478255 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.478202 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" event={"ID":"c53d7f48-2d33-42af-89a9-53895ef23f85","Type":"ContainerStarted","Data":"c2a7354639bd49ea8d8f1f1bfd730b195db3382002e8bb9e72a94dab1b08faea"} Jun 14 14:41:01.492714 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.492667 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" podStartSLOduration=1.9028519560000001 podStartE2EDuration="7.492632s" totalImagesPullingTime="5.589780044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:41:01.491064133 +0000 UTC m=+86.844442075" watchObservedRunningTime="2026-06-14 14:41:01.492632 +0000 UTC m=+86.846009955" Jun 14 14:41:01.508439 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:01.508399 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" podStartSLOduration=1.9360867499999999 podStartE2EDuration="7.508387311s" totalImagesPullingTime="5.572300561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:41:01.507801494 +0000 UTC m=+86.861179445" watchObservedRunningTime="2026-06-14 14:41:01.508387311 +0000 UTC m=+86.861765259" Jun 14 14:41:12.813119 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:12.813073 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:41:12.813468 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:41:12.813216 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:41:12.813468 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:41:12.813310 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:42:16.813295792 +0000 UTC m=+162.166673723 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:41:17.438451 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:17.438421 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bn8n7" Jun 14 14:41:45.035066 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:41:45.034722 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:41:45.035066 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:41:45.034801 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:41:45.035066 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:41:45.034902 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs podName:3810f95e-5de0-45a5-b079-0d507102215c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:47.034880905 +0000 UTC m=+252.388258848 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs") pod "network-metrics-daemon-sz6xx" (UID: "3810f95e-5de0-45a5-b079-0d507102215c") : secret "metrics-daemon-secret" not found Jun 14 14:42:11.994441 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:42:11.994394 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-64t25" podUID="abe1cd8c-a676-4724-a1eb-af13b2846734" Jun 14 14:42:12.203235 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:42:12.203190 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sz6xx" podUID="3810f95e-5de0-45a5-b079-0d507102215c" Jun 14 14:42:12.682849 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:42:12.682820 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64t25" Jun 14 14:42:16.852661 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:42:16.852611 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:42:16.853049 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:42:16.852732 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:42:16.853049 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:42:16.852795 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls podName:abe1cd8c-a676-4724-a1eb-af13b2846734 nodeName:}" failed. No retries permitted until 2026-06-14 14:44:18.852782134 +0000 UTC m=+284.206160062 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls") pod "dns-default-64t25" (UID: "abe1cd8c-a676-4724-a1eb-af13b2846734") : secret "dns-default-metrics-tls" not found Jun 14 14:42:26.172149 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:42:26.172064 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:43:00.819797 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:00.819764 2549 generic.go:356] "Generic (PLEG): container finished" podID="bdcaa630-537e-437b-b29f-5d51d974924a" containerID="1d00dd781faff6e82f4d2b11f83eda0209f6b4632a4c4c6bdea8bb273947b50c" exitCode=1 Jun 14 14:43:00.820161 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:00.819825 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" event={"ID":"bdcaa630-537e-437b-b29f-5d51d974924a","Type":"ContainerDied","Data":"1d00dd781faff6e82f4d2b11f83eda0209f6b4632a4c4c6bdea8bb273947b50c"} Jun 14 14:43:00.820161 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:00.820148 2549 scope.go:117] "RemoveContainer" containerID="1d00dd781faff6e82f4d2b11f83eda0209f6b4632a4c4c6bdea8bb273947b50c" Jun 14 14:43:01.476710 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:01.476672 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:43:01.824316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:01.824242 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" event={"ID":"bdcaa630-537e-437b-b29f-5d51d974924a","Type":"ContainerStarted","Data":"e7abdc97a0b972e5042c8db15ba9fc53879af6e180c806e630f367d76ad28dc0"} Jun 14 14:43:01.824675 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:01.824530 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:43:01.825088 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:01.825072 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7dfcc9b-6ndkd" Jun 14 14:43:09.777385 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.777354 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zb2sq"] Jun 14 14:43:09.779440 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.779425 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:09.781970 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.781946 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 14:43:09.782929 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.782899 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 14:43:09.782929 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.782909 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 14:43:09.783088 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.782961 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 14:43:09.783088 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.782976 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wt54v\"" Jun 14 14:43:09.796135 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.796116 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zb2sq"] Jun 14 14:43:09.912153 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.912127 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd1bf943-4a06-40a1-9644-ce39a7e403df-crio-socket\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:09.912281 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.912177 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd1bf943-4a06-40a1-9644-ce39a7e403df-data-volume\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:09.912281 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.912201 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:09.912281 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.912231 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:09.912379 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:09.912293 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77wbt\" (UniqueName: \"kubernetes.io/projected/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-api-access-77wbt\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013233 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013206 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd1bf943-4a06-40a1-9644-ce39a7e403df-crio-socket\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd1bf943-4a06-40a1-9644-ce39a7e403df-data-volume\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013278 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013294 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013315 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77wbt\" (UniqueName: \"kubernetes.io/projected/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-api-access-77wbt\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013317 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dd1bf943-4a06-40a1-9644-ce39a7e403df-crio-socket\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.013507 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.013381 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:10.013507 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.013406 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.013507 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.013463 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:10.513444709 +0000 UTC m=+215.866822636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : configmap "kube-rbac-proxy" not found Jun 14 14:43:10.013507 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.013481 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:10.513472681 +0000 UTC m=+215.866850611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.013675 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.013541 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd1bf943-4a06-40a1-9644-ce39a7e403df-data-volume\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.021182 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.021163 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77wbt\" (UniqueName: \"kubernetes.io/projected/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-api-access-77wbt\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.518014 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.517972 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.518014 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:10.518014 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:10.518235 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.518094 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:10.518235 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.518115 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.518235 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.518166 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.518143621 +0000 UTC m=+216.871521548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : configmap "kube-rbac-proxy" not found Jun 14 14:43:10.518235 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:10.518181 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.518174647 +0000 UTC m=+216.871552574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:11.524736 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:11.524696 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:11.524736 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:11.524738 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:11.525143 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:11.524819 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:11.525143 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:11.524843 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:11.525143 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:11.524901 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:13.524885115 +0000 UTC m=+218.878263061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : configmap "kube-rbac-proxy" not found Jun 14 14:43:11.525143 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:11.524918 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:13.524910349 +0000 UTC m=+218.878288275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:12.760215 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:12.760190 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x4wkv_c0bed816-8b69-48a3-978b-16bc53bd7057/dns-node-resolver/0.log" Jun 14 14:43:13.536741 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:13.536694 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:13.536741 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:13.536744 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:13.536959 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:13.536830 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:13.536959 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:13.536852 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:13.536959 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:13.536896 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:17.536879732 +0000 UTC m=+222.890257679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : configmap "kube-rbac-proxy" not found Jun 14 14:43:13.536959 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:13.536912 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:17.536905556 +0000 UTC m=+222.890283483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:13.560094 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:13.560071 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fdrcg_ff456538-2dff-49c6-ba8c-2165bfb34524/node-ca/0.log" Jun 14 14:43:14.161792 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:14.161766 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98gb7_73e20078-7202-4805-9a8e-206563bcf94f/serve-healthcheck-canary/0.log" Jun 14 14:43:17.568068 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:17.568034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:17.568068 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:17.568067 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:17.568445 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:17.568156 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:17.568445 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:17.568204 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:17.568445 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:17.568217 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:25.568201606 +0000 UTC m=+230.921579537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : configmap "kube-rbac-proxy" not found Jun 14 14:43:17.568445 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:17.568242 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls podName:dd1bf943-4a06-40a1-9644-ce39a7e403df nodeName:}" failed. No retries permitted until 2026-06-14 14:43:25.568230992 +0000 UTC m=+230.921608920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb2sq" (UID: "dd1bf943-4a06-40a1-9644-ce39a7e403df") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:25.620683 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.620650 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:25.620683 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.620684 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:25.621442 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.621406 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dd1bf943-4a06-40a1-9644-ce39a7e403df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:25.623117 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.623094 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dd1bf943-4a06-40a1-9644-ce39a7e403df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb2sq\" (UID: \"dd1bf943-4a06-40a1-9644-ce39a7e403df\") " pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:25.688810 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.688782 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zb2sq" Jun 14 14:43:25.810324 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.810289 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zb2sq"] Jun 14 14:43:25.813432 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:43:25.813403 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1bf943_4a06_40a1_9644_ce39a7e403df.slice/crio-b191b4efbf9fc378196ae1222cae3a24746e57d2b9d583241a09a5e93436646c WatchSource:0}: Error finding container b191b4efbf9fc378196ae1222cae3a24746e57d2b9d583241a09a5e93436646c: Status 404 returned error can't find the container with id b191b4efbf9fc378196ae1222cae3a24746e57d2b9d583241a09a5e93436646c Jun 14 14:43:25.891650 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:25.891595 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb2sq" event={"ID":"dd1bf943-4a06-40a1-9644-ce39a7e403df","Type":"ContainerStarted","Data":"b191b4efbf9fc378196ae1222cae3a24746e57d2b9d583241a09a5e93436646c"} Jun 14 14:43:29.906045 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:29.906011 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb2sq" event={"ID":"dd1bf943-4a06-40a1-9644-ce39a7e403df","Type":"ContainerStarted","Data":"e3d9cea36b116da506ce5390bf73995c4bb1ed67327a27f793df42ab163a26c2"} Jun 14 14:43:30.912358 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:30.912321 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb2sq" event={"ID":"dd1bf943-4a06-40a1-9644-ce39a7e403df","Type":"ContainerStarted","Data":"45ef6562c87133707ff5131e1022d63506c5622de08b8fbc8b987d11ff119ba1"} Jun 14 14:43:32.921753 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:32.921712 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb2sq" event={"ID":"dd1bf943-4a06-40a1-9644-ce39a7e403df","Type":"ContainerStarted","Data":"2575328e5511018a0edaacf9eb4153862a67b0e4e6caa268c7a1aa168f58f558"} Jun 14 14:43:32.939743 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:32.939694 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zb2sq" podStartSLOduration=17.85110053 podStartE2EDuration="23.939677897s" totalImagesPullingTime="6.088577367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:43:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:32.93836416 +0000 UTC m=+238.291742170" watchObservedRunningTime="2026-06-14 14:43:32.939677897 +0000 UTC m=+238.293055846" Jun 14 14:43:43.998949 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:43.998914 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ffb9d8795-2h4j9"] Jun 14 14:43:44.005030 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.005011 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.007619 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.007589 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 14:43:44.007750 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.007590 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 14:43:44.007750 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.007692 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 14:43:44.007750 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.007731 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 14:43:44.007980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.007941 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 14:43:44.008867 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.008847 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qd8m9\"" Jun 14 14:43:44.008945 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.008898 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 14:43:44.008988 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.008948 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 14:43:44.011796 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.011775 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb9d8795-2h4j9"] Jun 14 14:43:44.148389 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.148366 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-oauth-config\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.148482 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.148392 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-service-ca\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.148482 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.148409 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-oauth-serving-cert\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.148482 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.148428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vmc\" (UniqueName: \"kubernetes.io/projected/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-kube-api-access-k4vmc\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.148617 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.148508 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-serving-cert\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.148617 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.148554 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-config\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249024 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.248964 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-serving-cert\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249024 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.248990 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-config\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249163 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249031 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-oauth-config\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249163 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249075 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-service-ca\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249163 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249099 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-oauth-serving-cert\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249163 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249124 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vmc\" (UniqueName: \"kubernetes.io/projected/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-kube-api-access-k4vmc\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249747 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249728 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-service-ca\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249845 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-config\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.249845 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.249800 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-oauth-serving-cert\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.251411 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.251396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-serving-cert\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.251487 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.251472 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-oauth-config\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.257427 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.257405 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vmc\" (UniqueName: \"kubernetes.io/projected/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-kube-api-access-k4vmc\") pod \"console-7ffb9d8795-2h4j9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.314419 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.314384 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:44.432868 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.432840 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb9d8795-2h4j9"] Jun 14 14:43:44.435799 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:43:44.435765 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe52710_2cb7_4c14_8e6d_bb16c5f8ecd9.slice/crio-b5ccc7dc089c5d7036e8d8f79251a390643a924cf12415085e798b1224972e2d WatchSource:0}: Error finding container b5ccc7dc089c5d7036e8d8f79251a390643a924cf12415085e798b1224972e2d: Status 404 returned error can't find the container with id b5ccc7dc089c5d7036e8d8f79251a390643a924cf12415085e798b1224972e2d Jun 14 14:43:44.902381 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.902338 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" podUID="c53d7f48-2d33-42af-89a9-53895ef23f85" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 14:43:44.959218 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:44.959179 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb9d8795-2h4j9" event={"ID":"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9","Type":"ContainerStarted","Data":"b5ccc7dc089c5d7036e8d8f79251a390643a924cf12415085e798b1224972e2d"} Jun 14 14:43:46.061603 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.061557 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k7c2q"] Jun 14 14:43:46.064648 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.064624 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.067186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.067163 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 14:43:46.067299 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.067264 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 14:43:46.067299 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.067288 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-glx62\"" Jun 14 14:43:46.068262 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.068058 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 14:43:46.068262 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.068103 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 14:43:46.068262 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.068118 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 14:43:46.068262 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.068123 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 14:43:46.164046 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164018 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkl7q\" (UniqueName: \"kubernetes.io/projected/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-kube-api-access-fkl7q\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164184 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-root\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164248 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164197 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-metrics-client-ca\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164248 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164229 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-textfile\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164345 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164297 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164345 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164327 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-tls\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164505 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164353 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164505 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164373 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-wtmp\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.164505 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.164460 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-sys\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265195 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265154 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-textfile\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265338 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265199 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265338 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265227 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-tls\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265338 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265253 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265492 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:46.265369 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 14:43:46.265492 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265371 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-wtmp\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265492 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265429 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-sys\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265492 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265477 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkl7q\" (UniqueName: \"kubernetes.io/projected/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-kube-api-access-fkl7q\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265521 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-root\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265554 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-textfile\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265584 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-metrics-client-ca\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265634 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-wtmp\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.265712 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:46.265647 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-tls podName:91a7b9b0-ee4f-47f0-9e20-122cca0472b0 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:46.765622723 +0000 UTC m=+252.119000658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-tls") pod "node-exporter-k7c2q" (UID: "91a7b9b0-ee4f-47f0-9e20-122cca0472b0") : secret "node-exporter-tls" not found Jun 14 14:43:46.265712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265704 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-root\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.266004 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.265700 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-sys\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.266199 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.266163 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-metrics-client-ca\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.266302 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.266277 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.268035 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.268010 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.276405 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.276387 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkl7q\" (UniqueName: \"kubernetes.io/projected/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-kube-api-access-fkl7q\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.769961 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.769922 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-tls\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.772549 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.772521 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91a7b9b0-ee4f-47f0-9e20-122cca0472b0-node-exporter-tls\") pod \"node-exporter-k7c2q\" (UID: \"91a7b9b0-ee4f-47f0-9e20-122cca0472b0\") " pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:46.975500 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:46.975468 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k7c2q" Jun 14 14:43:47.072465 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.072401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:43:47.074995 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.074968 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3810f95e-5de0-45a5-b079-0d507102215c-metrics-certs\") pod \"network-metrics-daemon-sz6xx\" (UID: \"3810f95e-5de0-45a5-b079-0d507102215c\") " pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:43:47.160816 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:43:47.160791 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a7b9b0_ee4f_47f0_9e20_122cca0472b0.slice/crio-80fe726500adb88a1543215bc670a4df7ae30e5a923b02bca579b3c142bac4e1 WatchSource:0}: Error finding container 80fe726500adb88a1543215bc670a4df7ae30e5a923b02bca579b3c142bac4e1: Status 404 returned error can't find the container with id 80fe726500adb88a1543215bc670a4df7ae30e5a923b02bca579b3c142bac4e1 Jun 14 14:43:47.174783 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.174764 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pmmn\"" Jun 14 14:43:47.182618 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.182600 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz6xx" Jun 14 14:43:47.338607 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.338513 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sz6xx"] Jun 14 14:43:47.341059 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:43:47.341032 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3810f95e_5de0_45a5_b079_0d507102215c.slice/crio-cad32af4f6b3e49232ed72e4d9dcf6a6d878f769c95042b82c567371136c1f2f WatchSource:0}: Error finding container cad32af4f6b3e49232ed72e4d9dcf6a6d878f769c95042b82c567371136c1f2f: Status 404 returned error can't find the container with id cad32af4f6b3e49232ed72e4d9dcf6a6d878f769c95042b82c567371136c1f2f Jun 14 14:43:47.970948 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.970873 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sz6xx" event={"ID":"3810f95e-5de0-45a5-b079-0d507102215c","Type":"ContainerStarted","Data":"cad32af4f6b3e49232ed72e4d9dcf6a6d878f769c95042b82c567371136c1f2f"} Jun 14 14:43:47.972778 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.972742 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb9d8795-2h4j9" event={"ID":"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9","Type":"ContainerStarted","Data":"8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea"} Jun 14 14:43:47.974656 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.974628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k7c2q" event={"ID":"91a7b9b0-ee4f-47f0-9e20-122cca0472b0","Type":"ContainerStarted","Data":"80fe726500adb88a1543215bc670a4df7ae30e5a923b02bca579b3c142bac4e1"} Jun 14 14:43:47.989842 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:47.989797 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ffb9d8795-2h4j9" podStartSLOduration=2.206604809 podStartE2EDuration="4.989782155s" totalImagesPullingTime="2.783177346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:47.988716742 +0000 UTC m=+253.342094690" watchObservedRunningTime="2026-06-14 14:43:47.989782155 +0000 UTC m=+253.343160106" Jun 14 14:43:48.984165 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:48.983556 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sz6xx" event={"ID":"3810f95e-5de0-45a5-b079-0d507102215c","Type":"ContainerStarted","Data":"58b7ff4892ce0a4f99ec6fa5147faf689b69ef470944690af64a492a3f624ed0"} Jun 14 14:43:48.987678 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:48.987539 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k7c2q" event={"ID":"91a7b9b0-ee4f-47f0-9e20-122cca0472b0","Type":"ContainerStarted","Data":"52065b02a4abd5f2fde16ca1374d489b9e9dffdfceac86ce797cabd4576f3dba"} Jun 14 14:43:49.991162 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:49.991127 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sz6xx" event={"ID":"3810f95e-5de0-45a5-b079-0d507102215c","Type":"ContainerStarted","Data":"6a6ac7eece24486670ed763f04c3d9af9182b1894986c146dca713554220945b"} Jun 14 14:43:49.992655 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:49.992631 2549 generic.go:356] "Generic (PLEG): container finished" podID="91a7b9b0-ee4f-47f0-9e20-122cca0472b0" containerID="52065b02a4abd5f2fde16ca1374d489b9e9dffdfceac86ce797cabd4576f3dba" exitCode=0 Jun 14 14:43:49.992783 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:49.992659 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k7c2q" event={"ID":"91a7b9b0-ee4f-47f0-9e20-122cca0472b0","Type":"ContainerDied","Data":"52065b02a4abd5f2fde16ca1374d489b9e9dffdfceac86ce797cabd4576f3dba"} Jun 14 14:43:50.006470 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.006435 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sz6xx" podStartSLOduration=253.547535701 podStartE2EDuration="4m15.00642375s" totalImagesPullingTime="1.458888049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:50.005462539 +0000 UTC m=+255.358840489" watchObservedRunningTime="2026-06-14 14:43:50.00642375 +0000 UTC m=+255.359801699" Jun 14 14:43:50.817977 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.817945 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-26kb6"] Jun 14 14:43:50.820899 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.820884 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:50.823233 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.823212 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 14:43:50.823353 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.823244 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fx9dh\"" Jun 14 14:43:50.828155 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.828132 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-26kb6"] Jun 14 14:43:50.894459 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.894435 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:50.894614 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.894490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5d9t\" (UniqueName: \"kubernetes.io/projected/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-kube-api-access-v5d9t\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:50.995246 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.995221 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:50.995672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.995274 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5d9t\" (UniqueName: \"kubernetes.io/projected/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-kube-api-access-v5d9t\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:50.995672 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:50.995379 2549 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 14 14:43:50.995672 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:43:50.995450 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-monitoring-plugin-cert podName:d7bb1d0e-9111-4550-8b09-d242a56aa0b4 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:51.495429547 +0000 UTC m=+256.848807485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-26kb6" (UID: "d7bb1d0e-9111-4550-8b09-d242a56aa0b4") : secret "monitoring-plugin-cert" not found Jun 14 14:43:50.998059 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.998033 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k7c2q" event={"ID":"91a7b9b0-ee4f-47f0-9e20-122cca0472b0","Type":"ContainerStarted","Data":"6cc8658f63347f6a6d76afa4d0ab4cb724a254f284e9f2caab8e0a7a4a70c840"} Jun 14 14:43:50.998059 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:50.998078 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k7c2q" event={"ID":"91a7b9b0-ee4f-47f0-9e20-122cca0472b0","Type":"ContainerStarted","Data":"8f6d083da4cb75e3d0ca8d6b342ca526375cedc8517361d613741fe6864428e0"} Jun 14 14:43:51.003683 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:51.003664 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5d9t\" (UniqueName: \"kubernetes.io/projected/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-kube-api-access-v5d9t\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:51.017155 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:51.017114 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k7c2q" podStartSLOduration=3.2747972770000002 podStartE2EDuration="5.017101232s" totalImagesPullingTime="1.636757517s" totalInitContainerRuntime="105.546438ms" isStatefulPod=true podCreationTimestamp="2026-06-14 14:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:51.016041323 +0000 UTC m=+256.369419272" watchObservedRunningTime="2026-06-14 14:43:51.017101232 +0000 UTC m=+256.370479181" Jun 14 14:43:51.497756 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:51.497724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:51.499981 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:51.499952 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7bb1d0e-9111-4550-8b09-d242a56aa0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-26kb6\" (UID: \"d7bb1d0e-9111-4550-8b09-d242a56aa0b4\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:51.729382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:51.729350 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:51.847831 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:51.847708 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-26kb6"] Jun 14 14:43:51.850198 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:43:51.850165 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bb1d0e_9111_4550_8b09_d242a56aa0b4.slice/crio-edc8a837c74fbfe1bd21c866af3692bf8e194d70144372708a78ba8a4a52110c WatchSource:0}: Error finding container edc8a837c74fbfe1bd21c866af3692bf8e194d70144372708a78ba8a4a52110c: Status 404 returned error can't find the container with id edc8a837c74fbfe1bd21c866af3692bf8e194d70144372708a78ba8a4a52110c Jun 14 14:43:52.002579 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.002528 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" event={"ID":"d7bb1d0e-9111-4550-8b09-d242a56aa0b4","Type":"ContainerStarted","Data":"edc8a837c74fbfe1bd21c866af3692bf8e194d70144372708a78ba8a4a52110c"} Jun 14 14:43:52.240515 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.240493 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:43:52.245045 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.245030 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.247630 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.247605 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 14:43:52.247751 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.247643 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 14:43:52.247822 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.247786 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-txzrf\"" Jun 14 14:43:52.247889 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.247827 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 14:43:52.247889 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.247857 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 14:43:52.248029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248015 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 14:43:52.248093 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248048 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 14:43:52.248648 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248629 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 14:43:52.248756 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248654 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 14:43:52.248756 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248660 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-epnbtp68l787b\"" Jun 14 14:43:52.248756 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248698 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 14:43:52.248954 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248873 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 14:43:52.248954 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248901 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 14:43:52.248954 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248941 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 14:43:52.249118 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.248946 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 14:43:52.249300 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.249281 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 14:43:52.250896 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.250879 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 14:43:52.259224 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.259203 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:43:52.303606 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303582 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303694 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303610 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303694 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303694 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303649 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303794 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303715 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303794 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303746 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303794 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303772 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303794 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303789 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303909 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303807 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303909 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303829 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303909 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303857 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303909 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303871 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.303909 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303894 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303916 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt7tj\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-kube-api-access-rt7tj\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303950 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.303965 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.304007 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.304042 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.304223 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.304065 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.404850 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.404827 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.404953 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.404857 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.404953 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.404873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.404953 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.404892 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.404953 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.404906 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405092 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405224 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405122 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405224 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405151 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405224 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405175 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405224 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405219 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405245 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405275 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405298 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt7tj\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-kube-api-access-rt7tj\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405333 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405366 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405389 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405417 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.405453 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405451 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.406005 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405474 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.406005 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.405533 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.406602 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.406276 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.406602 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.406286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.406602 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.406379 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.406832 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.406647 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.408351 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.408331 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.408534 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.408510 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.408648 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.408592 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.408752 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.408732 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.408816 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.408779 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.409168 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.409138 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.409420 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.409374 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.410184 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.410080 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.410184 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.410147 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.410803 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.410551 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.410803 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.410672 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.410803 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.410703 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.410803 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.410764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.411327 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.411308 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.413196 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.413177 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt7tj\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-kube-api-access-rt7tj\") pod \"prometheus-k8s-0\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.555705 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.555647 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:43:52.696188 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:52.696166 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:43:52.698778 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:43:52.698756 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2d7b52_5bfd_4b45_b608_94cac815e6ac.slice/crio-3aad2986f60de694303a86f1e444559c2b84e86dc2b122e759406d714f6c3912 WatchSource:0}: Error finding container 3aad2986f60de694303a86f1e444559c2b84e86dc2b122e759406d714f6c3912: Status 404 returned error can't find the container with id 3aad2986f60de694303a86f1e444559c2b84e86dc2b122e759406d714f6c3912 Jun 14 14:43:53.007502 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:53.007459 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"3aad2986f60de694303a86f1e444559c2b84e86dc2b122e759406d714f6c3912"} Jun 14 14:43:54.015816 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.015779 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd" exitCode=0 Jun 14 14:43:54.016250 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.015859 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd"} Jun 14 14:43:54.017399 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.017377 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" event={"ID":"d7bb1d0e-9111-4550-8b09-d242a56aa0b4","Type":"ContainerStarted","Data":"2b1efd37dca31d779e12fd2d9aecb4f63766300caf5ae705f004bba3fc8629e2"} Jun 14 14:43:54.017653 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.017583 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:54.022432 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.022413 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" Jun 14 14:43:54.062339 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.062299 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-26kb6" podStartSLOduration=2.307694322 podStartE2EDuration="4.062288774s" totalImagesPullingTime="1.754594452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:54.061497642 +0000 UTC m=+259.414875591" watchObservedRunningTime="2026-06-14 14:43:54.062288774 +0000 UTC m=+259.415666722" Jun 14 14:43:54.315007 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.314926 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:54.315253 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.315232 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:43:54.316311 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.316291 2549 patch_prober.go:28] interesting pod/console-7ffb9d8795-2h4j9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 14 14:43:54.316375 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.316331 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7ffb9d8795-2h4j9" podUID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 14 14:43:54.902117 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:54.902075 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" podUID="c53d7f48-2d33-42af-89a9-53895ef23f85" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 14:43:57.433405 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:57.433324 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffb9d8795-2h4j9"] Jun 14 14:43:58.034759 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:58.034727 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17"} Jun 14 14:43:58.034916 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:58.034794 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d"} Jun 14 14:43:59.041302 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:59.041275 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f"} Jun 14 14:43:59.041633 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:59.041336 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd"} Jun 14 14:43:59.041633 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:59.041364 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2"} Jun 14 14:43:59.041633 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:59.041388 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerStarted","Data":"602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c"} Jun 14 14:43:59.069083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:43:59.069038 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.596210463 podStartE2EDuration="7.069023769s" totalImagesPullingTime="5.453649291s" totalInitContainerRuntime="19.164015ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:59.066686199 +0000 UTC m=+264.420064169" watchObservedRunningTime="2026-06-14 14:43:59.069023769 +0000 UTC m=+264.422401718" Jun 14 14:44:02.556035 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:02.556002 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:44:04.902422 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:04.902379 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" podUID="c53d7f48-2d33-42af-89a9-53895ef23f85" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 14:44:04.902833 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:04.902472 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" Jun 14 14:44:04.902976 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:04.902934 2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4163bdbfb1dfab2ce298ed572f06c16479588b35250f7ac580ee0bcd048ed76f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 14 14:44:04.903014 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:04.902999 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" podUID="c53d7f48-2d33-42af-89a9-53895ef23f85" containerName="service-proxy" containerID="cri-o://4163bdbfb1dfab2ce298ed572f06c16479588b35250f7ac580ee0bcd048ed76f" gracePeriod=30 Jun 14 14:44:05.064082 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:05.064058 2549 generic.go:356] "Generic (PLEG): container finished" podID="c53d7f48-2d33-42af-89a9-53895ef23f85" containerID="4163bdbfb1dfab2ce298ed572f06c16479588b35250f7ac580ee0bcd048ed76f" exitCode=2 Jun 14 14:44:05.064177 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:05.064127 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" event={"ID":"c53d7f48-2d33-42af-89a9-53895ef23f85","Type":"ContainerDied","Data":"4163bdbfb1dfab2ce298ed572f06c16479588b35250f7ac580ee0bcd048ed76f"} Jun 14 14:44:06.069932 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:06.069902 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bfb964cd-svqz9" event={"ID":"c53d7f48-2d33-42af-89a9-53895ef23f85","Type":"ContainerStarted","Data":"484becededcda1ef356e1981f6c7f818de3641f48ad4abc4f67e47c6d6b9d1a4"} Jun 14 14:44:15.683671 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:44:15.683633 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-64t25" podUID="abe1cd8c-a676-4724-a1eb-af13b2846734" Jun 14 14:44:16.100734 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:16.100705 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64t25" Jun 14 14:44:18.893892 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:18.893855 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:44:18.896305 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:18.896277 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe1cd8c-a676-4724-a1eb-af13b2846734-metrics-tls\") pod \"dns-default-64t25\" (UID: \"abe1cd8c-a676-4724-a1eb-af13b2846734\") " pod="openshift-dns/dns-default-64t25" Jun 14 14:44:19.104243 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:19.104217 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwvk2\"" Jun 14 14:44:19.111947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:19.111926 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64t25" Jun 14 14:44:19.237620 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:19.237592 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64t25"] Jun 14 14:44:19.240574 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:44:19.240534 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe1cd8c_a676_4724_a1eb_af13b2846734.slice/crio-a74769537e2573e7cc15839a6e68c960f71ddbaaf3d46352772bd4d8a4c947ef WatchSource:0}: Error finding container a74769537e2573e7cc15839a6e68c960f71ddbaaf3d46352772bd4d8a4c947ef: Status 404 returned error can't find the container with id a74769537e2573e7cc15839a6e68c960f71ddbaaf3d46352772bd4d8a4c947ef Jun 14 14:44:20.120887 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:20.120833 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64t25" event={"ID":"abe1cd8c-a676-4724-a1eb-af13b2846734","Type":"ContainerStarted","Data":"a74769537e2573e7cc15839a6e68c960f71ddbaaf3d46352772bd4d8a4c947ef"} Jun 14 14:44:22.130040 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.130005 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64t25" event={"ID":"abe1cd8c-a676-4724-a1eb-af13b2846734","Type":"ContainerStarted","Data":"b3135db43a46f50c763689d6f96bed68a3d88f13ac125eac72bbfa10a7dbd2c3"} Jun 14 14:44:22.130483 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.130054 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64t25" event={"ID":"abe1cd8c-a676-4724-a1eb-af13b2846734","Type":"ContainerStarted","Data":"39910c7cd903b3772c4c21f676c17e19919aee8ad727b5efe0915c119f5640b8"} Jun 14 14:44:22.130483 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.130102 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-64t25" Jun 14 14:44:22.146683 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.146632 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-64t25" podStartSLOduration=252.292069157 podStartE2EDuration="4m14.146618801s" totalImagesPullingTime="1.854549644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:44:22.144972272 +0000 UTC m=+287.498350221" watchObservedRunningTime="2026-06-14 14:44:22.146618801 +0000 UTC m=+287.499996750" Jun 14 14:44:22.452465 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.452432 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ffb9d8795-2h4j9" podUID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" containerName="console" containerID="cri-o://8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea" gracePeriod=15 Jun 14 14:44:22.690723 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.690700 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:44:22.721869 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.721811 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-serving-cert\") pod \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " Jun 14 14:44:22.721869 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.721857 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-oauth-config\") pod \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " Jun 14 14:44:22.722046 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.721921 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4vmc\" (UniqueName: \"kubernetes.io/projected/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-kube-api-access-k4vmc\") pod \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " Jun 14 14:44:22.722046 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.721966 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-config\") pod \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " Jun 14 14:44:22.722046 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.721990 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-oauth-serving-cert\") pod \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " Jun 14 14:44:22.722046 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.722022 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-service-ca\") pod \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\" (UID: \"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9\") " Jun 14 14:44:22.722449 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.722366 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-config" (OuterVolumeSpecName: "console-config") pod "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" (UID: "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:22.722545 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.722510 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" (UID: "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:22.722545 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.722531 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-service-ca" (OuterVolumeSpecName: "service-ca") pod "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" (UID: "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:22.724276 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.724253 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" (UID: "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:44:22.724345 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.724287 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" (UID: "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:44:22.724389 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.724373 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-kube-api-access-k4vmc" (OuterVolumeSpecName: "kube-api-access-k4vmc") pod "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" (UID: "afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9"). InnerVolumeSpecName "kube-api-access-k4vmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:44:22.822887 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.822856 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4vmc\" (UniqueName: \"kubernetes.io/projected/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-kube-api-access-k4vmc\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:44:22.822887 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.822882 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:44:22.822887 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.822891 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-oauth-serving-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:44:22.823071 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.822900 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-service-ca\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:44:22.823071 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.822908 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-serving-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:44:22.823071 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:22.822916 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9-console-oauth-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:44:23.134360 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.134275 2549 generic.go:356] "Generic (PLEG): container finished" podID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" containerID="8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea" exitCode=0 Jun 14 14:44:23.134360 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.134324 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb9d8795-2h4j9" Jun 14 14:44:23.134879 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.134366 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb9d8795-2h4j9" event={"ID":"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9","Type":"ContainerDied","Data":"8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea"} Jun 14 14:44:23.134879 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.134427 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb9d8795-2h4j9" event={"ID":"afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9","Type":"ContainerDied","Data":"b5ccc7dc089c5d7036e8d8f79251a390643a924cf12415085e798b1224972e2d"} Jun 14 14:44:23.134879 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.134473 2549 scope.go:117] "RemoveContainer" containerID="8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea" Jun 14 14:44:23.143728 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.143691 2549 scope.go:117] "RemoveContainer" containerID="8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea" Jun 14 14:44:23.143957 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:44:23.143938 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea\": container with ID starting with 8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea not found: ID does not exist" containerID="8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea" Jun 14 14:44:23.143996 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.143965 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea"} err="failed to get container status \"8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea\": rpc error: code = NotFound desc = could not find container \"8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea\": container with ID starting with 8ea946caa73f2d844920daaf0f5a4e964f3d79f57800ce581fafec5abfbb48ea not found: ID does not exist" Jun 14 14:44:23.154015 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.153991 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffb9d8795-2h4j9"] Jun 14 14:44:23.156999 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.156981 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ffb9d8795-2h4j9"] Jun 14 14:44:23.176936 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:23.176905 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" path="/var/lib/kubelet/pods/afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9/volumes" Jun 14 14:44:32.137045 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:32.137016 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-64t25" Jun 14 14:44:35.120902 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:35.120874 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:44:35.121255 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:35.121013 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:44:35.127163 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:35.127140 2549 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 14:44:40.973763 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:40.973723 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fdrcg_ff456538-2dff-49c6-ba8c-2165bfb34524/node-ca/0.log" Jun 14 14:44:41.573021 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:41.572994 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98gb7_73e20078-7202-4805-9a8e-206563bcf94f/serve-healthcheck-canary/0.log" Jun 14 14:44:52.556510 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:52.556465 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:44:52.577118 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:52.577088 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:44:53.252337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:44:53.252312 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:10.613195 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613160 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:45:10.613757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613460 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="prometheus" containerID="cri-o://ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d" gracePeriod=600 Jun 14 14:45:10.613757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613492 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="config-reloader" containerID="cri-o://465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17" gracePeriod=600 Jun 14 14:45:10.613757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613494 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-web" containerID="cri-o://115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2" gracePeriod=600 Jun 14 14:45:10.613757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613537 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-thanos" containerID="cri-o://04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f" gracePeriod=600 Jun 14 14:45:10.613757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613492 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="thanos-sidecar" containerID="cri-o://602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c" gracePeriod=600 Jun 14 14:45:10.613757 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:10.613496 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy" containerID="cri-o://9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd" gracePeriod=600 Jun 14 14:45:11.301203 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301175 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f" exitCode=0 Jun 14 14:45:11.301203 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301196 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd" exitCode=0 Jun 14 14:45:11.301203 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301203 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c" exitCode=0 Jun 14 14:45:11.301203 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301209 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17" exitCode=0 Jun 14 14:45:11.301203 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301215 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d" exitCode=0 Jun 14 14:45:11.301494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301255 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f"} Jun 14 14:45:11.301494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301314 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd"} Jun 14 14:45:11.301494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301342 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c"} Jun 14 14:45:11.301494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301368 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17"} Jun 14 14:45:11.301494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.301392 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d"} Jun 14 14:45:11.850278 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.850256 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:11.965169 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965149 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-metrics-client-certs\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965179 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-0\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965207 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-kubelet-serving-ca-bundle\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965224 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-tls\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965241 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-grpc-tls\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965268 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965297 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-serving-certs-ca-bundle\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965315 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-1\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965335 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965364 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-tls-assets\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965388 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-trusted-ca-bundle\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965416 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-web-config\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965440 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965483 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-db\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965514 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-2\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965551 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-thanos-prometheus-http-client-file\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965602 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt7tj\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-kube-api-access-rt7tj\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965631 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-metrics-client-ca\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965652 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config-out\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965646 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.965762 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965698 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-kube-rbac-proxy\") pod \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\" (UID: \"5c2d7b52-5bfd-4b45-b608-94cac815e6ac\") " Jun 14 14:45:11.966415 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.965926 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:11.966476 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.966428 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.966794 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.966765 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.966966 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.966941 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.967040 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.966982 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.967398 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.967369 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.968685 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.968661 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:45:11.969027 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.968987 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:11.969027 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.969010 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.969186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.969081 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.969186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.969113 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config-out" (OuterVolumeSpecName: "config-out") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:45:11.969374 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.969347 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-kube-api-access-rt7tj" (OuterVolumeSpecName: "kube-api-access-rt7tj") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "kube-api-access-rt7tj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:45:11.969446 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.969388 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.969644 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.969616 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config" (OuterVolumeSpecName: "config") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.970776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.970738 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.970908 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.970887 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:45:11.970997 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.970977 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.971048 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.971017 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.971048 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.971034 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:11.980494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:11.980473 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-web-config" (OuterVolumeSpecName: "web-config") pod "5c2d7b52-5bfd-4b45-b608-94cac815e6ac" (UID: "5c2d7b52-5bfd-4b45-b608-94cac815e6ac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:12.066668 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066651 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config-out\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066668 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066669 2549 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-kube-rbac-proxy\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066677 2549 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-metrics-client-certs\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066686 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066705 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066714 2549 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-grpc-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066723 2549 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066731 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066739 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066747 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066757 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-tls-assets\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066765 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066773 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-web-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066781 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.066788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066789 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-db\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.067143 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066797 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.067143 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066806 2549 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.067143 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066815 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt7tj\" (UniqueName: \"kubernetes.io/projected/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-kube-api-access-rt7tj\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.067143 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.066824 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2d7b52-5bfd-4b45-b608-94cac815e6ac-configmap-metrics-client-ca\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:45:12.307442 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.307364 2549 generic.go:356] "Generic (PLEG): container finished" podID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerID="115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2" exitCode=0 Jun 14 14:45:12.307590 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.307444 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.307590 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.307444 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2"} Jun 14 14:45:12.307590 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.307527 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c2d7b52-5bfd-4b45-b608-94cac815e6ac","Type":"ContainerDied","Data":"3aad2986f60de694303a86f1e444559c2b84e86dc2b122e759406d714f6c3912"} Jun 14 14:45:12.307749 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.307608 2549 scope.go:117] "RemoveContainer" containerID="04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f" Jun 14 14:45:12.316216 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.316199 2549 scope.go:117] "RemoveContainer" containerID="9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd" Jun 14 14:45:12.323989 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.323974 2549 scope.go:117] "RemoveContainer" containerID="115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2" Jun 14 14:45:12.331019 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.330987 2549 scope.go:117] "RemoveContainer" containerID="602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c" Jun 14 14:45:12.331184 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.331169 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:45:12.337832 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.337807 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:45:12.337897 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.337878 2549 scope.go:117] "RemoveContainer" containerID="465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17" Jun 14 14:45:12.343936 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.343919 2549 scope.go:117] "RemoveContainer" containerID="ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d" Jun 14 14:45:12.350322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.350307 2549 scope.go:117] "RemoveContainer" containerID="3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd" Jun 14 14:45:12.356431 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.356416 2549 scope.go:117] "RemoveContainer" containerID="04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f" Jun 14 14:45:12.356674 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.356658 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f\": container with ID starting with 04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f not found: ID does not exist" containerID="04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f" Jun 14 14:45:12.356723 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.356681 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f"} err="failed to get container status \"04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f\": rpc error: code = NotFound desc = could not find container \"04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f\": container with ID starting with 04f1d7f405368d62ec9e628d9d76a8cacba52fed08ba452e303020c6bce3198f not found: ID does not exist" Jun 14 14:45:12.356723 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.356698 2549 scope.go:117] "RemoveContainer" containerID="9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd" Jun 14 14:45:12.356887 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.356873 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd\": container with ID starting with 9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd not found: ID does not exist" containerID="9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd" Jun 14 14:45:12.356933 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.356891 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd"} err="failed to get container status \"9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd\": rpc error: code = NotFound desc = could not find container \"9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd\": container with ID starting with 9c646b50101e17a55fcabe891b1716fd6f1878f5d49c5a6c4e820d79054b56cd not found: ID does not exist" Jun 14 14:45:12.356933 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.356903 2549 scope.go:117] "RemoveContainer" containerID="115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2" Jun 14 14:45:12.357126 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.357109 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2\": container with ID starting with 115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2 not found: ID does not exist" containerID="115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2" Jun 14 14:45:12.357175 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.357132 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2"} err="failed to get container status \"115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2\": rpc error: code = NotFound desc = could not find container \"115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2\": container with ID starting with 115fff9f8a5277cc2bebde2048b066b4650aaa422e64f6d38804afdfdd39d7e2 not found: ID does not exist" Jun 14 14:45:12.357175 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.357159 2549 scope.go:117] "RemoveContainer" containerID="602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c" Jun 14 14:45:12.357351 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.357336 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c\": container with ID starting with 602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c not found: ID does not exist" containerID="602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c" Jun 14 14:45:12.357389 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.357354 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c"} err="failed to get container status \"602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c\": rpc error: code = NotFound desc = could not find container \"602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c\": container with ID starting with 602cd20e6a93801798b0aff8e60ecf28cd6aa27826479f81a190bada54857b4c not found: ID does not exist" Jun 14 14:45:12.357389 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.357366 2549 scope.go:117] "RemoveContainer" containerID="465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17" Jun 14 14:45:12.357753 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.357730 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17\": container with ID starting with 465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17 not found: ID does not exist" containerID="465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17" Jun 14 14:45:12.357805 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.357760 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17"} err="failed to get container status \"465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17\": rpc error: code = NotFound desc = could not find container \"465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17\": container with ID starting with 465bff74522fd649ed2e07868e028a5313f79826631e662b04a0ad51ccbfef17 not found: ID does not exist" Jun 14 14:45:12.357805 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.357778 2549 scope.go:117] "RemoveContainer" containerID="ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d" Jun 14 14:45:12.358023 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.358008 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d\": container with ID starting with ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d not found: ID does not exist" containerID="ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d" Jun 14 14:45:12.358062 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.358026 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d"} err="failed to get container status \"ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d\": rpc error: code = NotFound desc = could not find container \"ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d\": container with ID starting with ec74d08c622d6c7e4f53bc3fa20ba8d480ba71824919e47954d63ebd5dee351d not found: ID does not exist" Jun 14 14:45:12.358062 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.358046 2549 scope.go:117] "RemoveContainer" containerID="3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd" Jun 14 14:45:12.358296 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:45:12.358259 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd\": container with ID starting with 3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd not found: ID does not exist" containerID="3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd" Jun 14 14:45:12.358296 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.358287 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd"} err="failed to get container status \"3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd\": rpc error: code = NotFound desc = could not find container \"3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd\": container with ID starting with 3f74b177070c18c4cef3d9a1347c006898843027ddeb90e83bad8f77c9957cdd not found: ID does not exist" Jun 14 14:45:12.360163 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360145 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:45:12.360348 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360337 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="prometheus" Jun 14 14:45:12.360388 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360349 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="prometheus" Jun 14 14:45:12.360388 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360363 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="init-config-reloader" Jun 14 14:45:12.360388 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360369 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="init-config-reloader" Jun 14 14:45:12.360388 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360376 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-web" Jun 14 14:45:12.360388 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360382 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-web" Jun 14 14:45:12.360388 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360387 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360393 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360401 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="config-reloader" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360407 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="config-reloader" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360412 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-thanos" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360417 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-thanos" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360428 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" containerName="console" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360432 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" containerName="console" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360438 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="thanos-sidecar" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360443 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="thanos-sidecar" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360478 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360486 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe52710-2cb7-4c14-8e6d-bb16c5f8ecd9" containerName="console" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360491 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="thanos-sidecar" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360497 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="prometheus" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360502 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="config-reloader" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360507 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-thanos" Jun 14 14:45:12.360574 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.360512 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" containerName="kube-rbac-proxy-web" Jun 14 14:45:12.365464 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.365450 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.368069 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.368050 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 14:45:12.368152 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.368078 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 14:45:12.368261 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.368239 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 14:45:12.368400 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.368320 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 14:45:12.369106 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.369086 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 14:45:12.369106 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.369100 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 14:45:12.370049 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.370028 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 14:45:12.370488 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.370472 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 14:45:12.370550 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.370513 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-txzrf\"" Jun 14 14:45:12.371855 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.371283 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 14:45:12.372454 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.372435 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 14:45:12.373158 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.372792 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-epnbtp68l787b\"" Jun 14 14:45:12.373158 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.372936 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 14:45:12.373967 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.373466 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 14:45:12.373967 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.373791 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 14:45:12.376454 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.376436 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 14:45:12.378591 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.378557 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 14:45:12.384605 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.384582 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:45:12.469653 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469628 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-config\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469741 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469658 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wx5s\" (UniqueName: \"kubernetes.io/projected/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-kube-api-access-9wx5s\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469741 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469681 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469741 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469695 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469906 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469745 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469906 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469906 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469844 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469906 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469862 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469906 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469880 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-web-config\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.469906 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469904 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469937 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469954 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469978 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.469997 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-config-out\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.470011 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.470046 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.470062 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.470081 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470351 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.470105 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.470351 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.470133 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570447 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570395 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570447 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570422 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570447 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570440 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570589 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570462 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-config-out\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570589 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570504 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570589 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570530 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570589 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570552 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570599 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570626 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570651 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570691 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-config\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570720 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wx5s\" (UniqueName: \"kubernetes.io/projected/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-kube-api-access-9wx5s\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.570776 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570760 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570784 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570815 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570850 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570854 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570892 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570946 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-web-config\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.570968 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571430 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.571360 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.571489 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.571459 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.572144 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.572118 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.573302 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.573270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-config-out\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.573426 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.573406 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.573483 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.573465 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.573766 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.573735 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.573854 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.573831 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.573923 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.573832 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.574749 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.574719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.574965 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.574943 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.575044 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.574976 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.575292 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.575276 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.575384 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.575363 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.575957 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.575938 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-web-config\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.576035 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.576011 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-config\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.576210 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.576186 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.576892 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.576878 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.580957 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.580938 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wx5s\" (UniqueName: \"kubernetes.io/projected/da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df-kube-api-access-9wx5s\") pod \"prometheus-k8s-0\" (UID: \"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.678055 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.678033 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:45:12.807092 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:12.807062 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:45:12.810167 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:45:12.810143 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2ca0ae_e6c0_40c5_b9c5_2dee5408f3df.slice/crio-d00af89ee9fa0304c8e03f5b6997934c53eebb5850e8293c302bee7b55bd94cb WatchSource:0}: Error finding container d00af89ee9fa0304c8e03f5b6997934c53eebb5850e8293c302bee7b55bd94cb: Status 404 returned error can't find the container with id d00af89ee9fa0304c8e03f5b6997934c53eebb5850e8293c302bee7b55bd94cb Jun 14 14:45:13.176322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:13.176250 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c2d7b52-5bfd-4b45-b608-94cac815e6ac" path="/var/lib/kubelet/pods/5c2d7b52-5bfd-4b45-b608-94cac815e6ac/volumes" Jun 14 14:45:13.312011 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:13.311979 2549 generic.go:356] "Generic (PLEG): container finished" podID="da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df" containerID="0b412965669180088f4d17246d301a8289e5bd1f7ea1199b426850cd1e02ee6b" exitCode=0 Jun 14 14:45:13.312153 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:13.312067 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerDied","Data":"0b412965669180088f4d17246d301a8289e5bd1f7ea1199b426850cd1e02ee6b"} Jun 14 14:45:13.312153 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:13.312142 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"d00af89ee9fa0304c8e03f5b6997934c53eebb5850e8293c302bee7b55bd94cb"} Jun 14 14:45:14.320131 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.320098 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"d9d8d2e0daa7b4eda70d6198ed3fd31459b7d0b0d415f73d9291e1b2622a0058"} Jun 14 14:45:14.320584 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.320184 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"a132bf3bb1dccc45c3507b3e8f871bf1fba3e9cbbc88186aff209ce592394b54"} Jun 14 14:45:14.320584 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.320215 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"837a5c3c48360879390035cefea6832723d2e42c67493b4a6a769d04f2309ef9"} Jun 14 14:45:14.320584 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.320241 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"fe8ea8a1d1c379c1898e98c5e79418789b7e04a4432f7b5ae24260fa7710efb7"} Jun 14 14:45:14.320584 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.320263 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"9a4eb3dec11ce5d8ca19cb0a91629efc093d56ab105c24ab091ee3681ffbc9bb"} Jun 14 14:45:14.320584 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.320286 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df","Type":"ContainerStarted","Data":"2b76c7826951d6220a78abc729b8866f93367a21afbd0cfdede651d8fb682d9d"} Jun 14 14:45:14.348800 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:14.348754 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.331520497 podStartE2EDuration="2.348739025s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.218528ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:45:14.346773217 +0000 UTC m=+339.700151200" watchObservedRunningTime="2026-06-14 14:45:14.348739025 +0000 UTC m=+339.702116988" Jun 14 14:45:17.679013 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:45:17.678976 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:46:12.678519 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:46:12.678489 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:46:12.693320 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:46:12.693297 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:46:13.529877 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:46:13.529850 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:47:06.503041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.502968 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg"] Jun 14 14:47:06.506052 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.506037 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.509119 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.509099 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 14:47:06.509479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.509462 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 14:47:06.509597 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.509577 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 14:47:06.509667 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.509613 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f6x9g\"" Jun 14 14:47:06.509781 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.509765 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 14:47:06.526029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.526007 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg"] Jun 14 14:47:06.626000 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.625972 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3389792d-3aef-4dbd-a780-5844e31e4510-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.626000 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.626003 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3389792d-3aef-4dbd-a780-5844e31e4510-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.626230 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.626027 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3389792d-3aef-4dbd-a780-5844e31e4510-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.626230 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.626082 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8vx\" (UniqueName: \"kubernetes.io/projected/3389792d-3aef-4dbd-a780-5844e31e4510-kube-api-access-tx8vx\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.626230 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.626126 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3389792d-3aef-4dbd-a780-5844e31e4510-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.727191 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.727167 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8vx\" (UniqueName: \"kubernetes.io/projected/3389792d-3aef-4dbd-a780-5844e31e4510-kube-api-access-tx8vx\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.727328 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.727194 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3389792d-3aef-4dbd-a780-5844e31e4510-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.727328 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.727233 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3389792d-3aef-4dbd-a780-5844e31e4510-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.727445 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.727340 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3389792d-3aef-4dbd-a780-5844e31e4510-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.727445 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.727375 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3389792d-3aef-4dbd-a780-5844e31e4510-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.727656 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.727636 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3389792d-3aef-4dbd-a780-5844e31e4510-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.729557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.729539 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3389792d-3aef-4dbd-a780-5844e31e4510-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.729657 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.729641 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3389792d-3aef-4dbd-a780-5844e31e4510-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.729712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.729687 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3389792d-3aef-4dbd-a780-5844e31e4510-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.734930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.734907 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8vx\" (UniqueName: \"kubernetes.io/projected/3389792d-3aef-4dbd-a780-5844e31e4510-kube-api-access-tx8vx\") pod \"opendatahub-operator-controller-manager-bc868665f-k5lxg\" (UID: \"3389792d-3aef-4dbd-a780-5844e31e4510\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.815497 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.815446 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:06.949300 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.949271 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg"] Jun 14 14:47:06.952251 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:47:06.952225 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3389792d_3aef_4dbd_a780_5844e31e4510.slice/crio-ca6b8a8d7a8e96fa161440c6e9dfed919de58d0efa59cde2b5b986c644493235 WatchSource:0}: Error finding container ca6b8a8d7a8e96fa161440c6e9dfed919de58d0efa59cde2b5b986c644493235: Status 404 returned error can't find the container with id ca6b8a8d7a8e96fa161440c6e9dfed919de58d0efa59cde2b5b986c644493235 Jun 14 14:47:06.954209 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:06.954189 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:47:07.707075 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:07.707035 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" event={"ID":"3389792d-3aef-4dbd-a780-5844e31e4510","Type":"ContainerStarted","Data":"ca6b8a8d7a8e96fa161440c6e9dfed919de58d0efa59cde2b5b986c644493235"} Jun 14 14:47:10.719865 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:10.719833 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" event={"ID":"3389792d-3aef-4dbd-a780-5844e31e4510","Type":"ContainerStarted","Data":"9ac153fb1b5b3050c891c16ee37ded2506a58f306f08cc4b46a0a5ce81ff99db"} Jun 14 14:47:11.724675 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:11.724641 2549 generic.go:356] "Generic (PLEG): container finished" podID="3389792d-3aef-4dbd-a780-5844e31e4510" containerID="9ac153fb1b5b3050c891c16ee37ded2506a58f306f08cc4b46a0a5ce81ff99db" exitCode=0 Jun 14 14:47:11.725117 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:11.724682 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" event={"ID":"3389792d-3aef-4dbd-a780-5844e31e4510","Type":"ContainerDied","Data":"9ac153fb1b5b3050c891c16ee37ded2506a58f306f08cc4b46a0a5ce81ff99db"} Jun 14 14:47:12.730047 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:12.730013 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" event={"ID":"3389792d-3aef-4dbd-a780-5844e31e4510","Type":"ContainerStarted","Data":"70d7664290b7a58662ffcee333c94f3fcbef0046d838c287e7df710d6d836f0e"} Jun 14 14:47:12.730447 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:12.730135 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:12.751527 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:12.751486 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" podStartSLOduration=2.673355917 podStartE2EDuration="6.751472899s" totalImagesPullingTime="3.082516032s" totalInitContainerRuntime="995.60095ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:12.749841502 +0000 UTC m=+458.103219450" watchObservedRunningTime="2026-06-14 14:47:12.751472899 +0000 UTC m=+458.104850846" Jun 14 14:47:23.735802 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:23.735774 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-k5lxg" Jun 14 14:47:26.236002 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.235965 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz"] Jun 14 14:47:26.239025 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.239008 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.244350 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.244327 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 14:47:26.244474 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.244419 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 14:47:26.244546 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.244480 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xp662\"" Jun 14 14:47:26.244546 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.244340 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 14:47:26.244546 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.244337 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:47:26.244686 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.244615 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 14:47:26.261600 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.261574 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz"] Jun 14 14:47:26.368349 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.368324 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96kcg\" (UniqueName: \"kubernetes.io/projected/ccff0502-25f6-456a-8a61-087223a4bb92-kube-api-access-96kcg\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.368349 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.368357 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccff0502-25f6-456a-8a61-087223a4bb92-cert\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.368526 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.368376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccff0502-25f6-456a-8a61-087223a4bb92-manager-config\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.368526 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.368421 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccff0502-25f6-456a-8a61-087223a4bb92-metrics-cert\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.469216 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.469181 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96kcg\" (UniqueName: \"kubernetes.io/projected/ccff0502-25f6-456a-8a61-087223a4bb92-kube-api-access-96kcg\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.469216 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.469216 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccff0502-25f6-456a-8a61-087223a4bb92-cert\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.469416 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.469234 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccff0502-25f6-456a-8a61-087223a4bb92-manager-config\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.469416 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.469345 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccff0502-25f6-456a-8a61-087223a4bb92-metrics-cert\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.470043 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.470021 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccff0502-25f6-456a-8a61-087223a4bb92-manager-config\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.471704 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.471688 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccff0502-25f6-456a-8a61-087223a4bb92-metrics-cert\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.471845 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.471826 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccff0502-25f6-456a-8a61-087223a4bb92-cert\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.477315 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.477292 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96kcg\" (UniqueName: \"kubernetes.io/projected/ccff0502-25f6-456a-8a61-087223a4bb92-kube-api-access-96kcg\") pod \"lws-controller-manager-58654d7f68-sb2nz\" (UID: \"ccff0502-25f6-456a-8a61-087223a4bb92\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.547664 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.547611 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:26.672958 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.672932 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz"] Jun 14 14:47:26.675098 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:47:26.675070 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccff0502_25f6_456a_8a61_087223a4bb92.slice/crio-2c15a316037712b6c4f617cf9a5dcce910ee31b8bd1c75064bd562c7b946f2dc WatchSource:0}: Error finding container 2c15a316037712b6c4f617cf9a5dcce910ee31b8bd1c75064bd562c7b946f2dc: Status 404 returned error can't find the container with id 2c15a316037712b6c4f617cf9a5dcce910ee31b8bd1c75064bd562c7b946f2dc Jun 14 14:47:26.780295 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:26.780243 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" event={"ID":"ccff0502-25f6-456a-8a61-087223a4bb92","Type":"ContainerStarted","Data":"2c15a316037712b6c4f617cf9a5dcce910ee31b8bd1c75064bd562c7b946f2dc"} Jun 14 14:47:29.793689 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:29.793658 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" event={"ID":"ccff0502-25f6-456a-8a61-087223a4bb92","Type":"ContainerStarted","Data":"802eb78ef4ba0e51f142f5487815e7fd9dd4a0ba01d48e5d45dd9d9616685a5c"} Jun 14 14:47:29.794057 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:29.793774 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:29.811578 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:29.811524 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" podStartSLOduration=1.449013991 podStartE2EDuration="3.811509653s" totalImagesPullingTime="2.362495662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:29.810678307 +0000 UTC m=+475.164056259" watchObservedRunningTime="2026-06-14 14:47:29.811509653 +0000 UTC m=+475.164887600" Jun 14 14:47:40.799955 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:40.799921 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-sb2nz" Jun 14 14:47:42.541398 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.541370 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-678bbb5d45-69rrh"] Jun 14 14:47:42.546352 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.546327 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.549172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.549151 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xg5x7\"" Jun 14 14:47:42.549286 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.549268 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 14:47:42.562836 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.562813 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-678bbb5d45-69rrh"] Jun 14 14:47:42.684624 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.684601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8090df82-996c-46bf-9520-086ecc57621f-redirect-config\") pod \"dashboard-redirect-678bbb5d45-69rrh\" (UID: \"8090df82-996c-46bf-9520-086ecc57621f\") " pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.684781 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.684643 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjfg\" (UniqueName: \"kubernetes.io/projected/8090df82-996c-46bf-9520-086ecc57621f-kube-api-access-vfjfg\") pod \"dashboard-redirect-678bbb5d45-69rrh\" (UID: \"8090df82-996c-46bf-9520-086ecc57621f\") " pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.785889 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.785862 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8090df82-996c-46bf-9520-086ecc57621f-redirect-config\") pod \"dashboard-redirect-678bbb5d45-69rrh\" (UID: \"8090df82-996c-46bf-9520-086ecc57621f\") " pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.785995 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.785899 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjfg\" (UniqueName: \"kubernetes.io/projected/8090df82-996c-46bf-9520-086ecc57621f-kube-api-access-vfjfg\") pod \"dashboard-redirect-678bbb5d45-69rrh\" (UID: \"8090df82-996c-46bf-9520-086ecc57621f\") " pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.786521 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.786502 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8090df82-996c-46bf-9520-086ecc57621f-redirect-config\") pod \"dashboard-redirect-678bbb5d45-69rrh\" (UID: \"8090df82-996c-46bf-9520-086ecc57621f\") " pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.794466 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.794401 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjfg\" (UniqueName: \"kubernetes.io/projected/8090df82-996c-46bf-9520-086ecc57621f-kube-api-access-vfjfg\") pod \"dashboard-redirect-678bbb5d45-69rrh\" (UID: \"8090df82-996c-46bf-9520-086ecc57621f\") " pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.856232 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.856214 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" Jun 14 14:47:42.974815 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:42.974787 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-678bbb5d45-69rrh"] Jun 14 14:47:42.977408 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:47:42.977385 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8090df82_996c_46bf_9520_086ecc57621f.slice/crio-9ea489f2ae22ac8ef915c20160f7f83ac5917ae1ed10edfcdb4d565c07c62ef7 WatchSource:0}: Error finding container 9ea489f2ae22ac8ef915c20160f7f83ac5917ae1ed10edfcdb4d565c07c62ef7: Status 404 returned error can't find the container with id 9ea489f2ae22ac8ef915c20160f7f83ac5917ae1ed10edfcdb4d565c07c62ef7 Jun 14 14:47:43.845599 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:43.845541 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" event={"ID":"8090df82-996c-46bf-9520-086ecc57621f","Type":"ContainerStarted","Data":"9ea489f2ae22ac8ef915c20160f7f83ac5917ae1ed10edfcdb4d565c07c62ef7"} Jun 14 14:47:45.854436 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:45.854397 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" event={"ID":"8090df82-996c-46bf-9520-086ecc57621f","Type":"ContainerStarted","Data":"e627d710e170bb7b8cc71ca0e79e0479551c4bde2fecd994fa67df86bf9d7cd0"} Jun 14 14:47:45.871255 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:45.871204 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-678bbb5d45-69rrh" podStartSLOduration=2.054668426 podStartE2EDuration="3.87119048s" totalImagesPullingTime="1.816522054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:45.870667816 +0000 UTC m=+491.224045766" watchObservedRunningTime="2026-06-14 14:47:45.87119048 +0000 UTC m=+491.224568429" Jun 14 14:47:59.597790 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.597754 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z"] Jun 14 14:47:59.603976 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.603959 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.606803 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.606780 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 14:47:59.606928 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.606829 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 14:47:59.606928 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.606872 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pgq2r\"" Jun 14 14:47:59.606928 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.606901 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 14:47:59.614976 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.614957 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z"] Jun 14 14:47:59.705809 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705778 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpr2g\" (UniqueName: \"kubernetes.io/projected/49d52f6b-9b99-472a-96e1-b7b57a20eefd-kube-api-access-bpr2g\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.705930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705822 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.705930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.705930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705894 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.705930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705918 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.706097 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705935 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.706097 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705952 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.706097 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705967 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.706097 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.705988 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806401 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806373 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpr2g\" (UniqueName: \"kubernetes.io/projected/49d52f6b-9b99-472a-96e1-b7b57a20eefd-kube-api-access-bpr2g\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806523 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806423 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806523 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806452 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806523 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806481 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806523 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806516 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806545 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806592 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806619 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.806823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806649 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.807031 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.806932 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.807086 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.807054 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.807139 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.807100 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.807198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.807143 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.807338 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.807319 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.809295 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.809269 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.809429 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.809413 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.814452 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.814431 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49d52f6b-9b99-472a-96e1-b7b57a20eefd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.814694 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.814676 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpr2g\" (UniqueName: \"kubernetes.io/projected/49d52f6b-9b99-472a-96e1-b7b57a20eefd-kube-api-access-bpr2g\") pod \"data-science-gateway-data-science-gateway-class-74759f9795spn7z\" (UID: \"49d52f6b-9b99-472a-96e1-b7b57a20eefd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:47:59.913505 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:47:59.913437 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:48:00.041382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:00.041356 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z"] Jun 14 14:48:00.043506 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:48:00.043483 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d52f6b_9b99_472a_96e1_b7b57a20eefd.slice/crio-c31b3d145cc0f6695da26a44e5baf8a9cd55d8bc4af78abef1bf48ab87cddd6d WatchSource:0}: Error finding container c31b3d145cc0f6695da26a44e5baf8a9cd55d8bc4af78abef1bf48ab87cddd6d: Status 404 returned error can't find the container with id c31b3d145cc0f6695da26a44e5baf8a9cd55d8bc4af78abef1bf48ab87cddd6d Jun 14 14:48:00.912693 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:00.912659 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" event={"ID":"49d52f6b-9b99-472a-96e1-b7b57a20eefd","Type":"ContainerStarted","Data":"c31b3d145cc0f6695da26a44e5baf8a9cd55d8bc4af78abef1bf48ab87cddd6d"} Jun 14 14:48:04.139798 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:04.139760 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:48:04.140114 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:04.139852 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:48:04.140114 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:04.139882 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:48:04.935262 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:04.935224 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" event={"ID":"49d52f6b-9b99-472a-96e1-b7b57a20eefd","Type":"ContainerStarted","Data":"6256efe32458e260a45bc50c66b717a0861be37ce5c08c2ce5d3e30a37992dcd"} Jun 14 14:48:04.955759 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:04.955714 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" podStartSLOduration=1.86180605 podStartE2EDuration="5.955700822s" totalImagesPullingTime="4.093894772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:48:04.954515544 +0000 UTC m=+510.307893504" watchObservedRunningTime="2026-06-14 14:48:04.955700822 +0000 UTC m=+510.309078770" Jun 14 14:48:05.914493 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:05.914455 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:48:05.919013 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:05.918989 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:48:05.939477 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:05.939441 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:48:05.940119 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:05.940103 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795spn7z" Jun 14 14:48:26.609490 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.609458 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kb2nv"] Jun 14 14:48:26.612545 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.612530 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:26.615130 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.615109 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 14:48:26.616183 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.616163 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-shhrf\"" Jun 14 14:48:26.616299 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.616201 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 14:48:26.623823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.623315 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kb2nv"] Jun 14 14:48:26.726449 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.726420 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvfj\" (UniqueName: \"kubernetes.io/projected/622f5378-e3e2-4bdd-864d-e71b1441da23-kube-api-access-xmvfj\") pod \"kuadrant-operator-catalog-kb2nv\" (UID: \"622f5378-e3e2-4bdd-864d-e71b1441da23\") " pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:26.826966 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.826934 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvfj\" (UniqueName: \"kubernetes.io/projected/622f5378-e3e2-4bdd-864d-e71b1441da23-kube-api-access-xmvfj\") pod \"kuadrant-operator-catalog-kb2nv\" (UID: \"622f5378-e3e2-4bdd-864d-e71b1441da23\") " pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:26.838890 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.838861 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvfj\" (UniqueName: \"kubernetes.io/projected/622f5378-e3e2-4bdd-864d-e71b1441da23-kube-api-access-xmvfj\") pod \"kuadrant-operator-catalog-kb2nv\" (UID: \"622f5378-e3e2-4bdd-864d-e71b1441da23\") " pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:26.923597 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.923504 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:26.972719 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:26.972383 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kb2nv"] Jun 14 14:48:27.050211 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.050132 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kb2nv"] Jun 14 14:48:27.052998 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:48:27.052972 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622f5378_e3e2_4bdd_864d_e71b1441da23.slice/crio-ce633b563c9fe87d5f16ebc93830a7ab44f3a4b52a5070933072313693377e12 WatchSource:0}: Error finding container ce633b563c9fe87d5f16ebc93830a7ab44f3a4b52a5070933072313693377e12: Status 404 returned error can't find the container with id ce633b563c9fe87d5f16ebc93830a7ab44f3a4b52a5070933072313693377e12 Jun 14 14:48:27.181376 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.181305 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtkhh"] Jun 14 14:48:27.185232 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.185217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:27.190526 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.190505 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtkhh"] Jun 14 14:48:27.329868 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.329832 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xwg\" (UniqueName: \"kubernetes.io/projected/88f6231e-fe8f-4f83-992c-64c2449f9626-kube-api-access-n9xwg\") pod \"kuadrant-operator-catalog-xtkhh\" (UID: \"88f6231e-fe8f-4f83-992c-64c2449f9626\") " pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:27.430553 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.430520 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xwg\" (UniqueName: \"kubernetes.io/projected/88f6231e-fe8f-4f83-992c-64c2449f9626-kube-api-access-n9xwg\") pod \"kuadrant-operator-catalog-xtkhh\" (UID: \"88f6231e-fe8f-4f83-992c-64c2449f9626\") " pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:27.439220 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.439157 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xwg\" (UniqueName: \"kubernetes.io/projected/88f6231e-fe8f-4f83-992c-64c2449f9626-kube-api-access-n9xwg\") pod \"kuadrant-operator-catalog-xtkhh\" (UID: \"88f6231e-fe8f-4f83-992c-64c2449f9626\") " pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:27.495831 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.495371 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:27.630082 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:27.629990 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtkhh"] Jun 14 14:48:27.632748 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:48:27.632722 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f6231e_fe8f_4f83_992c_64c2449f9626.slice/crio-3677a9b2381bbf54429e64e76d07713875b0f93000c12676bc4b67ca6c6ac625 WatchSource:0}: Error finding container 3677a9b2381bbf54429e64e76d07713875b0f93000c12676bc4b67ca6c6ac625: Status 404 returned error can't find the container with id 3677a9b2381bbf54429e64e76d07713875b0f93000c12676bc4b67ca6c6ac625 Jun 14 14:48:28.023818 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:28.023782 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" event={"ID":"88f6231e-fe8f-4f83-992c-64c2449f9626","Type":"ContainerStarted","Data":"3677a9b2381bbf54429e64e76d07713875b0f93000c12676bc4b67ca6c6ac625"} Jun 14 14:48:28.024982 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:28.024951 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" event={"ID":"622f5378-e3e2-4bdd-864d-e71b1441da23","Type":"ContainerStarted","Data":"ce633b563c9fe87d5f16ebc93830a7ab44f3a4b52a5070933072313693377e12"} Jun 14 14:48:30.035144 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.035104 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" event={"ID":"622f5378-e3e2-4bdd-864d-e71b1441da23","Type":"ContainerStarted","Data":"350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455"} Jun 14 14:48:30.035630 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.035117 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" podUID="622f5378-e3e2-4bdd-864d-e71b1441da23" containerName="registry-server" containerID="cri-o://350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455" gracePeriod=2 Jun 14 14:48:30.036623 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.036600 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" event={"ID":"88f6231e-fe8f-4f83-992c-64c2449f9626","Type":"ContainerStarted","Data":"b0eb1e21a7549fb070047d1942c14def6cdcc04bd691bac6d3253a9a9302fccd"} Jun 14 14:48:30.050345 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.050308 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" podStartSLOduration=2.021658119 podStartE2EDuration="4.050294983s" totalImagesPullingTime="2.028636864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:48:30.049872763 +0000 UTC m=+535.403250732" watchObservedRunningTime="2026-06-14 14:48:30.050294983 +0000 UTC m=+535.403672933" Jun 14 14:48:30.063833 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.063789 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" podStartSLOduration=1.611613041 podStartE2EDuration="3.063776682s" totalImagesPullingTime="1.452163641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:48:30.063295853 +0000 UTC m=+535.416673803" watchObservedRunningTime="2026-06-14 14:48:30.063776682 +0000 UTC m=+535.417154630" Jun 14 14:48:30.270719 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.270695 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:30.356529 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.356456 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmvfj\" (UniqueName: \"kubernetes.io/projected/622f5378-e3e2-4bdd-864d-e71b1441da23-kube-api-access-xmvfj\") pod \"622f5378-e3e2-4bdd-864d-e71b1441da23\" (UID: \"622f5378-e3e2-4bdd-864d-e71b1441da23\") " Jun 14 14:48:30.358539 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.358508 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622f5378-e3e2-4bdd-864d-e71b1441da23-kube-api-access-xmvfj" (OuterVolumeSpecName: "kube-api-access-xmvfj") pod "622f5378-e3e2-4bdd-864d-e71b1441da23" (UID: "622f5378-e3e2-4bdd-864d-e71b1441da23"). InnerVolumeSpecName "kube-api-access-xmvfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:48:30.457913 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:30.457880 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmvfj\" (UniqueName: \"kubernetes.io/projected/622f5378-e3e2-4bdd-864d-e71b1441da23-kube-api-access-xmvfj\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:48:31.041883 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.041850 2549 generic.go:356] "Generic (PLEG): container finished" podID="622f5378-e3e2-4bdd-864d-e71b1441da23" containerID="350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455" exitCode=0 Jun 14 14:48:31.042436 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.041893 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" Jun 14 14:48:31.042436 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.041940 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" event={"ID":"622f5378-e3e2-4bdd-864d-e71b1441da23","Type":"ContainerDied","Data":"350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455"} Jun 14 14:48:31.042436 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.041991 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kb2nv" event={"ID":"622f5378-e3e2-4bdd-864d-e71b1441da23","Type":"ContainerDied","Data":"ce633b563c9fe87d5f16ebc93830a7ab44f3a4b52a5070933072313693377e12"} Jun 14 14:48:31.042436 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.042022 2549 scope.go:117] "RemoveContainer" containerID="350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455" Jun 14 14:48:31.051500 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.051484 2549 scope.go:117] "RemoveContainer" containerID="350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455" Jun 14 14:48:31.051764 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:48:31.051748 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455\": container with ID starting with 350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455 not found: ID does not exist" containerID="350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455" Jun 14 14:48:31.051828 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.051771 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455"} err="failed to get container status \"350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455\": rpc error: code = NotFound desc = could not find container \"350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455\": container with ID starting with 350c1a8be46c6d846a031052b3fffc078d0143b33a57d8ed3c2b674b009b1455 not found: ID does not exist" Jun 14 14:48:31.083113 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.083088 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kb2nv"] Jun 14 14:48:31.090890 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.090871 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kb2nv"] Jun 14 14:48:31.177425 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:31.177399 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="622f5378-e3e2-4bdd-864d-e71b1441da23" path="/var/lib/kubelet/pods/622f5378-e3e2-4bdd-864d-e71b1441da23/volumes" Jun 14 14:48:37.496223 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:37.496179 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:37.496749 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:37.496248 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:37.517880 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:37.517859 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:38.090199 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:38.090173 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xtkhh" Jun 14 14:48:57.774634 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.774597 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5"] Jun 14 14:48:57.775018 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.774872 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622f5378-e3e2-4bdd-864d-e71b1441da23" containerName="registry-server" Jun 14 14:48:57.775018 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.774881 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="622f5378-e3e2-4bdd-864d-e71b1441da23" containerName="registry-server" Jun 14 14:48:57.775018 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.774929 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="622f5378-e3e2-4bdd-864d-e71b1441da23" containerName="registry-server" Jun 14 14:48:57.777743 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.777729 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:48:57.780180 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.780156 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 14:48:57.780325 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.780258 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2pj5d\"" Jun 14 14:48:57.797529 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.797507 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5"] Jun 14 14:48:57.879877 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.879845 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlrc7\" (UniqueName: \"kubernetes.io/projected/69958dd6-924e-48c3-b3df-0d851e85b3ea-kube-api-access-dlrc7\") pod \"dns-operator-controller-manager-864dd78c4c-nznx5\" (UID: \"69958dd6-924e-48c3-b3df-0d851e85b3ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:48:57.980236 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.980189 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlrc7\" (UniqueName: \"kubernetes.io/projected/69958dd6-924e-48c3-b3df-0d851e85b3ea-kube-api-access-dlrc7\") pod \"dns-operator-controller-manager-864dd78c4c-nznx5\" (UID: \"69958dd6-924e-48c3-b3df-0d851e85b3ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:48:57.988307 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:57.988279 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlrc7\" (UniqueName: \"kubernetes.io/projected/69958dd6-924e-48c3-b3df-0d851e85b3ea-kube-api-access-dlrc7\") pod \"dns-operator-controller-manager-864dd78c4c-nznx5\" (UID: \"69958dd6-924e-48c3-b3df-0d851e85b3ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:48:58.092313 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:58.092249 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:48:58.215787 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:58.215762 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5"] Jun 14 14:48:58.218256 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:48:58.218221 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69958dd6_924e_48c3_b3df_0d851e85b3ea.slice/crio-870d4b581f9c8633ca9e4cc21751fad40769ec8be262afdbbe282e3ebb58149e WatchSource:0}: Error finding container 870d4b581f9c8633ca9e4cc21751fad40769ec8be262afdbbe282e3ebb58149e: Status 404 returned error can't find the container with id 870d4b581f9c8633ca9e4cc21751fad40769ec8be262afdbbe282e3ebb58149e Jun 14 14:48:59.150438 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.150364 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" event={"ID":"69958dd6-924e-48c3-b3df-0d851e85b3ea","Type":"ContainerStarted","Data":"870d4b581f9c8633ca9e4cc21751fad40769ec8be262afdbbe282e3ebb58149e"} Jun 14 14:48:59.619650 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.619611 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665bfdffd5-9c5lk"] Jun 14 14:48:59.622884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.622863 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.625304 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.625280 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 14:48:59.625411 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.625346 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 14:48:59.626519 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.626504 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 14:48:59.626634 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.626520 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 14:48:59.626634 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.626550 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qd8m9\"" Jun 14 14:48:59.626634 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.626556 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 14:48:59.626848 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.626825 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 14:48:59.626946 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.626866 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 14:48:59.630774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.630678 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 14:48:59.632692 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.632674 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665bfdffd5-9c5lk"] Jun 14 14:48:59.694422 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694395 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kss6n\" (UniqueName: \"kubernetes.io/projected/4d3e0d2f-812d-4ed6-99fc-f630122881b6-kube-api-access-kss6n\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.694558 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694437 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-config\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.694558 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694458 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-service-ca\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.694558 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694533 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-oauth-config\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.694689 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694612 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-trusted-ca-bundle\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.694689 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694645 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-serving-cert\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.694689 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.694673 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-oauth-serving-cert\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795214 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795175 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-config\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795370 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795219 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-service-ca\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795370 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795250 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-oauth-config\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795370 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795295 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-trusted-ca-bundle\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795370 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795339 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-serving-cert\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795618 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795372 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-oauth-serving-cert\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.795618 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.795414 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kss6n\" (UniqueName: \"kubernetes.io/projected/4d3e0d2f-812d-4ed6-99fc-f630122881b6-kube-api-access-kss6n\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.796247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.796108 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-service-ca\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.796247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.796149 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-config\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.796247 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.796237 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-oauth-serving-cert\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.796606 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.796559 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3e0d2f-812d-4ed6-99fc-f630122881b6-trusted-ca-bundle\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.797854 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.797832 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-oauth-config\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.797976 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.797957 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e0d2f-812d-4ed6-99fc-f630122881b6-console-serving-cert\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.806348 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.806322 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kss6n\" (UniqueName: \"kubernetes.io/projected/4d3e0d2f-812d-4ed6-99fc-f630122881b6-kube-api-access-kss6n\") pod \"console-665bfdffd5-9c5lk\" (UID: \"4d3e0d2f-812d-4ed6-99fc-f630122881b6\") " pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:48:59.933255 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:48:59.933166 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:49:00.360895 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:00.360871 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665bfdffd5-9c5lk"] Jun 14 14:49:00.362873 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:00.362851 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3e0d2f_812d_4ed6_99fc_f630122881b6.slice/crio-728249e1d75cc2b60b51a777d33cfc02077180ac31ff987b055075d66dd0bd78 WatchSource:0}: Error finding container 728249e1d75cc2b60b51a777d33cfc02077180ac31ff987b055075d66dd0bd78: Status 404 returned error can't find the container with id 728249e1d75cc2b60b51a777d33cfc02077180ac31ff987b055075d66dd0bd78 Jun 14 14:49:01.165113 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.160686 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665bfdffd5-9c5lk" event={"ID":"4d3e0d2f-812d-4ed6-99fc-f630122881b6","Type":"ContainerStarted","Data":"bcebdc5dc45b3ba1bbc0c62c514b3acff3745e08cfb7bc497293137bfdfd733f"} Jun 14 14:49:01.165113 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.160788 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665bfdffd5-9c5lk" event={"ID":"4d3e0d2f-812d-4ed6-99fc-f630122881b6","Type":"ContainerStarted","Data":"728249e1d75cc2b60b51a777d33cfc02077180ac31ff987b055075d66dd0bd78"} Jun 14 14:49:01.167273 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.167238 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" event={"ID":"69958dd6-924e-48c3-b3df-0d851e85b3ea","Type":"ContainerStarted","Data":"231f18ac6a11b4990708a4f1771e62a346fa77bfcb2642262e869915ebbcd69a"} Jun 14 14:49:01.167394 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.167325 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:49:01.179648 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.179610 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665bfdffd5-9c5lk" podStartSLOduration=2.179596827 podStartE2EDuration="2.179596827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:01.179128378 +0000 UTC m=+566.532506330" watchObservedRunningTime="2026-06-14 14:49:01.179596827 +0000 UTC m=+566.532974780" Jun 14 14:49:01.201911 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.201860 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" podStartSLOduration=2.125416751 podStartE2EDuration="4.201847747s" totalImagesPullingTime="2.076430996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:01.200348911 +0000 UTC m=+566.553726881" watchObservedRunningTime="2026-06-14 14:49:01.201847747 +0000 UTC m=+566.555225696" Jun 14 14:49:01.245774 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.245740 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg"] Jun 14 14:49:01.250228 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.250208 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:01.252835 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.252817 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-d8d4r\"" Jun 14 14:49:01.258911 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.258887 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg"] Jun 14 14:49:01.308934 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.308894 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4jz\" (UniqueName: \"kubernetes.io/projected/aeba5244-6ff6-4770-8d49-9b3c4cb26948-kube-api-access-8p4jz\") pod \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" (UID: \"aeba5244-6ff6-4770-8d49-9b3c4cb26948\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:01.409330 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.409286 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4jz\" (UniqueName: \"kubernetes.io/projected/aeba5244-6ff6-4770-8d49-9b3c4cb26948-kube-api-access-8p4jz\") pod \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" (UID: \"aeba5244-6ff6-4770-8d49-9b3c4cb26948\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:01.420187 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.420121 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4jz\" (UniqueName: \"kubernetes.io/projected/aeba5244-6ff6-4770-8d49-9b3c4cb26948-kube-api-access-8p4jz\") pod \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" (UID: \"aeba5244-6ff6-4770-8d49-9b3c4cb26948\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:01.561291 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.561257 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:01.688427 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:01.688345 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg"] Jun 14 14:49:01.691097 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:01.691070 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeba5244_6ff6_4770_8d49_9b3c4cb26948.slice/crio-554f666f996eaa4b9cff1b808412946a5e1c6d646d953b86fff9e062ef2eb376 WatchSource:0}: Error finding container 554f666f996eaa4b9cff1b808412946a5e1c6d646d953b86fff9e062ef2eb376: Status 404 returned error can't find the container with id 554f666f996eaa4b9cff1b808412946a5e1c6d646d953b86fff9e062ef2eb376 Jun 14 14:49:02.175553 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:02.175519 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" event={"ID":"aeba5244-6ff6-4770-8d49-9b3c4cb26948","Type":"ContainerStarted","Data":"554f666f996eaa4b9cff1b808412946a5e1c6d646d953b86fff9e062ef2eb376"} Jun 14 14:49:04.185186 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:04.185147 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" event={"ID":"aeba5244-6ff6-4770-8d49-9b3c4cb26948","Type":"ContainerStarted","Data":"0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c"} Jun 14 14:49:04.185577 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:04.185272 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:04.203834 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:04.203786 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" podStartSLOduration=1.214979261 podStartE2EDuration="3.203772107s" totalImagesPullingTime="1.988792846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:04.201936947 +0000 UTC m=+569.555314897" watchObservedRunningTime="2026-06-14 14:49:04.203772107 +0000 UTC m=+569.557150091" Jun 14 14:49:06.244506 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.244468 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj"] Jun 14 14:49:06.248109 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.248093 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.250597 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.250551 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9t7vc\"" Jun 14 14:49:06.258305 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.258284 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj"] Jun 14 14:49:06.352515 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.352487 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39fbd461-5a38-40dd-b6ed-60724602b3d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.352685 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.352540 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55456\" (UniqueName: \"kubernetes.io/projected/39fbd461-5a38-40dd-b6ed-60724602b3d4-kube-api-access-55456\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.453640 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.453614 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39fbd461-5a38-40dd-b6ed-60724602b3d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.453764 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.453655 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55456\" (UniqueName: \"kubernetes.io/projected/39fbd461-5a38-40dd-b6ed-60724602b3d4-kube-api-access-55456\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.453979 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.453958 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39fbd461-5a38-40dd-b6ed-60724602b3d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.462765 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.462742 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55456\" (UniqueName: \"kubernetes.io/projected/39fbd461-5a38-40dd-b6ed-60724602b3d4-kube-api-access-55456\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.558893 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.558833 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:06.690304 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:06.690262 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj"] Jun 14 14:49:06.694737 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:06.694701 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fbd461_5a38_40dd_b6ed_60724602b3d4.slice/crio-7af487259250f3739618b5493b86180c83124d2767e070eb8b730c040ca8809c WatchSource:0}: Error finding container 7af487259250f3739618b5493b86180c83124d2767e070eb8b730c040ca8809c: Status 404 returned error can't find the container with id 7af487259250f3739618b5493b86180c83124d2767e070eb8b730c040ca8809c Jun 14 14:49:07.198234 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:07.198202 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" event={"ID":"39fbd461-5a38-40dd-b6ed-60724602b3d4","Type":"ContainerStarted","Data":"7af487259250f3739618b5493b86180c83124d2767e070eb8b730c040ca8809c"} Jun 14 14:49:09.933609 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:09.933553 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:49:09.934050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:09.933645 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:49:09.938531 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:09.938507 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:49:10.214880 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:10.214852 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665bfdffd5-9c5lk" Jun 14 14:49:12.178470 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:12.178434 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nznx5" Jun 14 14:49:13.226415 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:13.226380 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" event={"ID":"39fbd461-5a38-40dd-b6ed-60724602b3d4","Type":"ContainerStarted","Data":"53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276"} Jun 14 14:49:13.226805 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:13.226534 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:13.245072 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:13.245017 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" podStartSLOduration=0.797418875 podStartE2EDuration="7.245001011s" totalImagesPullingTime="6.447582136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:13.24337614 +0000 UTC m=+578.596754102" watchObservedRunningTime="2026-06-14 14:49:13.245001011 +0000 UTC m=+578.598378960" Jun 14 14:49:15.191621 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:15.191591 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:24.231877 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:24.231841 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:25.902579 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.902539 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj"] Jun 14 14:49:25.902946 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.902787 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" containerName="manager" containerID="cri-o://53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276" gracePeriod=2 Jun 14 14:49:25.915335 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.915311 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj"] Jun 14 14:49:25.924667 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:25.924626 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"39fbd461-5a38-40dd-b6ed-60724602b3d4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:25.932727 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.932706 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg"] Jun 14 14:49:25.932948 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.932920 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" containerName="manager" containerID="cri-o://0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c" gracePeriod=2 Jun 14 14:49:25.934361 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.934340 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w"] Jun 14 14:49:25.934796 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.934774 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" containerName="manager" Jun 14 14:49:25.934796 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.934798 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" containerName="manager" Jun 14 14:49:25.934954 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.934900 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" containerName="manager" Jun 14 14:49:25.938018 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.937996 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg"] Jun 14 14:49:25.938126 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.938112 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:25.943478 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:25.943452 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:25.953463 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.953440 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w"] Jun 14 14:49:25.959212 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.959191 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65"] Jun 14 14:49:25.959512 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.959497 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" containerName="manager" Jun 14 14:49:25.959607 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.959515 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" containerName="manager" Jun 14 14:49:25.959607 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.959601 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" containerName="manager" Jun 14 14:49:25.962491 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.962475 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:25.966422 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:25.966395 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:25.968385 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:25.968364 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:25.970452 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:25.970429 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:25.972909 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:25.972888 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:25.977209 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:25.977185 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65"] Jun 14 14:49:26.035223 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.035197 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace90fab-be13-4448-a6e6-bf1218e74950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd99w\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.035319 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.035226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rn6l\" (UniqueName: \"kubernetes.io/projected/ace90fab-be13-4448-a6e6-bf1218e74950-kube-api-access-9rn6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd99w\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.108203 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.108169 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w"] Jun 14 14:49:26.108448 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.108428 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-9rn6l], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" podUID="ace90fab-be13-4448-a6e6-bf1218e74950" Jun 14 14:49:26.131595 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.131554 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq"] Jun 14 14:49:26.135196 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.135175 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.135820 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.135769 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfs6s\" (UniqueName: \"kubernetes.io/projected/d2a28efc-906c-44c1-b4e0-cb0defa93e2f-kube-api-access-dfs6s\") pod \"limitador-operator-controller-manager-859d7b78bd-jmx65\" (UID: \"d2a28efc-906c-44c1-b4e0-cb0defa93e2f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:26.135930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.135832 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace90fab-be13-4448-a6e6-bf1218e74950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd99w\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.135930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.135851 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rn6l\" (UniqueName: \"kubernetes.io/projected/ace90fab-be13-4448-a6e6-bf1218e74950-kube-api-access-9rn6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd99w\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.136145 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.136121 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace90fab-be13-4448-a6e6-bf1218e74950-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd99w\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.137494 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.137459 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.146065 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.146041 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq"] Jun 14 14:49:26.147827 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.147797 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rn6l\" (UniqueName: \"kubernetes.io/projected/ace90fab-be13-4448-a6e6-bf1218e74950-kube-api-access-9rn6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd99w\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.164997 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.164971 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.174406 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.174388 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.178557 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.178535 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.180677 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.180652 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.189773 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.189756 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.191905 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.191883 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.193858 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.193839 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.236747 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.236727 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcv78\" (UniqueName: \"kubernetes.io/projected/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-kube-api-access-mcv78\") pod \"kuadrant-operator-controller-manager-86878c769f-wwphq\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.236832 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.236757 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfs6s\" (UniqueName: \"kubernetes.io/projected/d2a28efc-906c-44c1-b4e0-cb0defa93e2f-kube-api-access-dfs6s\") pod \"limitador-operator-controller-manager-859d7b78bd-jmx65\" (UID: \"d2a28efc-906c-44c1-b4e0-cb0defa93e2f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:26.236875 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.236843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wwphq\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.245844 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.245826 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfs6s\" (UniqueName: \"kubernetes.io/projected/d2a28efc-906c-44c1-b4e0-cb0defa93e2f-kube-api-access-dfs6s\") pod \"limitador-operator-controller-manager-859d7b78bd-jmx65\" (UID: \"d2a28efc-906c-44c1-b4e0-cb0defa93e2f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:26.279291 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.279266 2549 generic.go:356] "Generic (PLEG): container finished" podID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" containerID="0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c" exitCode=0 Jun 14 14:49:26.279382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.279304 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.279382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.279327 2549 scope.go:117] "RemoveContainer" containerID="0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c" Jun 14 14:49:26.280759 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.280735 2549 generic.go:356] "Generic (PLEG): container finished" podID="39fbd461-5a38-40dd-b6ed-60724602b3d4" containerID="53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276" exitCode=0 Jun 14 14:49:26.280846 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.280767 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.280940 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.280926 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.281654 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.281636 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.283493 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.283468 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.287539 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.287521 2549 scope.go:117] "RemoveContainer" containerID="0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c" Jun 14 14:49:26.287719 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.287706 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:26.287801 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.287784 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c\": container with ID starting with 0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c not found: ID does not exist" containerID="0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c" Jun 14 14:49:26.287884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.287810 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c"} err="failed to get container status \"0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c\": rpc error: code = NotFound desc = could not find container \"0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c\": container with ID starting with 0ae99f553b5ff2c8bb1d35817da91a5d25f8b6f752a23a80407fe690d156943c not found: ID does not exist" Jun 14 14:49:26.287884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.287827 2549 scope.go:117] "RemoveContainer" containerID="53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276" Jun 14 14:49:26.294837 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.294820 2549 scope.go:117] "RemoveContainer" containerID="53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276" Jun 14 14:49:26.295076 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.295060 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276\": container with ID starting with 53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276 not found: ID does not exist" containerID="53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276" Jun 14 14:49:26.295125 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.295084 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276"} err="failed to get container status \"53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276\": rpc error: code = NotFound desc = could not find container \"53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276\": container with ID starting with 53902778eb027e57a5f5609d90f39b392ac3c4aeef8fbdf36438bbd9b1f7e276 not found: ID does not exist" Jun 14 14:49:26.305457 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.305428 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.307305 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.307284 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.309065 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.309047 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.317841 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.317816 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.338109 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338090 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39fbd461-5a38-40dd-b6ed-60724602b3d4-extensions-socket-volume\") pod \"39fbd461-5a38-40dd-b6ed-60724602b3d4\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " Jun 14 14:49:26.338168 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338130 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p4jz\" (UniqueName: \"kubernetes.io/projected/aeba5244-6ff6-4770-8d49-9b3c4cb26948-kube-api-access-8p4jz\") pod \"aeba5244-6ff6-4770-8d49-9b3c4cb26948\" (UID: \"aeba5244-6ff6-4770-8d49-9b3c4cb26948\") " Jun 14 14:49:26.338168 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338159 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55456\" (UniqueName: \"kubernetes.io/projected/39fbd461-5a38-40dd-b6ed-60724602b3d4-kube-api-access-55456\") pod \"39fbd461-5a38-40dd-b6ed-60724602b3d4\" (UID: \"39fbd461-5a38-40dd-b6ed-60724602b3d4\") " Jun 14 14:49:26.338269 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338239 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wwphq\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.338329 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcv78\" (UniqueName: \"kubernetes.io/projected/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-kube-api-access-mcv78\") pod \"kuadrant-operator-controller-manager-86878c769f-wwphq\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.338699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338674 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39fbd461-5a38-40dd-b6ed-60724602b3d4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "39fbd461-5a38-40dd-b6ed-60724602b3d4" (UID: "39fbd461-5a38-40dd-b6ed-60724602b3d4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:49:26.338782 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.338674 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wwphq\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.340597 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.340578 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeba5244-6ff6-4770-8d49-9b3c4cb26948-kube-api-access-8p4jz" (OuterVolumeSpecName: "kube-api-access-8p4jz") pod "aeba5244-6ff6-4770-8d49-9b3c4cb26948" (UID: "aeba5244-6ff6-4770-8d49-9b3c4cb26948"). InnerVolumeSpecName "kube-api-access-8p4jz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:49:26.340668 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.340590 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fbd461-5a38-40dd-b6ed-60724602b3d4-kube-api-access-55456" (OuterVolumeSpecName: "kube-api-access-55456") pod "39fbd461-5a38-40dd-b6ed-60724602b3d4" (UID: "39fbd461-5a38-40dd-b6ed-60724602b3d4"). InnerVolumeSpecName "kube-api-access-55456". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:49:26.349281 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.349260 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcv78\" (UniqueName: \"kubernetes.io/projected/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-kube-api-access-mcv78\") pod \"kuadrant-operator-controller-manager-86878c769f-wwphq\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.358084 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.358069 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:26.439204 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.439177 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace90fab-be13-4448-a6e6-bf1218e74950-extensions-socket-volume\") pod \"ace90fab-be13-4448-a6e6-bf1218e74950\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " Jun 14 14:49:26.439337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.439245 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rn6l\" (UniqueName: \"kubernetes.io/projected/ace90fab-be13-4448-a6e6-bf1218e74950-kube-api-access-9rn6l\") pod \"ace90fab-be13-4448-a6e6-bf1218e74950\" (UID: \"ace90fab-be13-4448-a6e6-bf1218e74950\") " Jun 14 14:49:26.439506 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.439475 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ace90fab-be13-4448-a6e6-bf1218e74950-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ace90fab-be13-4448-a6e6-bf1218e74950" (UID: "ace90fab-be13-4448-a6e6-bf1218e74950"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:49:26.439506 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.439503 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55456\" (UniqueName: \"kubernetes.io/projected/39fbd461-5a38-40dd-b6ed-60724602b3d4-kube-api-access-55456\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.439665 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.439520 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39fbd461-5a38-40dd-b6ed-60724602b3d4-extensions-socket-volume\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.439665 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.439534 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p4jz\" (UniqueName: \"kubernetes.io/projected/aeba5244-6ff6-4770-8d49-9b3c4cb26948-kube-api-access-8p4jz\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.442978 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.442955 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ace90fab-be13-4448-a6e6-bf1218e74950-kube-api-access-9rn6l" (OuterVolumeSpecName: "kube-api-access-9rn6l") pod "ace90fab-be13-4448-a6e6-bf1218e74950" (UID: "ace90fab-be13-4448-a6e6-bf1218e74950"). InnerVolumeSpecName "kube-api-access-9rn6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:49:26.446873 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.446854 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:26.484142 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.484118 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65"] Jun 14 14:49:26.487146 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:26.487102 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a28efc_906c_44c1_b4e0_cb0defa93e2f.slice/crio-c20c3ee11e294cc596dccdbbb4830abcec9553883a6ebd82a301484308548f8b WatchSource:0}: Error finding container c20c3ee11e294cc596dccdbbb4830abcec9553883a6ebd82a301484308548f8b: Status 404 returned error can't find the container with id c20c3ee11e294cc596dccdbbb4830abcec9553883a6ebd82a301484308548f8b Jun 14 14:49:26.540307 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.540270 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rn6l\" (UniqueName: \"kubernetes.io/projected/ace90fab-be13-4448-a6e6-bf1218e74950-kube-api-access-9rn6l\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.540408 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.540308 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ace90fab-be13-4448-a6e6-bf1218e74950-extensions-socket-volume\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:49:26.580878 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:26.580855 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq"] Jun 14 14:49:26.583633 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:26.583602 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b0a5fb_ce72_49bf_9d9a_0a884b7f83a0.slice/crio-35f4c6aa9c478c72cf3ea90fef4c8be2dfb5b44af40f52baec927194dad430cd WatchSource:0}: Error finding container 35f4c6aa9c478c72cf3ea90fef4c8be2dfb5b44af40f52baec927194dad430cd: Status 404 returned error can't find the container with id 35f4c6aa9c478c72cf3ea90fef4c8be2dfb5b44af40f52baec927194dad430cd Jun 14 14:49:26.592631 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.592604 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.594691 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.594668 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:26.596621 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.596600 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nfgg\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nfgg" Jun 14 14:49:26.598353 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:49:26.598331 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wn9sj\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wn9sj" Jun 14 14:49:27.177880 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.177789 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39fbd461-5a38-40dd-b6ed-60724602b3d4" path="/var/lib/kubelet/pods/39fbd461-5a38-40dd-b6ed-60724602b3d4/volumes" Jun 14 14:49:27.178326 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.178260 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeba5244-6ff6-4770-8d49-9b3c4cb26948" path="/var/lib/kubelet/pods/aeba5244-6ff6-4770-8d49-9b3c4cb26948/volumes" Jun 14 14:49:27.286729 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.286695 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" event={"ID":"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0","Type":"ContainerStarted","Data":"022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf"} Jun 14 14:49:27.286896 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.286741 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" event={"ID":"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0","Type":"ContainerStarted","Data":"35f4c6aa9c478c72cf3ea90fef4c8be2dfb5b44af40f52baec927194dad430cd"} Jun 14 14:49:27.286896 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.286792 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:27.289981 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.289953 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" event={"ID":"d2a28efc-906c-44c1-b4e0-cb0defa93e2f","Type":"ContainerStarted","Data":"59190b58e57a128fb6cdc80613f9fc868172bd0a55b454d3ca5d10c08e379fc7"} Jun 14 14:49:27.290112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.290000 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" event={"ID":"d2a28efc-906c-44c1-b4e0-cb0defa93e2f","Type":"ContainerStarted","Data":"c20c3ee11e294cc596dccdbbb4830abcec9553883a6ebd82a301484308548f8b"} Jun 14 14:49:27.290112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.290021 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:27.290112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.290041 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w" Jun 14 14:49:27.308820 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.308772 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" podStartSLOduration=1.308759844 podStartE2EDuration="1.308759844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:27.308289907 +0000 UTC m=+592.661667869" watchObservedRunningTime="2026-06-14 14:49:27.308759844 +0000 UTC m=+592.662137793" Jun 14 14:49:27.341659 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.341633 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w"] Jun 14 14:49:27.347683 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.347662 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd99w"] Jun 14 14:49:27.368262 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:27.368223 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" podStartSLOduration=2.368209758 podStartE2EDuration="2.368209758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:27.366558071 +0000 UTC m=+592.719936021" watchObservedRunningTime="2026-06-14 14:49:27.368209758 +0000 UTC m=+592.721587707" Jun 14 14:49:29.178199 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:29.178167 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ace90fab-be13-4448-a6e6-bf1218e74950" path="/var/lib/kubelet/pods/ace90fab-be13-4448-a6e6-bf1218e74950/volumes" Jun 14 14:49:35.144169 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:35.144143 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:49:35.145712 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:35.145688 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:49:38.296288 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:38.296259 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 14:49:38.296775 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:38.296332 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmx65" Jun 14 14:49:54.614050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.613954 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94"] Jun 14 14:49:54.616693 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.616658 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.619077 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.619058 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jh7zp\"" Jun 14 14:49:54.631627 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.631605 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94"] Jun 14 14:49:54.651882 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.651856 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.651980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.651887 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.651980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.651906 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.651980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.651960 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f82e9863-d2df-4bcd-8316-de79b970f581-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.652083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.651992 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7b7\" (UniqueName: \"kubernetes.io/projected/f82e9863-d2df-4bcd-8316-de79b970f581-kube-api-access-kb7b7\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.652083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.652023 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f82e9863-d2df-4bcd-8316-de79b970f581-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.652083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.652041 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f82e9863-d2df-4bcd-8316-de79b970f581-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.652083 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.652073 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.652229 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.652119 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752527 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752503 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752655 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752538 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f82e9863-d2df-4bcd-8316-de79b970f581-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752655 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752580 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7b7\" (UniqueName: \"kubernetes.io/projected/f82e9863-d2df-4bcd-8316-de79b970f581-kube-api-access-kb7b7\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752655 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752614 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f82e9863-d2df-4bcd-8316-de79b970f581-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752827 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752781 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f82e9863-d2df-4bcd-8316-de79b970f581-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752827 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752826 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752847 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752905 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.752930 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752910 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.753069 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.752934 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.753122 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.753102 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.753174 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.753160 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.753249 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.753227 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.753584 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.753542 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f82e9863-d2df-4bcd-8316-de79b970f581-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.755050 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.755024 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f82e9863-d2df-4bcd-8316-de79b970f581-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.755185 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.755166 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f82e9863-d2df-4bcd-8316-de79b970f581-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.760014 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.759993 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f82e9863-d2df-4bcd-8316-de79b970f581-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.761103 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.761081 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7b7\" (UniqueName: \"kubernetes.io/projected/f82e9863-d2df-4bcd-8316-de79b970f581-kube-api-access-kb7b7\") pod \"maas-default-gateway-openshift-default-687ff6996-l8k94\" (UID: \"f82e9863-d2df-4bcd-8316-de79b970f581\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:54.927029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:54.926968 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:55.052420 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.052391 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94"] Jun 14 14:49:55.055629 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:55.055557 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82e9863_d2df_4bcd_8316_de79b970f581.slice/crio-92849d53adab2f5667a15c54426c10e7d6593e6a784a8dcb2d19ec471a76b5c2 WatchSource:0}: Error finding container 92849d53adab2f5667a15c54426c10e7d6593e6a784a8dcb2d19ec471a76b5c2: Status 404 returned error can't find the container with id 92849d53adab2f5667a15c54426c10e7d6593e6a784a8dcb2d19ec471a76b5c2 Jun 14 14:49:55.057603 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.057545 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:49:55.057699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.057648 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:49:55.057699 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.057691 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:49:55.408223 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.408191 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" event={"ID":"f82e9863-d2df-4bcd-8316-de79b970f581","Type":"ContainerStarted","Data":"c83ccd1e68d82971437a184520dba362bb276d060895ac6ffa076e9844f6c1e9"} Jun 14 14:49:55.408376 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.408265 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" event={"ID":"f82e9863-d2df-4bcd-8316-de79b970f581","Type":"ContainerStarted","Data":"92849d53adab2f5667a15c54426c10e7d6593e6a784a8dcb2d19ec471a76b5c2"} Jun 14 14:49:55.426958 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.426908 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" podStartSLOduration=1.426892015 podStartE2EDuration="1.426892015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:55.426600739 +0000 UTC m=+620.779978692" watchObservedRunningTime="2026-06-14 14:49:55.426892015 +0000 UTC m=+620.780269965" Jun 14 14:49:55.927843 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:55.927816 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:56.932507 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:56.932478 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:57.417713 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.417685 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:57.418650 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.418628 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:49:57.456470 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.456442 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5r5hw"] Jun 14 14:49:57.459594 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.459556 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:49:57.463033 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.463010 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r25qf\"" Jun 14 14:49:57.473816 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.473798 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5r5hw"] Jun 14 14:49:57.572736 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.572707 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftc4m\" (UniqueName: \"kubernetes.io/projected/7987647b-d136-481b-8d78-c15951b8739b-kube-api-access-ftc4m\") pod \"authorino-75d556bd77-5r5hw\" (UID: \"7987647b-d136-481b-8d78-c15951b8739b\") " pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:49:57.673800 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.673724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftc4m\" (UniqueName: \"kubernetes.io/projected/7987647b-d136-481b-8d78-c15951b8739b-kube-api-access-ftc4m\") pod \"authorino-75d556bd77-5r5hw\" (UID: \"7987647b-d136-481b-8d78-c15951b8739b\") " pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:49:57.685779 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.685753 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftc4m\" (UniqueName: \"kubernetes.io/projected/7987647b-d136-481b-8d78-c15951b8739b-kube-api-access-ftc4m\") pod \"authorino-75d556bd77-5r5hw\" (UID: \"7987647b-d136-481b-8d78-c15951b8739b\") " pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:49:57.770630 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.770604 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:49:57.897658 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:57.897624 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5r5hw"] Jun 14 14:49:57.900265 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:49:57.900244 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7987647b_d136_481b_8d78_c15951b8739b.slice/crio-abddddc9c5927365a997f93889b0438fd3cfc8f08477b65a2b82552f2edb9fcb WatchSource:0}: Error finding container abddddc9c5927365a997f93889b0438fd3cfc8f08477b65a2b82552f2edb9fcb: Status 404 returned error can't find the container with id abddddc9c5927365a997f93889b0438fd3cfc8f08477b65a2b82552f2edb9fcb Jun 14 14:49:58.424841 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:49:58.424799 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5r5hw" event={"ID":"7987647b-d136-481b-8d78-c15951b8739b","Type":"ContainerStarted","Data":"abddddc9c5927365a997f93889b0438fd3cfc8f08477b65a2b82552f2edb9fcb"} Jun 14 14:50:01.439827 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:50:01.439798 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5r5hw" event={"ID":"7987647b-d136-481b-8d78-c15951b8739b","Type":"ContainerStarted","Data":"aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626"} Jun 14 14:50:01.455923 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:50:01.455879 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5r5hw" podStartSLOduration=1.575958026 podStartE2EDuration="4.455864327s" totalImagesPullingTime="2.879906301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:50:01.454402441 +0000 UTC m=+626.807780378" watchObservedRunningTime="2026-06-14 14:50:01.455864327 +0000 UTC m=+626.809242275" Jun 14 14:51:19.658414 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.658375 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rhwqq"] Jun 14 14:51:19.661127 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.661106 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:19.666285 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.666260 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rhwqq"] Jun 14 14:51:19.810822 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.810788 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/365d5bcf-b517-4e1b-8d39-c15f5167220c-kube-api-access-7ql75\") pod \"authorino-5d4b67c446-rhwqq\" (UID: \"365d5bcf-b517-4e1b-8d39-c15f5167220c\") " pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:19.886399 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.886369 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rhwqq"] Jun 14 14:51:19.886637 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:19.886616 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7ql75], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-rhwqq" podUID="365d5bcf-b517-4e1b-8d39-c15f5167220c" Jun 14 14:51:19.912091 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.912028 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/365d5bcf-b517-4e1b-8d39-c15f5167220c-kube-api-access-7ql75\") pod \"authorino-5d4b67c446-rhwqq\" (UID: \"365d5bcf-b517-4e1b-8d39-c15f5167220c\") " pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:19.920047 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:19.920024 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/365d5bcf-b517-4e1b-8d39-c15f5167220c-kube-api-access-7ql75\") pod \"authorino-5d4b67c446-rhwqq\" (UID: \"365d5bcf-b517-4e1b-8d39-c15f5167220c\") " pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:20.166178 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.166089 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64767d9cdf-fbdf8"] Jun 14 14:51:20.168487 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.168467 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.170898 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.170876 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 14:51:20.176064 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.176041 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64767d9cdf-fbdf8"] Jun 14 14:51:20.315425 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.315392 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkbfk\" (UniqueName: \"kubernetes.io/projected/1a1bf2c4-382c-4646-a313-923906273af9-kube-api-access-fkbfk\") pod \"authorino-64767d9cdf-fbdf8\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.315590 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.315436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a1bf2c4-382c-4646-a313-923906273af9-tls-cert\") pod \"authorino-64767d9cdf-fbdf8\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.415910 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.415877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkbfk\" (UniqueName: \"kubernetes.io/projected/1a1bf2c4-382c-4646-a313-923906273af9-kube-api-access-fkbfk\") pod \"authorino-64767d9cdf-fbdf8\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.416064 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.415920 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a1bf2c4-382c-4646-a313-923906273af9-tls-cert\") pod \"authorino-64767d9cdf-fbdf8\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.418268 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.418213 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a1bf2c4-382c-4646-a313-923906273af9-tls-cert\") pod \"authorino-64767d9cdf-fbdf8\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.423272 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.423247 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkbfk\" (UniqueName: \"kubernetes.io/projected/1a1bf2c4-382c-4646-a313-923906273af9-kube-api-access-fkbfk\") pod \"authorino-64767d9cdf-fbdf8\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.478821 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.478799 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:51:20.600621 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.600599 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64767d9cdf-fbdf8"] Jun 14 14:51:20.602993 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:51:20.602969 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a1bf2c4_382c_4646_a313_923906273af9.slice/crio-dd43a6eed6aa2eb88af2bb5fccefb2718d86fcc944ba1f57cf0adc429d4b7b4b WatchSource:0}: Error finding container dd43a6eed6aa2eb88af2bb5fccefb2718d86fcc944ba1f57cf0adc429d4b7b4b: Status 404 returned error can't find the container with id dd43a6eed6aa2eb88af2bb5fccefb2718d86fcc944ba1f57cf0adc429d4b7b4b Jun 14 14:51:20.778806 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.778785 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:20.779198 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.778786 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" event={"ID":"1a1bf2c4-382c-4646-a313-923906273af9","Type":"ContainerStarted","Data":"dd43a6eed6aa2eb88af2bb5fccefb2718d86fcc944ba1f57cf0adc429d4b7b4b"} Jun 14 14:51:20.785410 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.785389 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:20.921061 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.921034 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/365d5bcf-b517-4e1b-8d39-c15f5167220c-kube-api-access-7ql75\") pod \"365d5bcf-b517-4e1b-8d39-c15f5167220c\" (UID: \"365d5bcf-b517-4e1b-8d39-c15f5167220c\") " Jun 14 14:51:20.922787 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:20.922762 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/365d5bcf-b517-4e1b-8d39-c15f5167220c-kube-api-access-7ql75" (OuterVolumeSpecName: "kube-api-access-7ql75") pod "365d5bcf-b517-4e1b-8d39-c15f5167220c" (UID: "365d5bcf-b517-4e1b-8d39-c15f5167220c"). InnerVolumeSpecName "kube-api-access-7ql75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:51:21.022142 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.022108 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/365d5bcf-b517-4e1b-8d39-c15f5167220c-kube-api-access-7ql75\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:51:21.784180 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.784150 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rhwqq" Jun 14 14:51:21.784180 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.784162 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" event={"ID":"1a1bf2c4-382c-4646-a313-923906273af9","Type":"ContainerStarted","Data":"15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495"} Jun 14 14:51:21.799112 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.799071 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" podStartSLOduration=1.538961389 podStartE2EDuration="1.799058253s" totalImagesPullingTime="260.096864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:51:21.798386433 +0000 UTC m=+707.151764401" watchObservedRunningTime="2026-06-14 14:51:21.799058253 +0000 UTC m=+707.152436382" Jun 14 14:51:21.825980 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.825953 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5r5hw"] Jun 14 14:51:21.826160 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.826136 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5r5hw" podUID="7987647b-d136-481b-8d78-c15951b8739b" containerName="authorino" containerID="cri-o://aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626" gracePeriod=30 Jun 14 14:51:21.829358 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.829335 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rhwqq"] Jun 14 14:51:21.837546 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:21.837516 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rhwqq"] Jun 14 14:51:22.075810 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.075790 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:51:22.231798 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.231761 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftc4m\" (UniqueName: \"kubernetes.io/projected/7987647b-d136-481b-8d78-c15951b8739b-kube-api-access-ftc4m\") pod \"7987647b-d136-481b-8d78-c15951b8739b\" (UID: \"7987647b-d136-481b-8d78-c15951b8739b\") " Jun 14 14:51:22.233741 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.233711 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7987647b-d136-481b-8d78-c15951b8739b-kube-api-access-ftc4m" (OuterVolumeSpecName: "kube-api-access-ftc4m") pod "7987647b-d136-481b-8d78-c15951b8739b" (UID: "7987647b-d136-481b-8d78-c15951b8739b"). InnerVolumeSpecName "kube-api-access-ftc4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:51:22.332954 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.332884 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftc4m\" (UniqueName: \"kubernetes.io/projected/7987647b-d136-481b-8d78-c15951b8739b-kube-api-access-ftc4m\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:51:22.789818 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.789779 2549 generic.go:356] "Generic (PLEG): container finished" podID="7987647b-d136-481b-8d78-c15951b8739b" containerID="aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626" exitCode=0 Jun 14 14:51:22.790189 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.789823 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5r5hw" Jun 14 14:51:22.790189 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.789860 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5r5hw" event={"ID":"7987647b-d136-481b-8d78-c15951b8739b","Type":"ContainerDied","Data":"aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626"} Jun 14 14:51:22.790189 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.789909 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5r5hw" event={"ID":"7987647b-d136-481b-8d78-c15951b8739b","Type":"ContainerDied","Data":"abddddc9c5927365a997f93889b0438fd3cfc8f08477b65a2b82552f2edb9fcb"} Jun 14 14:51:22.790189 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.789937 2549 scope.go:117] "RemoveContainer" containerID="aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626" Jun 14 14:51:22.797843 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.797824 2549 scope.go:117] "RemoveContainer" containerID="aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626" Jun 14 14:51:22.798090 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:22.798072 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626\": container with ID starting with aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626 not found: ID does not exist" containerID="aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626" Jun 14 14:51:22.798134 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.798098 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626"} err="failed to get container status \"aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626\": rpc error: code = NotFound desc = could not find container \"aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626\": container with ID starting with aac2d9595b103fcbaeccef21dead1c1d2b12abfcaa21fce6e6f36fba3b249626 not found: ID does not exist" Jun 14 14:51:22.811860 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.811837 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5r5hw"] Jun 14 14:51:22.817450 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:22.817430 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5r5hw"] Jun 14 14:51:23.177715 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:23.177635 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="365d5bcf-b517-4e1b-8d39-c15f5167220c" path="/var/lib/kubelet/pods/365d5bcf-b517-4e1b-8d39-c15f5167220c/volumes" Jun 14 14:51:23.177939 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:23.177922 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7987647b-d136-481b-8d78-c15951b8739b" path="/var/lib/kubelet/pods/7987647b-d136-481b-8d78-c15951b8739b/volumes" Jun 14 14:51:25.184850 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.184822 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d57886496-nj4nn"] Jun 14 14:51:25.185202 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.185116 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7987647b-d136-481b-8d78-c15951b8739b" containerName="authorino" Jun 14 14:51:25.185202 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.185125 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7987647b-d136-481b-8d78-c15951b8739b" containerName="authorino" Jun 14 14:51:25.185202 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.185176 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="7987647b-d136-481b-8d78-c15951b8739b" containerName="authorino" Jun 14 14:51:25.188041 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.188026 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.190668 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.190647 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 14:51:25.190772 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.190668 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 14:51:25.190772 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.190679 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bw8qn\"" Jun 14 14:51:25.196153 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.196132 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d57886496-nj4nn"] Jun 14 14:51:25.258837 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.258811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckhl\" (UniqueName: \"kubernetes.io/projected/be752f5a-42d1-4f29-89d9-3ff50002babb-kube-api-access-bckhl\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.258987 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.258849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.341230 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.341190 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659b665964-slzwm"] Jun 14 14:51:25.343557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.343536 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.348671 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.348648 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659b665964-slzwm"] Jun 14 14:51:25.359195 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.359174 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.359301 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.359288 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bckhl\" (UniqueName: \"kubernetes.io/projected/be752f5a-42d1-4f29-89d9-3ff50002babb-kube-api-access-bckhl\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.359358 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:25.359336 2549 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 14:51:25.359409 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:25.359394 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert podName:be752f5a-42d1-4f29-89d9-3ff50002babb nodeName:}" failed. No retries permitted until 2026-06-14 14:51:25.859378387 +0000 UTC m=+711.212756320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert") pod "maas-controller-d57886496-nj4nn" (UID: "be752f5a-42d1-4f29-89d9-3ff50002babb") : secret "maas-controller-webhook-cert" not found Jun 14 14:51:25.367672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.367648 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckhl\" (UniqueName: \"kubernetes.io/projected/be752f5a-42d1-4f29-89d9-3ff50002babb-kube-api-access-bckhl\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.460272 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.460247 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ed1369-e539-463b-a31f-a90695f6adc8-webhook-cert\") pod \"maas-controller-659b665964-slzwm\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.460372 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.460286 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtc4\" (UniqueName: \"kubernetes.io/projected/c4ed1369-e539-463b-a31f-a90695f6adc8-kube-api-access-qjtc4\") pod \"maas-controller-659b665964-slzwm\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.561735 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.561701 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ed1369-e539-463b-a31f-a90695f6adc8-webhook-cert\") pod \"maas-controller-659b665964-slzwm\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.561866 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.561753 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtc4\" (UniqueName: \"kubernetes.io/projected/c4ed1369-e539-463b-a31f-a90695f6adc8-kube-api-access-qjtc4\") pod \"maas-controller-659b665964-slzwm\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.564095 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.564078 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ed1369-e539-463b-a31f-a90695f6adc8-webhook-cert\") pod \"maas-controller-659b665964-slzwm\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.569276 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.569256 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtc4\" (UniqueName: \"kubernetes.io/projected/c4ed1369-e539-463b-a31f-a90695f6adc8-kube-api-access-qjtc4\") pod \"maas-controller-659b665964-slzwm\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.655633 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.655610 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:25.781940 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.781904 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659b665964-slzwm"] Jun 14 14:51:25.784574 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:51:25.784537 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ed1369_e539_463b_a31f_a90695f6adc8.slice/crio-5db42556407d3b1c14e9dcca6aafb0d4fce336df1abd8d58407bee4d67443fd0 WatchSource:0}: Error finding container 5db42556407d3b1c14e9dcca6aafb0d4fce336df1abd8d58407bee4d67443fd0: Status 404 returned error can't find the container with id 5db42556407d3b1c14e9dcca6aafb0d4fce336df1abd8d58407bee4d67443fd0 Jun 14 14:51:25.804414 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.804392 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659b665964-slzwm" event={"ID":"c4ed1369-e539-463b-a31f-a90695f6adc8","Type":"ContainerStarted","Data":"5db42556407d3b1c14e9dcca6aafb0d4fce336df1abd8d58407bee4d67443fd0"} Jun 14 14:51:25.864919 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.864887 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:25.867134 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:25.867117 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert\") pod \"maas-controller-d57886496-nj4nn\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:26.098951 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:26.098874 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:26.224884 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:26.224861 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d57886496-nj4nn"] Jun 14 14:51:26.226852 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:51:26.226825 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe752f5a_42d1_4f29_89d9_3ff50002babb.slice/crio-63e16dbbd3dddeffc07aa65ffca57a563037ae3e5929ab4cd7e1146ec7e12f6e WatchSource:0}: Error finding container 63e16dbbd3dddeffc07aa65ffca57a563037ae3e5929ab4cd7e1146ec7e12f6e: Status 404 returned error can't find the container with id 63e16dbbd3dddeffc07aa65ffca57a563037ae3e5929ab4cd7e1146ec7e12f6e Jun 14 14:51:26.811472 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:26.811431 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d57886496-nj4nn" event={"ID":"be752f5a-42d1-4f29-89d9-3ff50002babb","Type":"ContainerStarted","Data":"63e16dbbd3dddeffc07aa65ffca57a563037ae3e5929ab4cd7e1146ec7e12f6e"} Jun 14 14:51:27.818485 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:27.818443 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d57886496-nj4nn" event={"ID":"be752f5a-42d1-4f29-89d9-3ff50002babb","Type":"ContainerStarted","Data":"9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594"} Jun 14 14:51:27.818902 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:27.818641 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:27.820304 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:27.820274 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659b665964-slzwm" event={"ID":"c4ed1369-e539-463b-a31f-a90695f6adc8","Type":"ContainerStarted","Data":"c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3"} Jun 14 14:51:27.820430 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:27.820408 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:27.837952 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:27.837910 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d57886496-nj4nn" podStartSLOduration=1.340797983 podStartE2EDuration="2.837895371s" totalImagesPullingTime="1.497097388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:51:27.836877332 +0000 UTC m=+713.190255283" watchObservedRunningTime="2026-06-14 14:51:27.837895371 +0000 UTC m=+713.191273319" Jun 14 14:51:27.853698 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:27.853660 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659b665964-slzwm" podStartSLOduration=0.910671268 podStartE2EDuration="2.853643136s" totalImagesPullingTime="1.942971868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:51:27.852094882 +0000 UTC m=+713.205472832" watchObservedRunningTime="2026-06-14 14:51:27.853643136 +0000 UTC m=+713.207021084" Jun 14 14:51:38.829435 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:38.829407 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:51:38.829816 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:38.829529 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:38.880837 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:38.880808 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d57886496-nj4nn"] Jun 14 14:51:38.880999 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:38.880977 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d57886496-nj4nn" podUID="be752f5a-42d1-4f29-89d9-3ff50002babb" containerName="manager" containerID="cri-o://9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594" gracePeriod=30 Jun 14 14:51:39.126172 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.126150 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:39.275378 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.275350 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bckhl\" (UniqueName: \"kubernetes.io/projected/be752f5a-42d1-4f29-89d9-3ff50002babb-kube-api-access-bckhl\") pod \"be752f5a-42d1-4f29-89d9-3ff50002babb\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " Jun 14 14:51:39.275517 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.275390 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert\") pod \"be752f5a-42d1-4f29-89d9-3ff50002babb\" (UID: \"be752f5a-42d1-4f29-89d9-3ff50002babb\") " Jun 14 14:51:39.277494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.277469 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "be752f5a-42d1-4f29-89d9-3ff50002babb" (UID: "be752f5a-42d1-4f29-89d9-3ff50002babb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:51:39.277624 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.277501 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be752f5a-42d1-4f29-89d9-3ff50002babb-kube-api-access-bckhl" (OuterVolumeSpecName: "kube-api-access-bckhl") pod "be752f5a-42d1-4f29-89d9-3ff50002babb" (UID: "be752f5a-42d1-4f29-89d9-3ff50002babb"). InnerVolumeSpecName "kube-api-access-bckhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:51:39.376532 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.376476 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bckhl\" (UniqueName: \"kubernetes.io/projected/be752f5a-42d1-4f29-89d9-3ff50002babb-kube-api-access-bckhl\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:51:39.376532 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.376497 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be752f5a-42d1-4f29-89d9-3ff50002babb-webhook-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:51:39.875443 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.875415 2549 generic.go:356] "Generic (PLEG): container finished" podID="be752f5a-42d1-4f29-89d9-3ff50002babb" containerID="9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594" exitCode=0 Jun 14 14:51:39.875821 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.875451 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d57886496-nj4nn" Jun 14 14:51:39.875821 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.875476 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d57886496-nj4nn" event={"ID":"be752f5a-42d1-4f29-89d9-3ff50002babb","Type":"ContainerDied","Data":"9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594"} Jun 14 14:51:39.875821 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.875514 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d57886496-nj4nn" event={"ID":"be752f5a-42d1-4f29-89d9-3ff50002babb","Type":"ContainerDied","Data":"63e16dbbd3dddeffc07aa65ffca57a563037ae3e5929ab4cd7e1146ec7e12f6e"} Jun 14 14:51:39.875821 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.875537 2549 scope.go:117] "RemoveContainer" containerID="9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594" Jun 14 14:51:39.884644 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.884437 2549 scope.go:117] "RemoveContainer" containerID="9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594" Jun 14 14:51:39.884928 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:39.884846 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594\": container with ID starting with 9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594 not found: ID does not exist" containerID="9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594" Jun 14 14:51:39.884928 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.884901 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594"} err="failed to get container status \"9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594\": rpc error: code = NotFound desc = could not find container \"9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594\": container with ID starting with 9f9bb39153bb3dcde1ff8abf031b328a098ca22eb5201b5e7ea040a2d709b594 not found: ID does not exist" Jun 14 14:51:39.896382 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.896360 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d57886496-nj4nn"] Jun 14 14:51:39.899702 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:39.899683 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d57886496-nj4nn"] Jun 14 14:51:41.177864 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:41.177829 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be752f5a-42d1-4f29-89d9-3ff50002babb" path="/var/lib/kubelet/pods/be752f5a-42d1-4f29-89d9-3ff50002babb/volumes" Jun 14 14:51:58.959314 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.959275 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-66f4c5c6bb-2htzf"] Jun 14 14:51:58.959875 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.959605 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be752f5a-42d1-4f29-89d9-3ff50002babb" containerName="manager" Jun 14 14:51:58.959875 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.959617 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="be752f5a-42d1-4f29-89d9-3ff50002babb" containerName="manager" Jun 14 14:51:58.959875 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.959677 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="be752f5a-42d1-4f29-89d9-3ff50002babb" containerName="manager" Jun 14 14:51:58.963196 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.963178 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:58.965715 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.965687 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 14:51:58.965834 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.965697 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w886h\"" Jun 14 14:51:58.971395 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:58.971370 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-66f4c5c6bb-2htzf"] Jun 14 14:51:59.014790 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.014766 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/231b2be0-a556-444b-95dc-6d23b12fa4bf-maas-api-tls\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.014898 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.014798 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/231b2be0-a556-444b-95dc-6d23b12fa4bf-openshift-service-ca\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.014898 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.014822 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7nx\" (UniqueName: \"kubernetes.io/projected/231b2be0-a556-444b-95dc-6d23b12fa4bf-kube-api-access-2n7nx\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.115984 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.115957 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/231b2be0-a556-444b-95dc-6d23b12fa4bf-maas-api-tls\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.116102 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.115995 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/231b2be0-a556-444b-95dc-6d23b12fa4bf-openshift-service-ca\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.116102 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.116018 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7nx\" (UniqueName: \"kubernetes.io/projected/231b2be0-a556-444b-95dc-6d23b12fa4bf-kube-api-access-2n7nx\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.116172 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:59.116156 2549 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 14 14:51:59.116226 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:51:59.116216 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231b2be0-a556-444b-95dc-6d23b12fa4bf-maas-api-tls podName:231b2be0-a556-444b-95dc-6d23b12fa4bf nodeName:}" failed. No retries permitted until 2026-06-14 14:51:59.616200035 +0000 UTC m=+744.969577971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/231b2be0-a556-444b-95dc-6d23b12fa4bf-maas-api-tls") pod "maas-api-66f4c5c6bb-2htzf" (UID: "231b2be0-a556-444b-95dc-6d23b12fa4bf") : secret "maas-api-serving-cert" not found Jun 14 14:51:59.116610 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.116594 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/231b2be0-a556-444b-95dc-6d23b12fa4bf-openshift-service-ca\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.128958 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.128939 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7nx\" (UniqueName: \"kubernetes.io/projected/231b2be0-a556-444b-95dc-6d23b12fa4bf-kube-api-access-2n7nx\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.491254 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.491219 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-msr74"] Jun 14 14:51:59.495078 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.495058 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:51:59.497823 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.497805 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 14:51:59.498401 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.498386 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bxjmp\"" Jun 14 14:51:59.505063 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.505039 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-msr74"] Jun 14 14:51:59.520108 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.520079 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dms85\" (UniqueName: \"kubernetes.io/projected/cb90cd04-85a9-448c-b8bc-f288df53ef6d-kube-api-access-dms85\") pod \"payload-pre-processing-579785bc64-msr74\" (UID: \"cb90cd04-85a9-448c-b8bc-f288df53ef6d\") " pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:51:59.549144 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.549122 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-h4dbk"] Jun 14 14:51:59.552631 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.552617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:51:59.562672 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.562651 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-h4dbk"] Jun 14 14:51:59.620702 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.620677 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dms85\" (UniqueName: \"kubernetes.io/projected/cb90cd04-85a9-448c-b8bc-f288df53ef6d-kube-api-access-dms85\") pod \"payload-pre-processing-579785bc64-msr74\" (UID: \"cb90cd04-85a9-448c-b8bc-f288df53ef6d\") " pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:51:59.620836 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.620713 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snv2l\" (UniqueName: \"kubernetes.io/projected/8e289040-63b6-4251-bda6-32c7a339ced1-kube-api-access-snv2l\") pod \"payload-processing-699b6cd6c-h4dbk\" (UID: \"8e289040-63b6-4251-bda6-32c7a339ced1\") " pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:51:59.620836 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.620758 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/231b2be0-a556-444b-95dc-6d23b12fa4bf-maas-api-tls\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.623395 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.623372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/231b2be0-a556-444b-95dc-6d23b12fa4bf-maas-api-tls\") pod \"maas-api-66f4c5c6bb-2htzf\" (UID: \"231b2be0-a556-444b-95dc-6d23b12fa4bf\") " pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.630265 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.630247 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dms85\" (UniqueName: \"kubernetes.io/projected/cb90cd04-85a9-448c-b8bc-f288df53ef6d-kube-api-access-dms85\") pod \"payload-pre-processing-579785bc64-msr74\" (UID: \"cb90cd04-85a9-448c-b8bc-f288df53ef6d\") " pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:51:59.722123 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.722081 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snv2l\" (UniqueName: \"kubernetes.io/projected/8e289040-63b6-4251-bda6-32c7a339ced1-kube-api-access-snv2l\") pod \"payload-processing-699b6cd6c-h4dbk\" (UID: \"8e289040-63b6-4251-bda6-32c7a339ced1\") " pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:51:59.730166 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.730144 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snv2l\" (UniqueName: \"kubernetes.io/projected/8e289040-63b6-4251-bda6-32c7a339ced1-kube-api-access-snv2l\") pod \"payload-processing-699b6cd6c-h4dbk\" (UID: \"8e289040-63b6-4251-bda6-32c7a339ced1\") " pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:51:59.807222 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.807145 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:51:59.862803 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.862771 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:51:59.874067 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.873794 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:51:59.948539 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.948208 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-msr74"] Jun 14 14:51:59.951678 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:51:59.951641 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb90cd04_85a9_448c_b8bc_f288df53ef6d.slice/crio-720cac8448fe00b8e557046183478344cf9998747bcdd5f1c976cc16251105c0 WatchSource:0}: Error finding container 720cac8448fe00b8e557046183478344cf9998747bcdd5f1c976cc16251105c0: Status 404 returned error can't find the container with id 720cac8448fe00b8e557046183478344cf9998747bcdd5f1c976cc16251105c0 Jun 14 14:51:59.973102 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:51:59.971798 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" event={"ID":"cb90cd04-85a9-448c-b8bc-f288df53ef6d","Type":"ContainerStarted","Data":"720cac8448fe00b8e557046183478344cf9998747bcdd5f1c976cc16251105c0"} Jun 14 14:52:00.029000 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:00.028956 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-h4dbk"] Jun 14 14:52:00.034294 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:52:00.034269 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e289040_63b6_4251_bda6_32c7a339ced1.slice/crio-e488fbf3b14d89a144fb9f121a77e1939856b008fe505736a3d3a8b37820ca0f WatchSource:0}: Error finding container e488fbf3b14d89a144fb9f121a77e1939856b008fe505736a3d3a8b37820ca0f: Status 404 returned error can't find the container with id e488fbf3b14d89a144fb9f121a77e1939856b008fe505736a3d3a8b37820ca0f Jun 14 14:52:00.041340 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:00.041320 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-66f4c5c6bb-2htzf"] Jun 14 14:52:00.043817 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:52:00.043758 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231b2be0_a556_444b_95dc_6d23b12fa4bf.slice/crio-6000b4c67cb80039facff3bebc96b0356f593720fba0bde10310c679a214178c WatchSource:0}: Error finding container 6000b4c67cb80039facff3bebc96b0356f593720fba0bde10310c679a214178c: Status 404 returned error can't find the container with id 6000b4c67cb80039facff3bebc96b0356f593720fba0bde10310c679a214178c Jun 14 14:52:00.983731 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:00.983657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" event={"ID":"8e289040-63b6-4251-bda6-32c7a339ced1","Type":"ContainerStarted","Data":"e488fbf3b14d89a144fb9f121a77e1939856b008fe505736a3d3a8b37820ca0f"} Jun 14 14:52:00.985229 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:00.985199 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" event={"ID":"231b2be0-a556-444b-95dc-6d23b12fa4bf","Type":"ContainerStarted","Data":"6000b4c67cb80039facff3bebc96b0356f593720fba0bde10310c679a214178c"} Jun 14 14:52:04.003675 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.003602 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" event={"ID":"8e289040-63b6-4251-bda6-32c7a339ced1","Type":"ContainerStarted","Data":"cdca708c6733d5f48f76f50ffe758e3a954cbef998bdb305155cf14e9717e051"} Jun 14 14:52:04.004174 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.003779 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:52:04.005846 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.005301 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" event={"ID":"231b2be0-a556-444b-95dc-6d23b12fa4bf","Type":"ContainerStarted","Data":"a1057aef166dafdb8b46f4962e12d6cfc11670d8850ea396219651c37a91e1be"} Jun 14 14:52:04.005846 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.005787 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:52:04.008662 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.008148 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" event={"ID":"cb90cd04-85a9-448c-b8bc-f288df53ef6d","Type":"ContainerStarted","Data":"fdb5dc0a0c9a36b11cfb9b6d6acb7f64c99d3da74327753c4d3e7e5457740850"} Jun 14 14:52:04.008662 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.008595 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:52:04.036557 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.036499 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" podStartSLOduration=1.512507325 podStartE2EDuration="5.036480361s" totalImagesPullingTime="3.523973036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:52:04.018719922 +0000 UTC m=+749.372097871" watchObservedRunningTime="2026-06-14 14:52:04.036480361 +0000 UTC m=+749.389858311" Jun 14 14:52:04.038788 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.038740 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" podStartSLOduration=2.599933424 podStartE2EDuration="6.038723695s" totalImagesPullingTime="3.438790271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:52:04.035861212 +0000 UTC m=+749.389239193" watchObservedRunningTime="2026-06-14 14:52:04.038723695 +0000 UTC m=+749.392101646" Jun 14 14:52:04.051500 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:04.051468 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" podStartSLOduration=1.4403016960000001 podStartE2EDuration="5.051455466s" totalImagesPullingTime="3.61115377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:52:04.049706361 +0000 UTC m=+749.403084310" watchObservedRunningTime="2026-06-14 14:52:04.051455466 +0000 UTC m=+749.404833414" Jun 14 14:52:07.025594 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:07.025496 2549 generic.go:356] "Generic (PLEG): container finished" podID="f82e9863-d2df-4bcd-8316-de79b970f581" containerID="c83ccd1e68d82971437a184520dba362bb276d060895ac6ffa076e9844f6c1e9" exitCode=0 Jun 14 14:52:07.025594 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:07.025585 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" event={"ID":"f82e9863-d2df-4bcd-8316-de79b970f581","Type":"ContainerDied","Data":"c83ccd1e68d82971437a184520dba362bb276d060895ac6ffa076e9844f6c1e9"} Jun 14 14:52:07.026003 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:07.025971 2549 scope.go:117] "RemoveContainer" containerID="c83ccd1e68d82971437a184520dba362bb276d060895ac6ffa076e9844f6c1e9" Jun 14 14:52:07.026949 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:07.026921 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:52:07.027029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:07.026989 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:52:07.027029 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:07.027022 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 14:52:08.034812 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:08.034774 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" event={"ID":"f82e9863-d2df-4bcd-8316-de79b970f581","Type":"ContainerStarted","Data":"210fdf1aeef61959c79cc1c360845dabacaca28f051567f3c1cdbb3701291ecd"} Jun 14 14:52:08.928607 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:08.927972 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:52:08.929099 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:08.929073 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-l8k94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 14 14:52:08.929205 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:08.929123 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" podUID="f82e9863-d2df-4bcd-8316-de79b970f581" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 14 14:52:09.927988 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:09.927943 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-l8k94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 14 14:52:09.928481 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:09.928007 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" podUID="f82e9863-d2df-4bcd-8316-de79b970f581" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 14 14:52:10.927673 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:10.927624 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-l8k94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 14 14:52:10.927887 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:10.927695 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" podUID="f82e9863-d2df-4bcd-8316-de79b970f581" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 14 14:52:11.031660 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:11.031628 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-66f4c5c6bb-2htzf" Jun 14 14:52:11.931552 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:11.931521 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:52:11.931946 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:11.931925 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:52:11.932687 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:11.932671 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-l8k94" Jun 14 14:52:15.016156 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:15.016127 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-h4dbk" Jun 14 14:52:16.022746 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:16.022717 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-msr74" Jun 14 14:52:51.845732 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:51.845697 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64767d9cdf-fbdf8"] Jun 14 14:52:51.846250 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:51.845887 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" podUID="1a1bf2c4-382c-4646-a313-923906273af9" containerName="authorino" containerID="cri-o://15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495" gracePeriod=30 Jun 14 14:52:52.096914 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.096860 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:52:52.158533 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.158506 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkbfk\" (UniqueName: \"kubernetes.io/projected/1a1bf2c4-382c-4646-a313-923906273af9-kube-api-access-fkbfk\") pod \"1a1bf2c4-382c-4646-a313-923906273af9\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " Jun 14 14:52:52.158758 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.158592 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a1bf2c4-382c-4646-a313-923906273af9-tls-cert\") pod \"1a1bf2c4-382c-4646-a313-923906273af9\" (UID: \"1a1bf2c4-382c-4646-a313-923906273af9\") " Jun 14 14:52:52.160604 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.160528 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a1bf2c4-382c-4646-a313-923906273af9-kube-api-access-fkbfk" (OuterVolumeSpecName: "kube-api-access-fkbfk") pod "1a1bf2c4-382c-4646-a313-923906273af9" (UID: "1a1bf2c4-382c-4646-a313-923906273af9"). InnerVolumeSpecName "kube-api-access-fkbfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:52:52.168004 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.167979 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a1bf2c4-382c-4646-a313-923906273af9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1a1bf2c4-382c-4646-a313-923906273af9" (UID: "1a1bf2c4-382c-4646-a313-923906273af9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:52:52.252539 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.252499 2549 generic.go:356] "Generic (PLEG): container finished" podID="1a1bf2c4-382c-4646-a313-923906273af9" containerID="15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495" exitCode=0 Jun 14 14:52:52.252739 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.252547 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" Jun 14 14:52:52.252739 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.252589 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" event={"ID":"1a1bf2c4-382c-4646-a313-923906273af9","Type":"ContainerDied","Data":"15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495"} Jun 14 14:52:52.252739 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.252642 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64767d9cdf-fbdf8" event={"ID":"1a1bf2c4-382c-4646-a313-923906273af9","Type":"ContainerDied","Data":"dd43a6eed6aa2eb88af2bb5fccefb2718d86fcc944ba1f57cf0adc429d4b7b4b"} Jun 14 14:52:52.252739 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.252662 2549 scope.go:117] "RemoveContainer" containerID="15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495" Jun 14 14:52:52.261615 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.261593 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a1bf2c4-382c-4646-a313-923906273af9-tls-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:52:52.261752 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.261618 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkbfk\" (UniqueName: \"kubernetes.io/projected/1a1bf2c4-382c-4646-a313-923906273af9-kube-api-access-fkbfk\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:52:52.265273 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.265254 2549 scope.go:117] "RemoveContainer" containerID="15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495" Jun 14 14:52:52.265530 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:52:52.265510 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495\": container with ID starting with 15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495 not found: ID does not exist" containerID="15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495" Jun 14 14:52:52.265615 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.265538 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495"} err="failed to get container status \"15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495\": rpc error: code = NotFound desc = could not find container \"15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495\": container with ID starting with 15c573543d981df8ae46baf2cc73ccbe1d45c19d49b68add91734cfa07629495 not found: ID does not exist" Jun 14 14:52:52.276827 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.276808 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64767d9cdf-fbdf8"] Jun 14 14:52:52.280235 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:52.280212 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64767d9cdf-fbdf8"] Jun 14 14:52:53.178207 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:52:53.178172 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a1bf2c4-382c-4646-a313-923906273af9" path="/var/lib/kubelet/pods/1a1bf2c4-382c-4646-a313-923906273af9/volumes" Jun 14 14:53:02.194067 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.193992 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn"] Jun 14 14:53:02.194401 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.194388 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a1bf2c4-382c-4646-a313-923906273af9" containerName="authorino" Jun 14 14:53:02.194460 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.194403 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a1bf2c4-382c-4646-a313-923906273af9" containerName="authorino" Jun 14 14:53:02.194460 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.194457 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a1bf2c4-382c-4646-a313-923906273af9" containerName="authorino" Jun 14 14:53:02.197751 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.197729 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.200174 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.200151 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 14:53:02.201280 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.201259 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 14 14:53:02.201392 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.201261 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 14:53:02.201463 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.201351 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wb6w7\"" Jun 14 14:53:02.206847 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.206826 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn"] Jun 14 14:53:02.343330 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.343299 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.343501 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.343350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.343501 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.343414 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.343501 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.343446 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.343501 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.343478 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c21b6520-b24d-4d3e-a07f-07dc40b49648-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.343698 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.343503 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56j2f\" (UniqueName: \"kubernetes.io/projected/c21b6520-b24d-4d3e-a07f-07dc40b49648-kube-api-access-56j2f\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.444599 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444502 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.444599 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444536 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.444599 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c21b6520-b24d-4d3e-a07f-07dc40b49648-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.444864 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444612 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56j2f\" (UniqueName: \"kubernetes.io/projected/c21b6520-b24d-4d3e-a07f-07dc40b49648-kube-api-access-56j2f\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.444864 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444680 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.444864 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444722 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.445019 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.444982 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.445059 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.445039 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.445094 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.445064 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.446802 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.446780 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c21b6520-b24d-4d3e-a07f-07dc40b49648-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.447035 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.447019 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c21b6520-b24d-4d3e-a07f-07dc40b49648-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.452108 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.452087 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56j2f\" (UniqueName: \"kubernetes.io/projected/c21b6520-b24d-4d3e-a07f-07dc40b49648-kube-api-access-56j2f\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn\" (UID: \"c21b6520-b24d-4d3e-a07f-07dc40b49648\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.509544 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.509518 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:02.641444 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.641417 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn"] Jun 14 14:53:02.645261 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:53:02.645230 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21b6520_b24d_4d3e_a07f_07dc40b49648.slice/crio-074f8c5b8fec9f48303004ab3b49dc0f80cd25dbdf66b61e002343f6e0a85b84 WatchSource:0}: Error finding container 074f8c5b8fec9f48303004ab3b49dc0f80cd25dbdf66b61e002343f6e0a85b84: Status 404 returned error can't find the container with id 074f8c5b8fec9f48303004ab3b49dc0f80cd25dbdf66b61e002343f6e0a85b84 Jun 14 14:53:02.648506 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:02.647797 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:53:03.306680 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:03.306646 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" event={"ID":"c21b6520-b24d-4d3e-a07f-07dc40b49648","Type":"ContainerStarted","Data":"074f8c5b8fec9f48303004ab3b49dc0f80cd25dbdf66b61e002343f6e0a85b84"} Jun 14 14:53:07.330886 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:07.330854 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" event={"ID":"c21b6520-b24d-4d3e-a07f-07dc40b49648","Type":"ContainerStarted","Data":"7f659c455da1cd1dbf396fae998ba50899a50afa9735f2b20376da69b5a276f3"} Jun 14 14:53:14.370961 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:14.370927 2549 generic.go:356] "Generic (PLEG): container finished" podID="c21b6520-b24d-4d3e-a07f-07dc40b49648" containerID="7f659c455da1cd1dbf396fae998ba50899a50afa9735f2b20376da69b5a276f3" exitCode=0 Jun 14 14:53:14.371336 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:14.370997 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" event={"ID":"c21b6520-b24d-4d3e-a07f-07dc40b49648","Type":"ContainerDied","Data":"7f659c455da1cd1dbf396fae998ba50899a50afa9735f2b20376da69b5a276f3"} Jun 14 14:53:16.381736 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:16.381702 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" event={"ID":"c21b6520-b24d-4d3e-a07f-07dc40b49648","Type":"ContainerStarted","Data":"8c48a8ace6bacbec2cfa16755bc96d2c16a38714ba2afc62f85ae326e6d337a9"} Jun 14 14:53:16.399983 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:16.399937 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" podStartSLOduration=1.987995974 podStartE2EDuration="14.399921701s" totalImagesPullingTime="4.626517854s" totalInitContainerRuntime="7.785407873s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:53:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:53:16.397935777 +0000 UTC m=+821.751313727" watchObservedRunningTime="2026-06-14 14:53:16.399921701 +0000 UTC m=+821.753299690" Jun 14 14:53:22.510494 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:22.510452 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:22.510908 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:22.510529 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:22.523187 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:22.523163 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:23.433479 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:23.433452 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn" Jun 14 14:53:26.903940 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.903904 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv"] Jun 14 14:53:26.907529 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.907509 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:26.910502 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.910485 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 14:53:26.925509 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.925486 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv"] Jun 14 14:53:26.949516 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.949490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:26.949758 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.949729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6pz\" (UniqueName: \"kubernetes.io/projected/8b5dc535-3d2f-40d7-8812-c89a07389d9c-kube-api-access-qz6pz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:26.949863 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.949799 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:26.949863 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.949831 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dc535-3d2f-40d7-8812-c89a07389d9c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:26.949959 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.949908 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:26.949959 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:26.949954 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051110 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051075 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051110 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dc535-3d2f-40d7-8812-c89a07389d9c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051158 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051267 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051346 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6pz\" (UniqueName: \"kubernetes.io/projected/8b5dc535-3d2f-40d7-8812-c89a07389d9c-kube-api-access-qz6pz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051758 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051728 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051892 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051786 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.051892 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.051830 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.053809 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.053784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b5dc535-3d2f-40d7-8812-c89a07389d9c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.053947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.053927 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dc535-3d2f-40d7-8812-c89a07389d9c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.065942 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.065922 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6pz\" (UniqueName: \"kubernetes.io/projected/8b5dc535-3d2f-40d7-8812-c89a07389d9c-kube-api-access-qz6pz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-djtgv\" (UID: \"8b5dc535-3d2f-40d7-8812-c89a07389d9c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.220254 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.220223 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:27.350885 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.350856 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv"] Jun 14 14:53:27.353063 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:53:27.353025 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5dc535_3d2f_40d7_8812_c89a07389d9c.slice/crio-0e916d048eb67056f7ece4ae952cf7994fc421b39f7640dec0a524c0ca50d040 WatchSource:0}: Error finding container 0e916d048eb67056f7ece4ae952cf7994fc421b39f7640dec0a524c0ca50d040: Status 404 returned error can't find the container with id 0e916d048eb67056f7ece4ae952cf7994fc421b39f7640dec0a524c0ca50d040 Jun 14 14:53:27.441924 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.441890 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" event={"ID":"8b5dc535-3d2f-40d7-8812-c89a07389d9c","Type":"ContainerStarted","Data":"2ec86133b7732d21fd5cd8b89a45b5a43a0fc8cd3d3c25c3fbd5b5ec0675ef22"} Jun 14 14:53:27.442070 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:27.441947 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" event={"ID":"8b5dc535-3d2f-40d7-8812-c89a07389d9c","Type":"ContainerStarted","Data":"0e916d048eb67056f7ece4ae952cf7994fc421b39f7640dec0a524c0ca50d040"} Jun 14 14:53:29.454459 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:29.454424 2549 generic.go:356] "Generic (PLEG): container finished" podID="8b5dc535-3d2f-40d7-8812-c89a07389d9c" containerID="2ec86133b7732d21fd5cd8b89a45b5a43a0fc8cd3d3c25c3fbd5b5ec0675ef22" exitCode=0 Jun 14 14:53:29.454848 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:29.454504 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" event={"ID":"8b5dc535-3d2f-40d7-8812-c89a07389d9c","Type":"ContainerDied","Data":"2ec86133b7732d21fd5cd8b89a45b5a43a0fc8cd3d3c25c3fbd5b5ec0675ef22"} Jun 14 14:53:30.460288 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:30.460255 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" event={"ID":"8b5dc535-3d2f-40d7-8812-c89a07389d9c","Type":"ContainerStarted","Data":"45bfc315d41f3a1071f73cf36d2ccd6061e14fb51f2781f8f2587870b3c70e1c"} Jun 14 14:53:30.479551 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:30.479505 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" podStartSLOduration=2.630419021 podStartE2EDuration="4.479491509s" totalImagesPullingTime="359.941676ms" totalInitContainerRuntime="1.489130812s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:53:30.476787546 +0000 UTC m=+835.830165495" watchObservedRunningTime="2026-06-14 14:53:30.479491509 +0000 UTC m=+835.832869458" Jun 14 14:53:37.220869 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:37.220842 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:37.221313 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:37.220896 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:37.233459 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:37.233437 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:37.504734 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:37.504656 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-djtgv" Jun 14 14:53:46.397340 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.397279 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x"] Jun 14 14:53:46.402731 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.402705 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.406284 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.406246 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 14 14:53:46.414795 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.414765 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x"] Jun 14 14:53:46.507316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.507283 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e9174c-2599-4299-969b-9af67ae79e52-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.507316 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.507314 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.507510 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.507343 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.507510 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.507381 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.507510 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.507414 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfrx\" (UniqueName: \"kubernetes.io/projected/d9e9174c-2599-4299-969b-9af67ae79e52-kube-api-access-jlfrx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.507708 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.507519 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.608845 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.608819 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.608973 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.608863 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e9174c-2599-4299-969b-9af67ae79e52-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.608973 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.608880 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.608973 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.608901 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.609107 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.609011 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.609107 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.609079 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfrx\" (UniqueName: \"kubernetes.io/projected/d9e9174c-2599-4299-969b-9af67ae79e52-kube-api-access-jlfrx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.609268 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.609249 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.609337 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.609308 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.609448 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.609428 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.611356 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.611332 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e9174c-2599-4299-969b-9af67ae79e52-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.611813 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.611794 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e9174c-2599-4299-969b-9af67ae79e52-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.618081 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.618054 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfrx\" (UniqueName: \"kubernetes.io/projected/d9e9174c-2599-4299-969b-9af67ae79e52-kube-api-access-jlfrx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x\" (UID: \"d9e9174c-2599-4299-969b-9af67ae79e52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.716410 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.716386 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:46.867669 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:46.867641 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x"] Jun 14 14:53:46.869825 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:53:46.869796 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e9174c_2599_4299_969b_9af67ae79e52.slice/crio-207c44cfc28884a43d424863e3090c05839fe0c8967fdbdb369bd3a621f8bd67 WatchSource:0}: Error finding container 207c44cfc28884a43d424863e3090c05839fe0c8967fdbdb369bd3a621f8bd67: Status 404 returned error can't find the container with id 207c44cfc28884a43d424863e3090c05839fe0c8967fdbdb369bd3a621f8bd67 Jun 14 14:53:47.541604 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:47.541545 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" event={"ID":"d9e9174c-2599-4299-969b-9af67ae79e52","Type":"ContainerStarted","Data":"fed9bff3456bf30725b752e3908e17ee5efdc5feccc84d626cb2942bd76b37df"} Jun 14 14:53:47.541947 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:47.541630 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" event={"ID":"d9e9174c-2599-4299-969b-9af67ae79e52","Type":"ContainerStarted","Data":"207c44cfc28884a43d424863e3090c05839fe0c8967fdbdb369bd3a621f8bd67"} Jun 14 14:53:51.561016 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:51.560987 2549 generic.go:356] "Generic (PLEG): container finished" podID="d9e9174c-2599-4299-969b-9af67ae79e52" containerID="fed9bff3456bf30725b752e3908e17ee5efdc5feccc84d626cb2942bd76b37df" exitCode=0 Jun 14 14:53:51.561344 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:51.561063 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" event={"ID":"d9e9174c-2599-4299-969b-9af67ae79e52","Type":"ContainerDied","Data":"fed9bff3456bf30725b752e3908e17ee5efdc5feccc84d626cb2942bd76b37df"} Jun 14 14:53:52.567575 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:52.567532 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" event={"ID":"d9e9174c-2599-4299-969b-9af67ae79e52","Type":"ContainerStarted","Data":"30e636e9e9abb7a0de8393db78e19a11de25f5ab6eba6d73acc0a4e39c37c5da"} Jun 14 14:53:52.591536 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:52.591485 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" podStartSLOduration=2.28186156 podStartE2EDuration="6.59146685s" totalImagesPullingTime="160.467606ms" totalInitContainerRuntime="4.149137684s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:53:52.589314156 +0000 UTC m=+857.942692143" watchObservedRunningTime="2026-06-14 14:53:52.59146685 +0000 UTC m=+857.944844839" Jun 14 14:53:56.716943 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:56.716911 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:56.717381 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:56.717011 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:56.729350 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:56.729328 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:53:57.601363 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:53:57.601337 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x" Jun 14 14:54:19.745427 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.745389 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7"] Jun 14 14:54:19.749049 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.749032 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.751429 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.751406 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 14:54:19.785331 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.785305 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7"] Jun 14 14:54:19.888215 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.888176 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.888431 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.888311 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.888431 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.888347 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.888431 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.888402 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdp5q\" (UniqueName: \"kubernetes.io/projected/9cd92f50-b36d-42c6-a068-1a90ae92939d-kube-api-access-cdp5q\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.888431 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.888429 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.888635 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.888464 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd92f50-b36d-42c6-a068-1a90ae92939d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989193 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989330 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989381 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989326 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp5q\" (UniqueName: \"kubernetes.io/projected/9cd92f50-b36d-42c6-a068-1a90ae92939d-kube-api-access-cdp5q\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989381 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989368 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989471 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989406 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd92f50-b36d-42c6-a068-1a90ae92939d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989471 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989438 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989587 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989513 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989650 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989606 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.989796 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.989778 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.991638 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.991613 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cd92f50-b36d-42c6-a068-1a90ae92939d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.991912 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.991895 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cd92f50-b36d-42c6-a068-1a90ae92939d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:19.999294 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:19.999226 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdp5q\" (UniqueName: \"kubernetes.io/projected/9cd92f50-b36d-42c6-a068-1a90ae92939d-kube-api-access-cdp5q\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-d96s7\" (UID: \"9cd92f50-b36d-42c6-a068-1a90ae92939d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:20.059212 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:20.059187 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:54:20.212537 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:20.212515 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7"] Jun 14 14:54:20.214177 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:54:20.214145 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd92f50_b36d_42c6_a068_1a90ae92939d.slice/crio-91b239c1a0d30ed35a355187c145b945ad8c0a72c9d9168808b7b841ecf39dd9 WatchSource:0}: Error finding container 91b239c1a0d30ed35a355187c145b945ad8c0a72c9d9168808b7b841ecf39dd9: Status 404 returned error can't find the container with id 91b239c1a0d30ed35a355187c145b945ad8c0a72c9d9168808b7b841ecf39dd9 Jun 14 14:54:20.701970 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:20.701934 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" event={"ID":"9cd92f50-b36d-42c6-a068-1a90ae92939d","Type":"ContainerStarted","Data":"affc596d99860a07b710ab31af15d7018c69c20e76c3277a76ae01386d6de3b6"} Jun 14 14:54:20.702126 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:20.701982 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" event={"ID":"9cd92f50-b36d-42c6-a068-1a90ae92939d","Type":"ContainerStarted","Data":"91b239c1a0d30ed35a355187c145b945ad8c0a72c9d9168808b7b841ecf39dd9"} Jun 14 14:54:35.171651 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:35.171626 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:54:35.176378 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:54:35.176351 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:56:40.357134 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:40.357100 2549 generic.go:356] "Generic (PLEG): container finished" podID="9cd92f50-b36d-42c6-a068-1a90ae92939d" containerID="affc596d99860a07b710ab31af15d7018c69c20e76c3277a76ae01386d6de3b6" exitCode=0 Jun 14 14:56:40.357504 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:40.357172 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" event={"ID":"9cd92f50-b36d-42c6-a068-1a90ae92939d","Type":"ContainerDied","Data":"affc596d99860a07b710ab31af15d7018c69c20e76c3277a76ae01386d6de3b6"} Jun 14 14:56:41.363632 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:41.363594 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" event={"ID":"9cd92f50-b36d-42c6-a068-1a90ae92939d","Type":"ContainerStarted","Data":"f503e675f0f1a46752268367fdd508397d210247f9e561a7b144a7b536ae5d31"} Jun 14 14:56:41.382504 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:41.382446 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" podStartSLOduration=2.775803774 podStartE2EDuration="2m22.382430397s" totalImagesPullingTime="166.158097ms" totalInitContainerRuntime="2m19.440468526s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:41.382352123 +0000 UTC m=+1026.735730071" watchObservedRunningTime="2026-06-14 14:56:41.382430397 +0000 UTC m=+1026.735808367" Jun 14 14:56:50.059391 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:50.059357 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:56:50.059883 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:50.059411 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:56:50.071790 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:50.071767 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:56:50.416932 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:56:50.416872 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-d96s7" Jun 14 14:58:22.537165 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.537135 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659b665964-slzwm"] Jun 14 14:58:22.537670 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.537344 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-659b665964-slzwm" podUID="c4ed1369-e539-463b-a31f-a90695f6adc8" containerName="manager" containerID="cri-o://c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3" gracePeriod=30 Jun 14 14:58:22.788964 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.788905 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:58:22.849602 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.846948 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ed1369-e539-463b-a31f-a90695f6adc8-webhook-cert\") pod \"c4ed1369-e539-463b-a31f-a90695f6adc8\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " Jun 14 14:58:22.849602 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.847066 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjtc4\" (UniqueName: \"kubernetes.io/projected/c4ed1369-e539-463b-a31f-a90695f6adc8-kube-api-access-qjtc4\") pod \"c4ed1369-e539-463b-a31f-a90695f6adc8\" (UID: \"c4ed1369-e539-463b-a31f-a90695f6adc8\") " Jun 14 14:58:22.852665 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.852627 2549 generic.go:356] "Generic (PLEG): container finished" podID="c4ed1369-e539-463b-a31f-a90695f6adc8" containerID="c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3" exitCode=0 Jun 14 14:58:22.852814 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.852698 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659b665964-slzwm" Jun 14 14:58:22.852814 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.852706 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659b665964-slzwm" event={"ID":"c4ed1369-e539-463b-a31f-a90695f6adc8","Type":"ContainerDied","Data":"c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3"} Jun 14 14:58:22.852973 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.852944 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ed1369-e539-463b-a31f-a90695f6adc8-kube-api-access-qjtc4" (OuterVolumeSpecName: "kube-api-access-qjtc4") pod "c4ed1369-e539-463b-a31f-a90695f6adc8" (UID: "c4ed1369-e539-463b-a31f-a90695f6adc8"). InnerVolumeSpecName "kube-api-access-qjtc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:58:22.853053 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.852829 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659b665964-slzwm" event={"ID":"c4ed1369-e539-463b-a31f-a90695f6adc8","Type":"ContainerDied","Data":"5db42556407d3b1c14e9dcca6aafb0d4fce336df1abd8d58407bee4d67443fd0"} Jun 14 14:58:22.853110 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.853056 2549 scope.go:117] "RemoveContainer" containerID="c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3" Jun 14 14:58:22.855270 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.855242 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ed1369-e539-463b-a31f-a90695f6adc8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4ed1369-e539-463b-a31f-a90695f6adc8" (UID: "c4ed1369-e539-463b-a31f-a90695f6adc8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:58:22.870722 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.870698 2549 scope.go:117] "RemoveContainer" containerID="c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3" Jun 14 14:58:22.870986 ip-10-0-136-235 kubenswrapper[2549]: E0614 14:58:22.870968 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3\": container with ID starting with c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3 not found: ID does not exist" containerID="c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3" Jun 14 14:58:22.871051 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.870997 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3"} err="failed to get container status \"c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3\": rpc error: code = NotFound desc = could not find container \"c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3\": container with ID starting with c33e0069fc61dcbf10f389185921cb44b28ea93acdd59de897089a49bc89abf3 not found: ID does not exist" Jun 14 14:58:22.948509 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.948486 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ed1369-e539-463b-a31f-a90695f6adc8-webhook-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:58:22.948509 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:22.948509 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjtc4\" (UniqueName: \"kubernetes.io/projected/c4ed1369-e539-463b-a31f-a90695f6adc8-kube-api-access-qjtc4\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 14:58:23.190706 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:23.190675 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659b665964-slzwm"] Jun 14 14:58:23.196009 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:23.195986 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-659b665964-slzwm"] Jun 14 14:58:24.053322 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.053289 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659b665964-fdwlj"] Jun 14 14:58:24.053704 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.053666 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ed1369-e539-463b-a31f-a90695f6adc8" containerName="manager" Jun 14 14:58:24.053704 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.053678 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ed1369-e539-463b-a31f-a90695f6adc8" containerName="manager" Jun 14 14:58:24.053785 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.053734 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ed1369-e539-463b-a31f-a90695f6adc8" containerName="manager" Jun 14 14:58:24.057928 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.057912 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.061331 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.061312 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bw8qn\"" Jun 14 14:58:24.061984 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.061960 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 14:58:24.062377 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.062360 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 14:58:24.081523 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.081493 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659b665964-fdwlj"] Jun 14 14:58:24.158764 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.158730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjj4l\" (UniqueName: \"kubernetes.io/projected/b5efc959-52aa-459b-bb8b-2d04b6eebef1-kube-api-access-rjj4l\") pod \"maas-controller-659b665964-fdwlj\" (UID: \"b5efc959-52aa-459b-bb8b-2d04b6eebef1\") " pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.158944 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.158858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5efc959-52aa-459b-bb8b-2d04b6eebef1-webhook-cert\") pod \"maas-controller-659b665964-fdwlj\" (UID: \"b5efc959-52aa-459b-bb8b-2d04b6eebef1\") " pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.260243 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.260202 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjj4l\" (UniqueName: \"kubernetes.io/projected/b5efc959-52aa-459b-bb8b-2d04b6eebef1-kube-api-access-rjj4l\") pod \"maas-controller-659b665964-fdwlj\" (UID: \"b5efc959-52aa-459b-bb8b-2d04b6eebef1\") " pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.260421 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.260301 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5efc959-52aa-459b-bb8b-2d04b6eebef1-webhook-cert\") pod \"maas-controller-659b665964-fdwlj\" (UID: \"b5efc959-52aa-459b-bb8b-2d04b6eebef1\") " pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.262729 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.262699 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5efc959-52aa-459b-bb8b-2d04b6eebef1-webhook-cert\") pod \"maas-controller-659b665964-fdwlj\" (UID: \"b5efc959-52aa-459b-bb8b-2d04b6eebef1\") " pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.272992 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.272963 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjj4l\" (UniqueName: \"kubernetes.io/projected/b5efc959-52aa-459b-bb8b-2d04b6eebef1-kube-api-access-rjj4l\") pod \"maas-controller-659b665964-fdwlj\" (UID: \"b5efc959-52aa-459b-bb8b-2d04b6eebef1\") " pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.368372 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.368279 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:24.524275 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.524242 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659b665964-fdwlj"] Jun 14 14:58:24.529019 ip-10-0-136-235 kubenswrapper[2549]: W0614 14:58:24.528994 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5efc959_52aa_459b_bb8b_2d04b6eebef1.slice/crio-42a28f34624acdf89c411cf57d834320af6fc8d54cdce140353e2828d6c49204 WatchSource:0}: Error finding container 42a28f34624acdf89c411cf57d834320af6fc8d54cdce140353e2828d6c49204: Status 404 returned error can't find the container with id 42a28f34624acdf89c411cf57d834320af6fc8d54cdce140353e2828d6c49204 Jun 14 14:58:24.530427 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.530407 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:58:24.864514 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:24.864479 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659b665964-fdwlj" event={"ID":"b5efc959-52aa-459b-bb8b-2d04b6eebef1","Type":"ContainerStarted","Data":"42a28f34624acdf89c411cf57d834320af6fc8d54cdce140353e2828d6c49204"} Jun 14 14:58:25.179492 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:25.179397 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ed1369-e539-463b-a31f-a90695f6adc8" path="/var/lib/kubelet/pods/c4ed1369-e539-463b-a31f-a90695f6adc8/volumes" Jun 14 14:58:25.870534 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:25.870499 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659b665964-fdwlj" event={"ID":"b5efc959-52aa-459b-bb8b-2d04b6eebef1","Type":"ContainerStarted","Data":"29e984b7d5f4e97eb70f0a7d566e971bdee60aa1bb8270b7f74fa0ba56222bfb"} Jun 14 14:58:25.870758 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:25.870594 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:58:25.903956 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:25.903895 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659b665964-fdwlj" podStartSLOduration=1.434407925 podStartE2EDuration="1.903879182s" totalImagesPullingTime="469.471257ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:58:25.901767039 +0000 UTC m=+1131.255144999" watchObservedRunningTime="2026-06-14 14:58:25.903879182 +0000 UTC m=+1131.257257130" Jun 14 14:58:36.882008 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:58:36.881970 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659b665964-fdwlj" Jun 14 14:59:35.199931 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:59:35.199906 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 14:59:35.206258 ip-10-0-136-235 kubenswrapper[2549]: I0614 14:59:35.206239 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:04:35.227836 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:04:35.227807 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:04:35.235533 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:04:35.235514 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:08:26.731900 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:26.731869 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq"] Jun 14 15:08:26.732398 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:26.732073 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" podUID="33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" containerName="manager" containerID="cri-o://022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf" gracePeriod=10 Jun 14 15:08:26.992402 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:26.992347 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 15:08:27.114466 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.114436 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcv78\" (UniqueName: \"kubernetes.io/projected/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-kube-api-access-mcv78\") pod \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " Jun 14 15:08:27.114648 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.114498 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-extensions-socket-volume\") pod \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\" (UID: \"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0\") " Jun 14 15:08:27.114879 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.114856 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" (UID: "33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:08:27.116485 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.116460 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-kube-api-access-mcv78" (OuterVolumeSpecName: "kube-api-access-mcv78") pod "33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" (UID: "33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0"). InnerVolumeSpecName "kube-api-access-mcv78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:08:27.215331 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.215304 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcv78\" (UniqueName: \"kubernetes.io/projected/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-kube-api-access-mcv78\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:08:27.215331 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.215327 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0-extensions-socket-volume\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:08:27.684338 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.684306 2549 generic.go:356] "Generic (PLEG): container finished" podID="33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" containerID="022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf" exitCode=0 Jun 14 15:08:27.684499 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.684345 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" Jun 14 15:08:27.684499 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.684368 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" event={"ID":"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0","Type":"ContainerDied","Data":"022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf"} Jun 14 15:08:27.684499 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.684414 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq" event={"ID":"33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0","Type":"ContainerDied","Data":"35f4c6aa9c478c72cf3ea90fef4c8be2dfb5b44af40f52baec927194dad430cd"} Jun 14 15:08:27.684499 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.684437 2549 scope.go:117] "RemoveContainer" containerID="022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf" Jun 14 15:08:27.694710 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.694691 2549 scope.go:117] "RemoveContainer" containerID="022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf" Jun 14 15:08:27.695007 ip-10-0-136-235 kubenswrapper[2549]: E0614 15:08:27.694985 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf\": container with ID starting with 022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf not found: ID does not exist" containerID="022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf" Jun 14 15:08:27.695098 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.695017 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf"} err="failed to get container status \"022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf\": rpc error: code = NotFound desc = could not find container \"022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf\": container with ID starting with 022c8914b8d48585d66224bbb3955861365a543fe7ffcbf427cf802cdff99bdf not found: ID does not exist" Jun 14 15:08:27.703538 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.703517 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq"] Jun 14 15:08:27.708448 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:27.708427 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwphq"] Jun 14 15:08:29.178580 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:08:29.178537 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" path="/var/lib/kubelet/pods/33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0/volumes" Jun 14 15:09:27.880243 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.880211 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj"] Jun 14 15:09:27.880667 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.880575 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" containerName="manager" Jun 14 15:09:27.880667 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.880587 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" containerName="manager" Jun 14 15:09:27.880667 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.880657 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b0a5fb-ce72-49bf-9d9a-0a884b7f83a0" containerName="manager" Jun 14 15:09:27.883781 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.883765 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:27.890792 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.890772 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9t7vc\"" Jun 14 15:09:27.897940 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:27.897918 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj"] Jun 14 15:09:28.013382 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.013360 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12cc49e9-88ef-4ae2-b4f6-350e92c34472-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cdmmj\" (UID: \"12cc49e9-88ef-4ae2-b4f6-350e92c34472\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.013495 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.013426 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zssm6\" (UniqueName: \"kubernetes.io/projected/12cc49e9-88ef-4ae2-b4f6-350e92c34472-kube-api-access-zssm6\") pod \"kuadrant-operator-controller-manager-86878c769f-cdmmj\" (UID: \"12cc49e9-88ef-4ae2-b4f6-350e92c34472\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.114334 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.114312 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zssm6\" (UniqueName: \"kubernetes.io/projected/12cc49e9-88ef-4ae2-b4f6-350e92c34472-kube-api-access-zssm6\") pod \"kuadrant-operator-controller-manager-86878c769f-cdmmj\" (UID: \"12cc49e9-88ef-4ae2-b4f6-350e92c34472\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.114443 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.114349 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12cc49e9-88ef-4ae2-b4f6-350e92c34472-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cdmmj\" (UID: \"12cc49e9-88ef-4ae2-b4f6-350e92c34472\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.114699 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.114684 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12cc49e9-88ef-4ae2-b4f6-350e92c34472-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cdmmj\" (UID: \"12cc49e9-88ef-4ae2-b4f6-350e92c34472\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.122727 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.122708 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zssm6\" (UniqueName: \"kubernetes.io/projected/12cc49e9-88ef-4ae2-b4f6-350e92c34472-kube-api-access-zssm6\") pod \"kuadrant-operator-controller-manager-86878c769f-cdmmj\" (UID: \"12cc49e9-88ef-4ae2-b4f6-350e92c34472\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.193900 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.193877 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.332916 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.332892 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj"] Jun 14 15:09:28.335365 ip-10-0-136-235 kubenswrapper[2549]: W0614 15:09:28.335336 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cc49e9_88ef_4ae2_b4f6_350e92c34472.slice/crio-d535027f3942dffadcb55c179e4a0d3564fd08fbd68ba3cd3eb2606380399d2a WatchSource:0}: Error finding container d535027f3942dffadcb55c179e4a0d3564fd08fbd68ba3cd3eb2606380399d2a: Status 404 returned error can't find the container with id d535027f3942dffadcb55c179e4a0d3564fd08fbd68ba3cd3eb2606380399d2a Jun 14 15:09:28.965805 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.965766 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" event={"ID":"12cc49e9-88ef-4ae2-b4f6-350e92c34472","Type":"ContainerStarted","Data":"4f26554ac688004efeffc61169d41c51b7014368b14914ffe57dfc8752472fd6"} Jun 14 15:09:28.966190 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.965857 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" event={"ID":"12cc49e9-88ef-4ae2-b4f6-350e92c34472","Type":"ContainerStarted","Data":"d535027f3942dffadcb55c179e4a0d3564fd08fbd68ba3cd3eb2606380399d2a"} Jun 14 15:09:28.966190 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.965889 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:09:28.985855 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:28.985805 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" podStartSLOduration=1.985789367 podStartE2EDuration="1.985789367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:09:28.984893094 +0000 UTC m=+1794.338271072" watchObservedRunningTime="2026-06-14 15:09:28.985789367 +0000 UTC m=+1794.339167316" Jun 14 15:09:35.255293 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:35.255180 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:09:35.263674 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:35.263653 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:09:39.972697 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:09:39.972665 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cdmmj" Jun 14 15:14:35.282660 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:14:35.282536 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:14:35.291459 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:14:35.291442 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:18:45.753273 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.753237 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck"] Jun 14 15:18:45.756860 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.756844 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.759638 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.759613 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-59aa0365-openshift-default-dockercfg-nx4mh\"" Jun 14 15:18:45.781507 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.781481 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck"] Jun 14 15:18:45.940293 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-certs\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940293 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940293 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h489m\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-kube-api-access-h489m\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940474 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940315 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-token\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940474 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940340 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-socket\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940474 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940409 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istiod-ca-cert\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940474 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940446 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-podinfo\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940474 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940472 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-data\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940664 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940585 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-credential-socket\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:45.940664 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:45.940623 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-envoy\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041092 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041013 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-certs\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041092 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h489m\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-kube-api-access-h489m\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041154 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-token\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041178 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-socket\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041225 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istiod-ca-cert\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041263 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-podinfo\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-data\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041375 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-credential-socket\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041403 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-envoy\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041432 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-certs\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.041614 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041586 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-socket\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.042092 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041679 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-credential-socket\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.042092 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.041744 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-data\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.042092 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.042015 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istiod-ca-cert\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.043689 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.043670 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-envoy\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.043830 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.043812 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-podinfo\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.053734 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.053713 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-token\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.053734 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.053730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h489m\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-kube-api-access-h489m\") pod \"e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.068643 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.068619 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:46.215037 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.215013 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck"] Jun 14 15:18:46.217051 ip-10-0-136-235 kubenswrapper[2549]: W0614 15:18:46.217027 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090d7c1c_cb8d_4000_99a0_b37d69fd78b9.slice/crio-1d71810242d4682c7ba872db1e99b1768617339e01fe7ae6cd2817cfb4e308e6 WatchSource:0}: Error finding container 1d71810242d4682c7ba872db1e99b1768617339e01fe7ae6cd2817cfb4e308e6: Status 404 returned error can't find the container with id 1d71810242d4682c7ba872db1e99b1768617339e01fe7ae6cd2817cfb4e308e6 Jun 14 15:18:46.219199 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.219163 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 15:18:46.219371 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.219234 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 15:18:46.219371 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.219269 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 15:18:46.563698 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.563664 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" event={"ID":"090d7c1c-cb8d-4000-99a0-b37d69fd78b9","Type":"ContainerStarted","Data":"bf4516259124ca2f669250b232556adce2a2ef0c972328c0f50edbc12cfe319a"} Jun 14 15:18:46.563856 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.563724 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" event={"ID":"090d7c1c-cb8d-4000-99a0-b37d69fd78b9","Type":"ContainerStarted","Data":"1d71810242d4682c7ba872db1e99b1768617339e01fe7ae6cd2817cfb4e308e6"} Jun 14 15:18:46.591503 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:46.591460 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" podStartSLOduration=1.591445244 podStartE2EDuration="1.591445244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:18:46.590515471 +0000 UTC m=+2351.943893421" watchObservedRunningTime="2026-06-14 15:18:46.591445244 +0000 UTC m=+2351.944823192" Jun 14 15:18:47.069443 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:47.069411 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:47.074772 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:47.074749 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:47.569274 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:47.569245 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:47.570194 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:47.570168 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:52.186439 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:52.186401 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck"] Jun 14 15:18:52.186944 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:52.186585 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" podUID="090d7c1c-cb8d-4000-99a0-b37d69fd78b9" containerName="istio-proxy" containerID="cri-o://bf4516259124ca2f669250b232556adce2a2ef0c972328c0f50edbc12cfe319a" gracePeriod=30 Jun 14 15:18:55.610709 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:55.610644 2549 generic.go:356] "Generic (PLEG): container finished" podID="090d7c1c-cb8d-4000-99a0-b37d69fd78b9" containerID="bf4516259124ca2f669250b232556adce2a2ef0c972328c0f50edbc12cfe319a" exitCode=0 Jun 14 15:18:55.611062 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:55.610717 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" event={"ID":"090d7c1c-cb8d-4000-99a0-b37d69fd78b9","Type":"ContainerDied","Data":"bf4516259124ca2f669250b232556adce2a2ef0c972328c0f50edbc12cfe319a"} Jun 14 15:18:55.934508 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:55.934481 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:56.013969 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.013948 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-certs\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014093 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.013976 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h489m\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-kube-api-access-h489m\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014093 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.013993 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-podinfo\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014093 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014012 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-data\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014268 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014166 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-envoy\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014268 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014245 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istiod-ca-cert\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014387 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014273 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:18:56.014387 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014310 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-socket\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014387 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014343 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-token\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014387 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014367 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-credential-socket\") pod \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\" (UID: \"090d7c1c-cb8d-4000-99a0-b37d69fd78b9\") " Jun 14 15:18:56.014928 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014698 2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-certs\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.014928 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014882 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:18:56.014928 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.014882 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:18:56.015154 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.015088 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:18:56.015337 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.015311 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:18:56.016621 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.016589 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:18:56.016754 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.016681 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 15:18:56.016754 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.016691 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-kube-api-access-h489m" (OuterVolumeSpecName: "kube-api-access-h489m") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "kube-api-access-h489m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:18:56.017011 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.016986 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "090d7c1c-cb8d-4000-99a0-b37d69fd78b9" (UID: "090d7c1c-cb8d-4000-99a0-b37d69fd78b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:18:56.115081 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115058 2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-workload-socket\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115081 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115079 2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-token\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115087 2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-credential-socket\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115096 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h489m\" (UniqueName: \"kubernetes.io/projected/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-kube-api-access-h489m\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115106 2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-podinfo\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115122 2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-data\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115131 2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istio-envoy\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.115202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.115140 2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/090d7c1c-cb8d-4000-99a0-b37d69fd78b9-istiod-ca-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:18:56.617246 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.617216 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" Jun 14 15:18:56.617246 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.617227 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck" event={"ID":"090d7c1c-cb8d-4000-99a0-b37d69fd78b9","Type":"ContainerDied","Data":"1d71810242d4682c7ba872db1e99b1768617339e01fe7ae6cd2817cfb4e308e6"} Jun 14 15:18:56.617711 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.617280 2549 scope.go:117] "RemoveContainer" containerID="bf4516259124ca2f669250b232556adce2a2ef0c972328c0f50edbc12cfe319a" Jun 14 15:18:56.641662 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.641638 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck"] Jun 14 15:18:56.645883 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:56.645862 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-59aa0365-openshift-default-5d5b964598-xnmck"] Jun 14 15:18:57.179060 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:57.179029 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="090d7c1c-cb8d-4000-99a0-b37d69fd78b9" path="/var/lib/kubelet/pods/090d7c1c-cb8d-4000-99a0-b37d69fd78b9/volumes" Jun 14 15:18:58.283780 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.283747 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k"] Jun 14 15:18:58.284220 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.284100 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="090d7c1c-cb8d-4000-99a0-b37d69fd78b9" containerName="istio-proxy" Jun 14 15:18:58.284220 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.284111 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="090d7c1c-cb8d-4000-99a0-b37d69fd78b9" containerName="istio-proxy" Jun 14 15:18:58.284220 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.284179 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="090d7c1c-cb8d-4000-99a0-b37d69fd78b9" containerName="istio-proxy" Jun 14 15:18:58.288544 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.288526 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.291400 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.291382 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-412109df-openshift-default-dockercfg-fg2bt\"" Jun 14 15:18:58.305674 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.305653 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k"] Jun 14 15:18:58.331958 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.331935 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-certs\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332047 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.331961 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-podinfo\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332047 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.331981 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-envoy\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332047 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.331998 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istiod-ca-cert\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332151 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.332087 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-credential-socket\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332151 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.332115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-socket\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332151 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.332135 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pndg\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-kube-api-access-7pndg\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332245 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.332183 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-data\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.332245 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.332205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-token\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433045 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433019 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-certs\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433200 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433051 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-podinfo\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433200 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433073 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-envoy\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433200 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433092 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istiod-ca-cert\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433200 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433137 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-credential-socket\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433200 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433161 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-socket\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433200 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433179 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pndg\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-kube-api-access-7pndg\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433482 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433227 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-data\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433574 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433538 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-credential-socket\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433705 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433687 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-token\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433818 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433794 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-data\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.433977 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.433956 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istiod-ca-cert\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.434047 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.434020 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-socket\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.434240 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.434222 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-certs\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.435907 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.435884 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-podinfo\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.436000 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.435919 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-envoy\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.447256 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.447234 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pndg\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-kube-api-access-7pndg\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.447425 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.447406 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-token\") pod \"e2e-ait-412109df-openshift-default-5449459db4-rrl4k\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.602156 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.602084 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:18:58.744803 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.744770 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k"] Jun 14 15:18:58.749024 ip-10-0-136-235 kubenswrapper[2549]: W0614 15:18:58.749001 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73afd7a_31bc_412b_a71d_da999bf0aa1d.slice/crio-ee9eaa4be2362a80ff54f428f12c93844032b24d23145c093bc9884f10a55242 WatchSource:0}: Error finding container ee9eaa4be2362a80ff54f428f12c93844032b24d23145c093bc9884f10a55242: Status 404 returned error can't find the container with id ee9eaa4be2362a80ff54f428f12c93844032b24d23145c093bc9884f10a55242 Jun 14 15:18:58.751257 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.751218 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 15:18:58.751324 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.751300 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 15:18:58.751359 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:58.751340 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 14 15:18:59.635716 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:59.635683 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" event={"ID":"a73afd7a-31bc-412b-a71d-da999bf0aa1d","Type":"ContainerStarted","Data":"3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768"} Jun 14 15:18:59.636146 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:59.635754 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" event={"ID":"a73afd7a-31bc-412b-a71d-da999bf0aa1d","Type":"ContainerStarted","Data":"ee9eaa4be2362a80ff54f428f12c93844032b24d23145c093bc9884f10a55242"} Jun 14 15:18:59.656633 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:18:59.656591 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podStartSLOduration=1.6565757589999999 podStartE2EDuration="1.656575759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:18:59.655433081 +0000 UTC m=+2365.008811055" watchObservedRunningTime="2026-06-14 15:18:59.656575759 +0000 UTC m=+2365.009953701" Jun 14 15:19:00.603218 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:00.603180 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:19:01.603439 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:01.603404 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 14 15:19:01.603991 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:01.603475 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 14 15:19:02.604725 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:02.604682 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 14 15:19:02.605171 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:02.604750 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 14 15:19:03.606170 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:03.605453 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 14 15:19:03.606170 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:03.605526 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 14 15:19:04.646703 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:04.646665 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 14 15:19:04.647101 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:04.646727 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 14 15:19:05.687748 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:05.687700 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 14 15:19:05.688170 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:05.687754 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 14 15:19:05.691592 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:05.691550 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k"] Jun 14 15:19:05.691800 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:05.691777 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" containerID="cri-o://3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768" gracePeriod=30 Jun 14 15:19:06.729731 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:06.729686 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 14 15:19:06.730127 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:06.729740 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 14 15:19:07.315296 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.313977 2549 patch_prober.go:28] interesting pod/e2e-ait-412109df-openshift-default-5449459db4-rrl4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:56522->10.134.0.44:15021: read: connection reset by peer" start-of-body= Jun 14 15:19:07.315296 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.314041 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:56522->10.134.0.44:15021: read: connection reset by peer" Jun 14 15:19:07.554925 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.554902 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:19:07.624679 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624610 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-token\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.624679 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624668 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istiod-ca-cert\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.624842 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624782 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-podinfo\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.624886 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624841 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-socket\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.624933 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624913 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-certs\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.624989 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624940 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-data\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.624989 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.624976 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-credential-socket\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.625102 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625006 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-envoy\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.625102 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625037 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pndg\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-kube-api-access-7pndg\") pod \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\" (UID: \"a73afd7a-31bc-412b-a71d-da999bf0aa1d\") " Jun 14 15:19:07.625202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625001 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:19:07.625202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625155 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:19:07.625202 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625185 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:19:07.625369 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625311 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:19:07.625477 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625458 2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-certs\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.625477 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625479 2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-credential-socket\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.625680 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625492 2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istiod-ca-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.625680 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.625505 2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-workload-socket\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.626092 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.626068 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:19:07.627029 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.627006 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:19:07.627233 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.627214 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-kube-api-access-7pndg" (OuterVolumeSpecName: "kube-api-access-7pndg") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "kube-api-access-7pndg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:19:07.627310 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.627290 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 15:19:07.627516 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.627356 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a73afd7a-31bc-412b-a71d-da999bf0aa1d" (UID: "a73afd7a-31bc-412b-a71d-da999bf0aa1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:19:07.675135 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.675106 2549 generic.go:356] "Generic (PLEG): container finished" podID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerID="3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768" exitCode=0 Jun 14 15:19:07.675226 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.675159 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" Jun 14 15:19:07.675226 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.675189 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" event={"ID":"a73afd7a-31bc-412b-a71d-da999bf0aa1d","Type":"ContainerDied","Data":"3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768"} Jun 14 15:19:07.675302 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.675239 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k" event={"ID":"a73afd7a-31bc-412b-a71d-da999bf0aa1d","Type":"ContainerDied","Data":"ee9eaa4be2362a80ff54f428f12c93844032b24d23145c093bc9884f10a55242"} Jun 14 15:19:07.675302 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.675267 2549 scope.go:117] "RemoveContainer" containerID="3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768" Jun 14 15:19:07.684463 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.684379 2549 scope.go:117] "RemoveContainer" containerID="3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768" Jun 14 15:19:07.684966 ip-10-0-136-235 kubenswrapper[2549]: E0614 15:19:07.684939 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768\": container with ID starting with 3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768 not found: ID does not exist" containerID="3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768" Jun 14 15:19:07.685066 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.684969 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768"} err="failed to get container status \"3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768\": rpc error: code = NotFound desc = could not find container \"3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768\": container with ID starting with 3a01a8fcc5b2f4f52d4d1ac990e9a19328d2c37c005df1e050d909a0f23df768 not found: ID does not exist" Jun 14 15:19:07.699122 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.699099 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k"] Jun 14 15:19:07.702975 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.702954 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-412109df-openshift-default-5449459db4-rrl4k"] Jun 14 15:19:07.726156 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.726137 2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-podinfo\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.726156 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.726155 2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-data\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.726283 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.726165 2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-envoy\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.726283 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.726174 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pndg\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-kube-api-access-7pndg\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:07.726283 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:07.726183 2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73afd7a-31bc-412b-a71d-da999bf0aa1d-istio-token\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\"" Jun 14 15:19:09.179381 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:09.179352 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" path="/var/lib/kubelet/pods/a73afd7a-31bc-412b-a71d-da999bf0aa1d/volumes" Jun 14 15:19:22.238101 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:22.238072 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-678bbb5d45-69rrh_8090df82-996c-46bf-9520-086ecc57621f/nginx/0.log" Jun 14 15:19:22.708303 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:22.708268 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-66f4c5c6bb-2htzf_231b2be0-a556-444b-95dc-6d23b12fa4bf/maas-api/0.log" Jun 14 15:19:23.256008 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:23.255982 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659b665964-fdwlj_b5efc959-52aa-459b-bb8b-2d04b6eebef1/manager/0.log" Jun 14 15:19:23.590813 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:23.590734 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-k5lxg_3389792d-3aef-4dbd-a780-5844e31e4510/manager/0.log" Jun 14 15:19:23.597193 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:23.597174 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-k5lxg_3389792d-3aef-4dbd-a780-5844e31e4510/copy-manifests/0.log" Jun 14 15:19:25.426163 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:25.426131 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nznx5_69958dd6-924e-48c3-b3df-0d851e85b3ea/manager/0.log" Jun 14 15:19:25.653729 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:25.653684 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xtkhh_88f6231e-fe8f-4f83-992c-64c2449f9626/registry-server/0.log" Jun 14 15:19:25.776279 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:25.776246 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cdmmj_12cc49e9-88ef-4ae2-b4f6-350e92c34472/manager/0.log" Jun 14 15:19:26.002114 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:26.002084 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jmx65_d2a28efc-906c-44c1-b4e0-cb0defa93e2f/manager/0.log" Jun 14 15:19:26.344921 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:26.344888 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795spn7z_49d52f6b-9b99-472a-96e1-b7b57a20eefd/istio-proxy/0.log" Jun 14 15:19:26.797079 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:26.797051 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/1.log" Jun 14 15:19:26.914734 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:26.914705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-msr74_cb90cd04-85a9-448c-b8bc-f288df53ef6d/payload-pre-processing/0.log" Jun 14 15:19:27.029064 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.029031 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-h4dbk_8e289040-63b6-4251-bda6-32c7a339ced1/payload-processing/0.log" Jun 14 15:19:27.469764 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.469725 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn_c21b6520-b24d-4d3e-a07f-07dc40b49648/storage-initializer/0.log" Jun 14 15:19:27.478002 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.477978 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vlttn_c21b6520-b24d-4d3e-a07f-07dc40b49648/main/0.log" Jun 14 15:19:27.591100 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.591055 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-djtgv_8b5dc535-3d2f-40d7-8812-c89a07389d9c/storage-initializer/0.log" Jun 14 15:19:27.602444 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.602425 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-djtgv_8b5dc535-3d2f-40d7-8812-c89a07389d9c/main/0.log" Jun 14 15:19:27.828810 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.828735 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x_d9e9174c-2599-4299-969b-9af67ae79e52/storage-initializer/0.log" Jun 14 15:19:27.836393 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:27.836369 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdp69x_d9e9174c-2599-4299-969b-9af67ae79e52/main/0.log" Jun 14 15:19:28.055342 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:28.055312 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-d96s7_9cd92f50-b36d-42c6-a068-1a90ae92939d/main/0.log" Jun 14 15:19:28.061907 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:28.061880 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-d96s7_9cd92f50-b36d-42c6-a068-1a90ae92939d/storage-initializer/0.log" Jun 14 15:19:34.815153 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:34.815118 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r4lfw_2743a642-0c17-44e6-89e4-6742c52f0afd/global-pull-secret-syncer/0.log" Jun 14 15:19:34.945072 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:34.945043 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxgh4_9b13cdf5-8297-45d7-9404-8363a9543ebf/konnectivity-agent/0.log" Jun 14 15:19:35.026249 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:35.026220 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-235.ec2.internal_4d8e55ef14373ec2db270f794a4f312f/haproxy/0.log" Jun 14 15:19:35.317255 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:35.317228 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:19:35.325861 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:35.325840 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpt5m_1799981e-244f-4549-8197-20784024ec11/ovn-acl-logging/0.log" Jun 14 15:19:40.635993 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:40.635956 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nznx5_69958dd6-924e-48c3-b3df-0d851e85b3ea/manager/0.log" Jun 14 15:19:40.711642 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:40.711616 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xtkhh_88f6231e-fe8f-4f83-992c-64c2449f9626/registry-server/0.log" Jun 14 15:19:40.790683 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:40.790646 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cdmmj_12cc49e9-88ef-4ae2-b4f6-350e92c34472/manager/0.log" Jun 14 15:19:40.908023 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:40.907939 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jmx65_d2a28efc-906c-44c1-b4e0-cb0defa93e2f/manager/0.log" Jun 14 15:19:43.008099 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.008064 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-26kb6_d7bb1d0e-9111-4550-8b09-d242a56aa0b4/monitoring-plugin/0.log" Jun 14 15:19:43.049051 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.049016 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k7c2q_91a7b9b0-ee4f-47f0-9e20-122cca0472b0/node-exporter/0.log" Jun 14 15:19:43.072107 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.072084 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k7c2q_91a7b9b0-ee4f-47f0-9e20-122cca0472b0/kube-rbac-proxy/0.log" Jun 14 15:19:43.095490 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.095469 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k7c2q_91a7b9b0-ee4f-47f0-9e20-122cca0472b0/init-textfile/0.log" Jun 14 15:19:43.390454 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.390430 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/prometheus/0.log" Jun 14 15:19:43.410601 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.410582 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/config-reloader/0.log" Jun 14 15:19:43.435891 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.435870 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/thanos-sidecar/0.log" Jun 14 15:19:43.458765 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.458742 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/kube-rbac-proxy-web/0.log" Jun 14 15:19:43.482333 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.482314 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/kube-rbac-proxy/0.log" Jun 14 15:19:43.507780 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.507758 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/kube-rbac-proxy-thanos/0.log" Jun 14 15:19:43.532004 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:43.531988 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da2ca0ae-e6c0-40c5-b9c5-2dee5408f3df/init-config-reloader/0.log" Jun 14 15:19:46.369847 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.369814 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x"] Jun 14 15:19:46.370323 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.370304 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" Jun 14 15:19:46.370368 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.370327 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" Jun 14 15:19:46.370413 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.370408 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73afd7a-31bc-412b-a71d-da999bf0aa1d" containerName="istio-proxy" Jun 14 15:19:46.372438 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.372422 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.375189 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.375160 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9rwp\"/\"openshift-service-ca.crt\"" Jun 14 15:19:46.375189 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.375185 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9rwp\"/\"kube-root-ca.crt\"" Jun 14 15:19:46.376132 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.376115 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n9rwp\"/\"default-dockercfg-6m4tx\"" Jun 14 15:19:46.381019 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.380987 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x"] Jun 14 15:19:46.460138 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.460107 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-podres\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.460274 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.460157 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-lib-modules\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.460274 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.460257 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-sys\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.460394 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.460313 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/02e360de-4362-4569-a2bc-8359c791f40c-kube-api-access-v2hnd\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.460394 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.460383 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-proc\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561004 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.560971 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-lib-modules\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561155 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-sys\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561155 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561070 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/02e360de-4362-4569-a2bc-8359c791f40c-kube-api-access-v2hnd\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561155 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561127 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-proc\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561155 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561131 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-lib-modules\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561155 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561147 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-sys\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561391 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561195 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-podres\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561391 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561203 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-proc\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.561391 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.561287 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02e360de-4362-4569-a2bc-8359c791f40c-podres\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.569485 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.569465 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hnd\" (UniqueName: \"kubernetes.io/projected/02e360de-4362-4569-a2bc-8359c791f40c-kube-api-access-v2hnd\") pod \"perf-node-gather-daemonset-7m47x\" (UID: \"02e360de-4362-4569-a2bc-8359c791f40c\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.602779 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.602759 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-665bfdffd5-9c5lk_4d3e0d2f-812d-4ed6-99fc-f630122881b6/console/0.log" Jun 14 15:19:46.683358 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.683306 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:46.813514 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.813486 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x"] Jun 14 15:19:46.820665 ip-10-0-136-235 kubenswrapper[2549]: W0614 15:19:46.820630 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod02e360de_4362_4569_a2bc_8359c791f40c.slice/crio-6e7a077215c8e764e7381d466277c9e85cd5e256e117ad267922d80eb171ec0b WatchSource:0}: Error finding container 6e7a077215c8e764e7381d466277c9e85cd5e256e117ad267922d80eb171ec0b: Status 404 returned error can't find the container with id 6e7a077215c8e764e7381d466277c9e85cd5e256e117ad267922d80eb171ec0b Jun 14 15:19:46.855843 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:46.855813 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" event={"ID":"02e360de-4362-4569-a2bc-8359c791f40c","Type":"ContainerStarted","Data":"6e7a077215c8e764e7381d466277c9e85cd5e256e117ad267922d80eb171ec0b"} Jun 14 15:19:47.861406 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:47.861372 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" event={"ID":"02e360de-4362-4569-a2bc-8359c791f40c","Type":"ContainerStarted","Data":"c6647d44f953b7008ccf56f2d18cd01b3164fffd7af3765bb60c9a02aa54e402"} Jun 14 15:19:47.861832 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:47.861507 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:47.879886 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:47.879842 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" podStartSLOduration=1.879829867 podStartE2EDuration="1.879829867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:19:47.878901234 +0000 UTC m=+2413.232279186" watchObservedRunningTime="2026-06-14 15:19:47.879829867 +0000 UTC m=+2413.233207816" Jun 14 15:19:48.581674 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:48.581646 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64t25_abe1cd8c-a676-4724-a1eb-af13b2846734/dns/0.log" Jun 14 15:19:48.607311 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:48.607289 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64t25_abe1cd8c-a676-4724-a1eb-af13b2846734/kube-rbac-proxy/0.log" Jun 14 15:19:48.744387 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:48.744369 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x4wkv_c0bed816-8b69-48a3-978b-16bc53bd7057/dns-node-resolver/0.log" Jun 14 15:19:49.348712 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:49.348685 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fdrcg_ff456538-2dff-49c6-ba8c-2165bfb34524/node-ca/0.log" Jun 14 15:19:50.377710 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:50.377678 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795spn7z_49d52f6b-9b99-472a-96e1-b7b57a20eefd/istio-proxy/0.log" Jun 14 15:19:50.525380 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:50.525356 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/0.log" Jun 14 15:19:50.584654 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:50.584632 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/1.log" Jun 14 15:19:50.621961 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:50.621930 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-msr74_cb90cd04-85a9-448c-b8bc-f288df53ef6d/payload-pre-processing/0.log" Jun 14 15:19:50.712389 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:50.712366 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-h4dbk_8e289040-63b6-4251-bda6-32c7a339ced1/payload-processing/0.log" Jun 14 15:19:51.369620 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:51.369591 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98gb7_73e20078-7202-4805-9a8e-206563bcf94f/serve-healthcheck-canary/0.log" Jun 14 15:19:52.122261 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:52.122238 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb2sq_dd1bf943-4a06-40a1-9644-ce39a7e403df/kube-rbac-proxy/0.log" Jun 14 15:19:52.146389 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:52.146367 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb2sq_dd1bf943-4a06-40a1-9644-ce39a7e403df/exporter/0.log" Jun 14 15:19:52.170818 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:52.170793 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb2sq_dd1bf943-4a06-40a1-9644-ce39a7e403df/extractor/0.log" Jun 14 15:19:53.876731 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:53.876652 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-7m47x" Jun 14 15:19:54.414217 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:54.414185 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-678bbb5d45-69rrh_8090df82-996c-46bf-9520-086ecc57621f/nginx/0.log" Jun 14 15:19:54.610403 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:54.610364 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-66f4c5c6bb-2htzf_231b2be0-a556-444b-95dc-6d23b12fa4bf/maas-api/0.log" Jun 14 15:19:54.829551 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:54.829523 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659b665964-fdwlj_b5efc959-52aa-459b-bb8b-2d04b6eebef1/manager/0.log" Jun 14 15:19:54.951942 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:54.951920 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-k5lxg_3389792d-3aef-4dbd-a780-5844e31e4510/manager/0.log" Jun 14 15:19:54.976269 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:54.976246 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-k5lxg_3389792d-3aef-4dbd-a780-5844e31e4510/copy-manifests/0.log" Jun 14 15:19:57.114130 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:57.114093 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58654d7f68-sb2nz_ccff0502-25f6-456a-8a61-087223a4bb92/manager/0.log" Jun 14 15:19:59.420674 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:59.420641 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795spn7z_49d52f6b-9b99-472a-96e1-b7b57a20eefd/istio-proxy/0.log" Jun 14 15:19:59.526898 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:59.526854 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/0.log" Jun 14 15:19:59.582315 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:59.582282 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/1.log" Jun 14 15:19:59.614231 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:59.614203 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-msr74_cb90cd04-85a9-448c-b8bc-f288df53ef6d/payload-pre-processing/0.log" Jun 14 15:19:59.694312 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:19:59.694287 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-h4dbk_8e289040-63b6-4251-bda6-32c7a339ced1/payload-processing/0.log" Jun 14 15:20:00.857593 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:00.857550 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795spn7z_49d52f6b-9b99-472a-96e1-b7b57a20eefd/istio-proxy/0.log" Jun 14 15:20:00.962963 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:00.962937 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/0.log" Jun 14 15:20:01.021611 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:01.021586 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/1.log" Jun 14 15:20:01.051053 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:01.051025 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-msr74_cb90cd04-85a9-448c-b8bc-f288df53ef6d/payload-pre-processing/0.log" Jun 14 15:20:01.131262 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:01.131193 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-h4dbk_8e289040-63b6-4251-bda6-32c7a339ced1/payload-processing/0.log" Jun 14 15:20:02.889348 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:02.889312 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795spn7z_49d52f6b-9b99-472a-96e1-b7b57a20eefd/istio-proxy/0.log" Jun 14 15:20:03.002467 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:03.002440 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/0.log" Jun 14 15:20:03.058345 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:03.058316 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-l8k94_f82e9863-d2df-4bcd-8316-de79b970f581/istio-proxy/1.log" Jun 14 15:20:03.107804 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:03.107781 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-msr74_cb90cd04-85a9-448c-b8bc-f288df53ef6d/payload-pre-processing/0.log" Jun 14 15:20:03.189878 ip-10-0-136-235 kubenswrapper[2549]: I0614 15:20:03.189854 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-h4dbk_8e289040-63b6-4251-bda6-32c7a339ced1/payload-processing/0.log"