Jun 10 13:00:49.953101 ip-10-0-128-233 systemd[1]: Starting Kubernetes Kubelet... Jun 10 13:00:50.381210 ip-10-0-128-233 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:00:50.381210 ip-10-0-128-233 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 13:00:50.381210 ip-10-0-128-233 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:00:50.381210 ip-10-0-128-233 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 13:00:50.381210 ip-10-0-128-233 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:00:50.382169 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.382085 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 13:00:50.388596 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388574 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:00:50.388596 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388591 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:00:50.388596 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388595 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:00:50.388596 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388599 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:00:50.388596 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388602 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388606 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388608 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388612 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388614 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388617 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388619 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388622 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388624 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388628 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388633 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388636 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388639 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388642 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388645 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388649 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388653 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388656 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388658 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:00:50.388791 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388661 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388663 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388667 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388671 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388673 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388676 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388679 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388681 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388685 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388687 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388690 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388693 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388695 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388698 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388702 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388705 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388708 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388710 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388714 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388717 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:00:50.389275 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388720 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388723 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388725 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388728 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388730 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388733 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388735 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388739 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388741 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388744 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388746 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388749 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388751 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388754 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388756 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388759 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388761 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388764 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388766 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388769 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:00:50.389757 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388772 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388775 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388777 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388780 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388783 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388785 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388788 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388791 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388793 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388796 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388799 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388802 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388804 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388807 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388810 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388813 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388816 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388818 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388820 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388823 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:00:50.390264 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388826 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388845 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388848 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388850 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388853 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388855 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388858 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388860 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388863 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388865 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388867 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388870 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388873 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388876 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388878 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.388881 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390473 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390481 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390484 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390487 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:00:50.390744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390491 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390494 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390497 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390500 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390502 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390505 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390508 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390510 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390513 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390515 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390518 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390521 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390523 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390527 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390531 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390534 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390537 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390540 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390543 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390545 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:00:50.391252 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390548 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390550 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390553 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390556 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390559 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390562 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390564 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390567 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390570 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390572 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390575 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390577 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390580 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390582 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390585 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390587 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390590 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390593 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390598 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:00:50.391746 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390603 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390606 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390609 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390612 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390615 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390618 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390621 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390625 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390628 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390631 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390633 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390636 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390638 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390641 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390643 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390646 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390648 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390651 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390654 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390656 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:00:50.392236 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390659 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390661 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390664 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390667 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390669 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390672 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390674 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390677 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390679 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390681 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390684 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390686 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390691 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390694 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390697 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390700 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390703 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390705 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390708 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390710 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:00:50.392751 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390714 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390716 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390719 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390721 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390723 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390726 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390728 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390731 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390733 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390736 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390738 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390741 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390744 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390746 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390749 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.390752 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391162 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391169 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391171 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391174 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:00:50.393259 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391177 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391179 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391182 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391184 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391187 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391189 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391192 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391194 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391197 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391201 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391205 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391208 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391212 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391216 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391219 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391222 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391225 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391227 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391230 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:00:50.393736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391232 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391235 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391237 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391240 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391242 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391245 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391247 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391250 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391252 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391255 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391257 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391260 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391263 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391265 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391268 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391271 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391274 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391276 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391278 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391281 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:00:50.394244 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391283 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391285 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391288 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391290 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391294 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391297 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391300 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391303 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391305 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391307 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391310 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391312 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391315 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391317 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391319 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391322 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391324 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391327 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391329 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391331 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:00:50.394740 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391335 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391338 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391342 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391346 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391351 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391354 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391356 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391359 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391363 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391366 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391368 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391371 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391373 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391376 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391378 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391380 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391383 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391385 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391388 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391391 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:00:50.395243 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391393 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391396 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391399 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391401 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391404 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391407 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391409 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391411 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391414 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391416 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391418 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391421 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391423 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391426 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391428 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.391431 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391509 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391517 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391525 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391532 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391540 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 13:00:50.395735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391545 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391551 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391556 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391559 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391562 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391565 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391569 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391572 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391575 2561 flags.go:64] FLAG: --cgroup-root="" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391578 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391580 2561 flags.go:64] FLAG: --client-ca-file="" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391584 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391586 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391590 2561 flags.go:64] FLAG: --cluster-domain="" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391593 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391596 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391598 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391602 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391605 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391608 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391610 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391614 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391616 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391619 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 13:00:50.396259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391622 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391625 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391627 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391631 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391634 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391637 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391639 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391643 2561 flags.go:64] FLAG: --enable-server="true" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391646 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391651 2561 flags.go:64] FLAG: --event-burst="100" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391654 2561 flags.go:64] FLAG: --event-qps="50" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391657 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391660 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391663 2561 flags.go:64] FLAG: --eviction-hard="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391666 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391669 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391672 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391675 2561 flags.go:64] FLAG: --eviction-soft="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391677 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391680 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391684 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391687 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391690 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391692 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391695 2561 flags.go:64] FLAG: --feature-gates="" Jun 10 13:00:50.396825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391699 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391701 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391704 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391707 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391710 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391713 2561 flags.go:64] FLAG: --help="false" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391715 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391718 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391721 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391724 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391727 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391730 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391733 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391735 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391739 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391742 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391744 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391751 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391754 2561 flags.go:64] FLAG: --kube-reserved="" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391756 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391759 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391763 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391765 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391768 2561 flags.go:64] FLAG: --lock-file="" Jun 10 13:00:50.397529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391771 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391774 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391776 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391782 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391785 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391788 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391790 2561 flags.go:64] FLAG: --logging-format="text" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391793 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391796 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391799 2561 flags.go:64] FLAG: --manifest-url="" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391802 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391806 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391808 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391812 2561 flags.go:64] FLAG: --max-pods="110" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391815 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391818 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391820 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391823 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391840 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391844 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391847 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391855 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391859 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391862 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 13:00:50.398144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391865 2561 flags.go:64] FLAG: --pod-cidr="" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391868 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391873 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391876 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391879 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391882 2561 flags.go:64] FLAG: --port="10250" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391885 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391888 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00216bcb5ab1fed21" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391891 2561 flags.go:64] FLAG: --qos-reserved="" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391894 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391896 2561 flags.go:64] FLAG: --register-node="true" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391899 2561 flags.go:64] FLAG: --register-with-taints="" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391903 2561 flags.go:64] FLAG: --registry-burst="10" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391906 2561 flags.go:64] FLAG: --registry-qps="5" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391909 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391911 2561 flags.go:64] FLAG: --reserved-memory="" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391922 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391924 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391927 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391930 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391933 2561 flags.go:64] FLAG: --runonce="false" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391936 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391939 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391942 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391944 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 13:00:50.398773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391947 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391950 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391953 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391956 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391958 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391962 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391965 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391968 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391970 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391974 2561 flags.go:64] FLAG: --system-cgroups="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391977 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391982 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391985 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391988 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391991 2561 flags.go:64] FLAG: --tls-min-version="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391994 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391997 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.391999 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.392002 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.392005 2561 flags.go:64] FLAG: --v="2" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.392009 2561 flags.go:64] FLAG: --version="false" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.392013 2561 flags.go:64] FLAG: --vmodule="" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.392016 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.392019 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392131 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:00:50.399401 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392135 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392138 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392141 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392144 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392146 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392148 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392151 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392154 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392156 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392158 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392161 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392163 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392167 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392170 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392172 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392175 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392179 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392182 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392184 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392187 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:00:50.400062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392190 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392194 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392197 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392199 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392202 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392205 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392207 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392209 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392212 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392215 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392217 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392220 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392223 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392225 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392228 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392230 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392233 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392235 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392237 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392240 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:00:50.400550 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392242 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392245 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392248 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392250 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392254 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392256 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392260 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392264 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392267 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392270 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392273 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392275 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392278 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392280 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392283 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392285 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392287 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392290 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392292 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392295 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:00:50.401050 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392297 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392300 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392303 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392306 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392309 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392311 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392314 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392316 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392319 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392321 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392323 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392326 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392329 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392331 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392334 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392336 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392339 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392342 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392344 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392347 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:00:50.401543 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392350 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392353 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392355 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392358 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392360 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392363 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392366 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392368 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392371 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392375 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392378 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392381 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392383 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392386 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392388 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392391 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392394 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:00:50.402044 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.392396 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.393226 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.400565 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.400580 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.400593 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.400599 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400655 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400659 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400662 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400665 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400667 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400670 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400672 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400675 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:00:50.402458 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400679 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400683 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400686 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400689 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400691 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400694 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400697 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400699 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400702 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400704 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400707 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400710 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400712 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400714 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400717 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400719 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400723 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400728 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400731 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:00:50.402814 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400735 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400737 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400741 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400744 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400747 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400750 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400753 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400756 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400758 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400761 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400763 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400766 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400768 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400771 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400774 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400776 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400779 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400781 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400784 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400787 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:00:50.403295 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400789 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400791 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400794 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400796 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400799 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400801 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400804 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400806 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400808 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400811 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400814 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400817 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400820 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400822 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400826 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400846 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400849 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400851 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400854 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400857 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:00:50.403772 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400859 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400862 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400864 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400867 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400869 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400872 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400875 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400877 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400880 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400882 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400885 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400887 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400890 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400892 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400895 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400897 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400899 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400902 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400904 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400907 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:00:50.404328 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400910 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400912 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400915 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400923 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400926 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400929 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400932 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400935 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400937 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400939 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400942 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.400944 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.400949 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401069 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401073 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:00:50.404800 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401076 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401079 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401082 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401084 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401087 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401089 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401092 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401094 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401096 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401099 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401101 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401104 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401106 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401108 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401111 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401113 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401116 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401119 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401121 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401124 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:00:50.405239 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401127 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401130 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401132 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401134 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401137 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401139 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401142 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401144 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401147 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401149 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401151 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401154 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401156 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401160 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401163 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401166 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401168 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401171 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401173 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401176 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:00:50.405761 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401178 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401180 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401183 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401185 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401187 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401190 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401193 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401197 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401200 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401202 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401204 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401207 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401209 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401212 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401215 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401217 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401220 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401222 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401225 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401227 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:00:50.406260 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401229 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401232 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401234 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401238 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401241 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401244 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401246 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401249 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401251 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401254 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401256 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401259 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401261 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401264 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401266 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401268 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401270 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401273 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401275 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:00:50.406729 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401278 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401280 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401283 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401285 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401288 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401290 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401293 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401295 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401298 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401300 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401302 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401305 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401307 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401309 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401312 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401314 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401317 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:00:50.407208 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:50.401319 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:00:50.407627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.401324 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:00:50.407627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.401423 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 13:00:50.407627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.403782 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 13:00:50.407627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.405451 2561 server.go:1019] "Starting client certificate rotation" Jun 10 13:00:50.407627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.405553 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:00:50.407627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.405592 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:00:50.408420 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.408407 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:00:50.413055 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.412218 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:00:50.424647 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.424630 2561 log.go:25] "Validated CRI v1 runtime API" Jun 10 13:00:50.427583 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.427569 2561 log.go:25] "Validated CRI v1 image API" Jun 10 13:00:50.429261 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.429243 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 13:00:50.432938 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.432918 2561 fs.go:135] Filesystem UUIDs: map[4be84f47-eeeb-4aab-bb64-a84b75aad6a4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a3cfdb19-1de0-4248-adba-edb8c61c1aab:/dev/nvme0n1p3] Jun 10 13:00:50.432987 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.432939 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 13:00:50.438063 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.437953 2561 manager.go:216] Machine: {Timestamp:2026-06-10 13:00:50.436580241 +0000 UTC m=+0.378593442 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097770 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea1ad85fb39f5fdc09de7069fb0f6 SystemUUID:ec2ea1ad-85fb-39f5-fdc0-9de7069fb0f6 BootID:a5c2160b-df2c-4ef6-be16-c1eb3bf4e143 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:7b:81:50:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:7b:81:50:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:76:06:10:a1:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 13:00:50.438063 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.438061 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 13:00:50.438169 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.438151 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 13:00:50.441338 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.441322 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:00:50.441573 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.441546 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 13:00:50.441715 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.441578 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 13:00:50.443238 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.443228 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 13:00:50.443277 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.443241 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 13:00:50.443277 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.443248 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:00:50.444450 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.444440 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:00:50.445918 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.445906 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 13:00:50.450067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450056 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:00:50.450181 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450171 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 13:00:50.450219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450199 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 10 13:00:50.450219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450209 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 13:00:50.450285 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450223 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 13:00:50.450285 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450232 2561 kubelet.go:398] "Adding apiserver pod source" Jun 10 13:00:50.450285 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450241 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 13:00:50.450596 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450583 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:00:50.450633 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.450603 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:00:50.452824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.452806 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 13:00:50.454488 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.454474 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 13:00:50.454552 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.454503 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 13:00:50.455863 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455852 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 13:00:50.455900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455868 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 13:00:50.455900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455875 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 13:00:50.455900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455880 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 13:00:50.455900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455889 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 13:00:50.455900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455895 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 13:00:50.456067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455903 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 13:00:50.456067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455909 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 13:00:50.456067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455915 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 13:00:50.456067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455920 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 13:00:50.456067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455929 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 13:00:50.456067 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.455934 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 13:00:50.456812 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.456802 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 13:00:50.456812 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.456811 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 13:00:50.459908 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.459895 2561 server.go:1268] "Started kubelet" Jun 10 13:00:50.460012 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.459988 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 13:00:50.460114 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.459980 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 13:00:50.460244 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.460130 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 13:00:50.463708 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.463686 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 13:00:50.464011 ip-10-0-128-233 systemd[1]: Started Kubernetes Kubelet. Jun 10 13:00:50.466009 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.465762 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 10 13:00:50.468646 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.468198 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 13:00:50.468724 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.468205 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 13:00:50.468778 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.468745 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 13:00:50.471473 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.471455 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 13:00:50.472849 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.471851 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-233.ec2.internal.18b7b9c8f85ea6c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-233.ec2.internal,UID:ip-10-0-128-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-233.ec2.internal,},FirstTimestamp:2026-06-10 13:00:50.459870921 +0000 UTC m=+0.401884122,LastTimestamp:2026-06-10 13:00:50.459870921 +0000 UTC m=+0.401884122,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-233.ec2.internal,}" Jun 10 13:00:50.473042 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473026 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 13:00:50.473109 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473039 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 13:00:50.473217 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.473198 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.473870 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473852 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 13:00:50.473870 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473855 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 13:00:50.473870 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473876 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 13:00:50.474068 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473989 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 10 13:00:50.474068 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.473998 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 10 13:00:50.474376 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474360 2561 factory.go:55] Registering systemd factory Jun 10 13:00:50.474458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474408 2561 factory.go:223] Registration of the systemd container factory successfully Jun 10 13:00:50.474638 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474624 2561 factory.go:153] Registering CRI-O factory Jun 10 13:00:50.474638 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474638 2561 factory.go:223] Registration of the crio container factory successfully Jun 10 13:00:50.474739 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474704 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 13:00:50.474739 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474722 2561 factory.go:103] Registering Raw factory Jun 10 13:00:50.474739 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.474731 2561 manager.go:1196] Started watching for new ooms in manager Jun 10 13:00:50.475864 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.475848 2561 manager.go:349] Starting recovery of all containers Jun 10 13:00:50.482118 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.482089 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 13:00:50.482194 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.482124 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fgphf" Jun 10 13:00:50.482239 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.482196 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 13:00:50.487044 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.487027 2561 manager.go:354] Recovery completed Jun 10 13:00:50.491157 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.491144 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.493153 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493135 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.493213 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493171 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.493213 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493182 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.493813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493798 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 13:00:50.493813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493808 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.493923 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493811 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 13:00:50.493923 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.493861 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:00:50.494480 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.494467 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.494531 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.494493 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.494531 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.494503 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.495775 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.495763 2561 policy_none.go:49] "None policy: Start" Jun 10 13:00:50.495810 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.495779 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 13:00:50.495810 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.495790 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 13:00:50.496734 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.496716 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fgphf" Jun 10 13:00:50.497189 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.497124 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-233.ec2.internal.18b7b9c8fa5a8965 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-233.ec2.internal,UID:ip-10-0-128-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-233.ec2.internal,},FirstTimestamp:2026-06-10 13:00:50.493155685 +0000 UTC m=+0.435168887,LastTimestamp:2026-06-10 13:00:50.493155685 +0000 UTC m=+0.435168887,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-233.ec2.internal,}" Jun 10 13:00:50.497477 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.497460 2561 policy_none.go:47] "Start" Jun 10 13:00:50.523535 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.523516 2561 manager.go:337] "Starting Device Plugin manager" Jun 10 13:00:50.523657 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.523560 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 13:00:50.523657 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.523573 2561 server.go:87] "Starting device plugin registration server" Jun 10 13:00:50.523864 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.523851 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 13:00:50.523937 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.523866 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 13:00:50.523985 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.523944 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 13:00:50.524044 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.524035 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 13:00:50.524093 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.524045 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 13:00:50.524612 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.524589 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 13:00:50.524688 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.524638 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.553979 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.553946 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 13:00:50.562582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.555259 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 13:00:50.562582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.555294 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 13:00:50.562582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.555316 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 13:00:50.562582 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.555350 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 13:00:50.562582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.558700 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:00:50.624235 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.624212 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.625111 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.625093 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.625228 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.625130 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.625228 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.625147 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.625228 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.625180 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.638169 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.638114 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.638169 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.638139 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-233.ec2.internal\": node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.656165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.656143 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal"] Jun 10 13:00:50.656235 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.656201 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.656972 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.656956 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.657061 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.656981 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.657061 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.656991 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.659543 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.659529 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.659671 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.659656 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.659729 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.659695 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.660438 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.660420 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.660539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.660450 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.660539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.660461 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.660539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.660472 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.660539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.660490 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.660539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.660500 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.662698 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.662684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.662748 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.662716 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:00:50.665061 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.665046 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:00:50.665136 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.665076 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:00:50.665136 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.665086 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:00:50.671079 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.671065 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.675772 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.675753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c8e7e5c3e3b873cc5c1665483d3722f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"2c8e7e5c3e3b873cc5c1665483d3722f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.675854 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.675780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c8e7e5c3e3b873cc5c1665483d3722f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"2c8e7e5c3e3b873cc5c1665483d3722f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.675854 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.675799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b34c1dd48d0ad7bd636471024083f38f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-233.ec2.internal\" (UID: \"b34c1dd48d0ad7bd636471024083f38f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.687372 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.687357 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-233.ec2.internal\" not found" node="ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.692648 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.692631 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-233.ec2.internal\" not found" node="ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.771182 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.771161 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.776358 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.776342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c8e7e5c3e3b873cc5c1665483d3722f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"2c8e7e5c3e3b873cc5c1665483d3722f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.776422 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.776366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b34c1dd48d0ad7bd636471024083f38f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-233.ec2.internal\" (UID: \"b34c1dd48d0ad7bd636471024083f38f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.776422 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.776382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c8e7e5c3e3b873cc5c1665483d3722f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"2c8e7e5c3e3b873cc5c1665483d3722f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.776521 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.776418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c8e7e5c3e3b873cc5c1665483d3722f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"2c8e7e5c3e3b873cc5c1665483d3722f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.776521 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.776450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c8e7e5c3e3b873cc5c1665483d3722f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal\" (UID: \"2c8e7e5c3e3b873cc5c1665483d3722f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.776521 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.776464 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b34c1dd48d0ad7bd636471024083f38f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-233.ec2.internal\" (UID: \"b34c1dd48d0ad7bd636471024083f38f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.872028 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.871995 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.972512 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:50.972437 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:50.993911 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.993887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:50.999920 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:50.999547 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jun 10 13:00:51.073491 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.073454 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.173890 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.173860 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.274304 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.274277 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.374765 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.374737 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.405047 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.405020 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 13:00:51.405583 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.405154 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:00:51.475726 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.475694 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.499894 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.499855 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:55:50 +0000 UTC" deadline="2027-12-15 18:41:27.952546104 +0000 UTC" Jun 10 13:00:51.499894 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.499888 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13277h40m36.452660787s" Jun 10 13:00:51.555649 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:51.555615 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8e7e5c3e3b873cc5c1665483d3722f.slice/crio-c9b332800ea8e7728130ec23d8538b55a751f094ba64873720a79b58119351ad WatchSource:0}: Error finding container c9b332800ea8e7728130ec23d8538b55a751f094ba64873720a79b58119351ad: Status 404 returned error can't find the container with id c9b332800ea8e7728130ec23d8538b55a751f094ba64873720a79b58119351ad Jun 10 13:00:51.556297 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:51.556279 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34c1dd48d0ad7bd636471024083f38f.slice/crio-741630d005b79ccf9d24a87a0c29edee19a8d5c9e704d5355ef73b76c9dda53c WatchSource:0}: Error finding container 741630d005b79ccf9d24a87a0c29edee19a8d5c9e704d5355ef73b76c9dda53c: Status 404 returned error can't find the container with id 741630d005b79ccf9d24a87a0c29edee19a8d5c9e704d5355ef73b76c9dda53c Jun 10 13:00:51.560219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.560202 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:00:51.576065 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.576039 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.636133 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.636109 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:00:51.676704 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:51.676681 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-233.ec2.internal\" not found" Jun 10 13:00:51.746450 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.746426 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:00:51.773477 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.773460 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" Jun 10 13:00:51.785252 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.785231 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:00:51.786402 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.786389 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" Jun 10 13:00:51.795962 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.795918 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:00:51.914203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:51.914181 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:00:52.451604 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.451575 2561 apiserver.go:52] "Watching apiserver" Jun 10 13:00:52.460646 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.460617 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 13:00:52.461057 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.461035 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-cbs6f","openshift-network-diagnostics/network-check-target-t79fc","openshift-network-operator/iptables-alerter-cpxb4","openshift-ovn-kubernetes/ovnkube-node-b6k2t","kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg","openshift-cluster-node-tuning-operator/tuned-tbf7p","openshift-dns/node-resolver-kcnp9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-tvsdn","openshift-multus/multus-q7tfw","openshift-multus/network-metrics-daemon-ntrxb","kube-system/global-pull-secret-syncer-fk5k7","kube-system/konnectivity-agent-x7g6s"] Jun 10 13:00:52.463661 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.463634 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.465689 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.465659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.466655 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.466631 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h8lf8\"" Jun 10 13:00:52.466773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.466631 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.466773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.466634 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.467872 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.467843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.468353 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.468335 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 13:00:52.468447 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.468383 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 13:00:52.468447 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.468440 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.468550 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.468446 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hptb6\"" Jun 10 13:00:52.468632 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.468614 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.470320 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.470303 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.470610 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.470595 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j8s4f\"" Jun 10 13:00:52.470610 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.470605 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.470778 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.470764 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.471263 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.471237 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 13:00:52.472438 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.472423 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.473533 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.473513 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 13:00:52.473533 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.473526 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.473656 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.473625 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 13:00:52.475112 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.475088 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 13:00:52.475203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.475119 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.475342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.475309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.475427 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.475408 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 13:00:52.475487 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.475442 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xdkf5\"" Jun 10 13:00:52.475917 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.475897 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 13:00:52.477092 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.477073 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ghpbg\"" Jun 10 13:00:52.477200 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.477184 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 13:00:52.478463 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.477916 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 13:00:52.478463 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.478256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dt58d\"" Jun 10 13:00:52.478660 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.478643 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.478730 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.478681 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.478730 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.478680 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 13:00:52.479863 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.479788 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.482079 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.482062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.482187 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.482145 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:00:52.484375 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:52.484480 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.484423 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:00:52.484480 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-kubelet\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.484580 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-node-log\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.484580 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.484580 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-ovnkube-config\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.484725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-cni-multus\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.484725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b07f1adb-426f-42d7-8f81-52983d908246-host-slash\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.484725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-cni-bin\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.484725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vkv\" (UniqueName: \"kubernetes.io/projected/5c59700d-d06a-4359-85e3-9184a55014af-kube-api-access-75vkv\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.484725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.484725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-sys-fs\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5h5\" (UniqueName: \"kubernetes.io/projected/96ffd465-415a-42e5-bd60-be45e2e60890-kube-api-access-8m5h5\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxtfx\" (UniqueName: \"kubernetes.io/projected/b07f1adb-426f-42d7-8f81-52983d908246-kube-api-access-lxtfx\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-env-overrides\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-lib-modules\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96ffd465-415a-42e5-bd60-be45e2e60890-etc-tuned\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484952 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-systemd\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484974 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-run-ovn-kubernetes\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.484989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-host\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485032 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-cnibin\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-etc-kubernetes\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-etc-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-systemd\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ffd465-415a-42e5-bd60-be45e2e60890-tmp\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-k8s-cni-cncf-io\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-hostroot\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-kubelet\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-systemd-units\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-slash\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-var-lib-kubelet\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-system-cni-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-cni-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-daemon-config\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-modprobe-d\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-os-release\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-run-netns\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.485458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485450 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bptmt\" (UniqueName: \"kubernetes.io/projected/e4e688e4-31dd-403f-867c-5e9012ddb5a7-kube-api-access-bptmt\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f915b1e-4531-4ff2-a86a-9be8c3355a55-cni-binary-copy\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7sng\" (UniqueName: \"kubernetes.io/projected/6f915b1e-4531-4ff2-a86a-9be8c3355a55-kube-api-access-b7sng\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-cni-netd\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/272e5243-db29-4751-abba-597ed272b81f-agent-certs\") pod \"konnectivity-agent-x7g6s\" (UID: \"272e5243-db29-4751-abba-597ed272b81f\") " pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-ovn\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/272e5243-db29-4751-abba-597ed272b81f-konnectivity-ca\") pod \"konnectivity-agent-x7g6s\" (UID: \"272e5243-db29-4751-abba-597ed272b81f\") " pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysconfig\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-netns\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-conf-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-multus-certs\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b07f1adb-426f-42d7-8f81-52983d908246-iptables-alerter-script\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-socket-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysctl-conf\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-run\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-cni-bin\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-log-socket\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-ovnkube-script-lib\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-sys\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.485967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-socket-dir-parent\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-device-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c59700d-d06a-4359-85e3-9184a55014af-ovn-node-metrics-cert\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-registration-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-var-lib-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-kubernetes\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.486755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysctl-d\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.487274 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486768 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.487274 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486781 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cdj6w\"" Jun 10 13:00:52.487274 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.486874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.488579 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.488558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.489111 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.489096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.490430 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.490269 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 13:00:52.490430 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.490356 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 13:00:52.490580 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.490441 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vxjgn\"" Jun 10 13:00:52.491402 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.491384 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:52.491499 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.491445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:00:52.494402 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.494369 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 13:00:52.494507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.494433 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 13:00:52.496417 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.496397 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:00:52.497389 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.497367 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-865kf\"" Jun 10 13:00:52.501718 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.501700 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 13:00:52.536463 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.536443 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zc795" Jun 10 13:00:52.545394 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.545377 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zc795" Jun 10 13:00:52.560304 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.560260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" event={"ID":"b34c1dd48d0ad7bd636471024083f38f","Type":"ContainerStarted","Data":"741630d005b79ccf9d24a87a0c29edee19a8d5c9e704d5355ef73b76c9dda53c"} Jun 10 13:00:52.561422 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.561401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" event={"ID":"2c8e7e5c3e3b873cc5c1665483d3722f","Type":"ContainerStarted","Data":"c9b332800ea8e7728130ec23d8538b55a751f094ba64873720a79b58119351ad"} Jun 10 13:00:52.575770 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.575736 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 13:00:52.586388 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-netns\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.586483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-conf-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.586483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-multus-certs\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.586483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b07f1adb-426f-42d7-8f81-52983d908246-iptables-alerter-script\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.586483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbvj\" (UniqueName: \"kubernetes.io/projected/a0454db3-1642-4fd1-9b32-723666816224-kube-api-access-znbvj\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.586483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-hosts-file\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586488 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-netns\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-socket-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-multus-certs\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysctl-conf\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-run\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-cni-bin\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-log-socket\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586612 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-ovnkube-script-lib\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjz58\" (UniqueName: \"kubernetes.io/projected/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-kube-api-access-xjz58\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.586649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586644 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-socket-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-sys\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-socket-dir-parent\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-cni-bin\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-device-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c59700d-d06a-4359-85e3-9184a55014af-ovn-node-metrics-cert\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e360f1a8-c94e-4367-a134-f31a74dfc75e-dbus\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysctl-conf\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-registration-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-var-lib-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586868 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-run\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-log-socket\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586932 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e360f1a8-c94e-4367-a134-f31a74dfc75e-kubelet-config\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.587033 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-device-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.586998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzgr\" (UniqueName: \"kubernetes.io/projected/25724863-3fd3-4d40-a01e-520f9c8313c3-kube-api-access-9bzgr\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b07f1adb-426f-42d7-8f81-52983d908246-iptables-alerter-script\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-tmp-dir\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rb5\" (UniqueName: \"kubernetes.io/projected/095e9e21-d6d2-4d98-a61d-2722143b78ef-kube-api-access-86rb5\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-registration-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-kubernetes\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysctl-d\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-kubelet\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-node-log\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-ovnkube-config\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095e9e21-d6d2-4d98-a61d-2722143b78ef-host\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-cni-multus\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587245 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b07f1adb-426f-42d7-8f81-52983d908246-host-slash\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-cni-bin\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.587606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b07f1adb-426f-42d7-8f81-52983d908246-host-slash\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vkv\" (UniqueName: \"kubernetes.io/projected/5c59700d-d06a-4359-85e3-9184a55014af-kube-api-access-75vkv\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-sys-fs\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587376 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5h5\" (UniqueName: \"kubernetes.io/projected/96ffd465-415a-42e5-bd60-be45e2e60890-kube-api-access-8m5h5\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxtfx\" (UniqueName: \"kubernetes.io/projected/b07f1adb-426f-42d7-8f81-52983d908246-kube-api-access-lxtfx\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-env-overrides\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587458 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-socket-dir-parent\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-system-cni-dir\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-lib-modules\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-cni-bin\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96ffd465-415a-42e5-bd60-be45e2e60890-etc-tuned\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-systemd\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587580 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-kubernetes\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-ovnkube-script-lib\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587672 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-conf-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.588329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysctl-d\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-cni-multus\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-systemd\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-var-lib-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587780 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-var-lib-kubelet\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-run-ovn-kubernetes\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-sys\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-host\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-sys-fs\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-lib-modules\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.587985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-node-log\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-run-ovn-kubernetes\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588111 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-ovnkube-config\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-cnibin\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-etc-kubernetes\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588176 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-host\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-etc-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589052 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-cnibin\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-systemd\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ffd465-415a-42e5-bd60-be45e2e60890-tmp\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588363 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-cnibin\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-k8s-cni-cncf-io\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-hostroot\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-kubelet\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-systemd-units\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-etc-openvswitch\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-slash\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-systemd\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/095e9e21-d6d2-4d98-a61d-2722143b78ef-serviceca\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c59700d-d06a-4359-85e3-9184a55014af-env-overrides\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-var-lib-kubelet\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-system-cni-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-cni-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-daemon-config\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.589564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-modprobe-d\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-os-release\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-run-netns\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bptmt\" (UniqueName: \"kubernetes.io/projected/e4e688e4-31dd-403f-867c-5e9012ddb5a7-kube-api-access-bptmt\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f915b1e-4531-4ff2-a86a-9be8c3355a55-cni-binary-copy\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7sng\" (UniqueName: \"kubernetes.io/projected/6f915b1e-4531-4ff2-a86a-9be8c3355a55-kube-api-access-b7sng\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.588977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-cni-netd\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/272e5243-db29-4751-abba-597ed272b81f-agent-certs\") pod \"konnectivity-agent-x7g6s\" (UID: \"272e5243-db29-4751-abba-597ed272b81f\") " pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-ovn\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/272e5243-db29-4751-abba-597ed272b81f-konnectivity-ca\") pod \"konnectivity-agent-x7g6s\" (UID: \"272e5243-db29-4751-abba-597ed272b81f\") " pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-os-release\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysconfig\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-sysconfig\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.590203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-run-netns\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589368 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-kubelet\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-etc-kubernetes\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-hostroot\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589470 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-systemd-units\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589501 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-slash\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-var-lib-kubelet\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-system-cni-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-cni-dir\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-host-run-k8s-cni-cncf-io\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589740 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-host-cni-netd\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96ffd465-415a-42e5-bd60-be45e2e60890-etc-modprobe-d\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.589886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f915b1e-4531-4ff2-a86a-9be8c3355a55-os-release\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.590106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f915b1e-4531-4ff2-a86a-9be8c3355a55-multus-daemon-config\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.590616 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f915b1e-4531-4ff2-a86a-9be8c3355a55-cni-binary-copy\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.590919 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c59700d-d06a-4359-85e3-9184a55014af-run-ovn\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.590979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96ffd465-415a-42e5-bd60-be45e2e60890-etc-tuned\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.591031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ffd465-415a-42e5-bd60-be45e2e60890-tmp\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.591070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.591051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4e688e4-31dd-403f-867c-5e9012ddb5a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.591925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.591392 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c59700d-d06a-4359-85e3-9184a55014af-ovn-node-metrics-cert\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.591925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.591457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/272e5243-db29-4751-abba-597ed272b81f-konnectivity-ca\") pod \"konnectivity-agent-x7g6s\" (UID: \"272e5243-db29-4751-abba-597ed272b81f\") " pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.592864 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.592843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/272e5243-db29-4751-abba-597ed272b81f-agent-certs\") pod \"konnectivity-agent-x7g6s\" (UID: \"272e5243-db29-4751-abba-597ed272b81f\") " pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.600189 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.600170 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5h5\" (UniqueName: \"kubernetes.io/projected/96ffd465-415a-42e5-bd60-be45e2e60890-kube-api-access-8m5h5\") pod \"tuned-tbf7p\" (UID: \"96ffd465-415a-42e5-bd60-be45e2e60890\") " pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.601736 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.601714 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7sng\" (UniqueName: \"kubernetes.io/projected/6f915b1e-4531-4ff2-a86a-9be8c3355a55-kube-api-access-b7sng\") pod \"multus-q7tfw\" (UID: \"6f915b1e-4531-4ff2-a86a-9be8c3355a55\") " pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.602157 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.602133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vkv\" (UniqueName: \"kubernetes.io/projected/5c59700d-d06a-4359-85e3-9184a55014af-kube-api-access-75vkv\") pod \"ovnkube-node-b6k2t\" (UID: \"5c59700d-d06a-4359-85e3-9184a55014af\") " pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.602236 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.602142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxtfx\" (UniqueName: \"kubernetes.io/projected/b07f1adb-426f-42d7-8f81-52983d908246-kube-api-access-lxtfx\") pod \"iptables-alerter-cpxb4\" (UID: \"b07f1adb-426f-42d7-8f81-52983d908246\") " pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.603858 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.603821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bptmt\" (UniqueName: \"kubernetes.io/projected/e4e688e4-31dd-403f-867c-5e9012ddb5a7-kube-api-access-bptmt\") pod \"aws-ebs-csi-driver-node-bwzwg\" (UID: \"e4e688e4-31dd-403f-867c-5e9012ddb5a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.690245 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.690245 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:52.690410 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-os-release\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.690410 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690329 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-os-release\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.690410 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.690376 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:52.690529 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.690451 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:00:53.190435695 +0000 UTC m=+3.132448883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:52.690529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.690529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbvj\" (UniqueName: \"kubernetes.io/projected/a0454db3-1642-4fd1-9b32-723666816224-kube-api-access-znbvj\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.690529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-hosts-file\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.690729 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjz58\" (UniqueName: \"kubernetes.io/projected/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-kube-api-access-xjz58\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.690729 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.690729 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-hosts-file\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.690729 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:52.690729 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e360f1a8-c94e-4367-a134-f31a74dfc75e-dbus\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690768 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e360f1a8-c94e-4367-a134-f31a74dfc75e-dbus\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e360f1a8-c94e-4367-a134-f31a74dfc75e-kubelet-config\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzgr\" (UniqueName: \"kubernetes.io/projected/25724863-3fd3-4d40-a01e-520f9c8313c3-kube-api-access-9bzgr\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.690912 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e360f1a8-c94e-4367-a134-f31a74dfc75e-kubelet-config\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.690928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-tmp-dir\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.691021 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.690972 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:00:53.190955228 +0000 UTC m=+3.132968416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rb5\" (UniqueName: \"kubernetes.io/projected/095e9e21-d6d2-4d98-a61d-2722143b78ef-kube-api-access-86rb5\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095e9e21-d6d2-4d98-a61d-2722143b78ef-host\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-system-cni-dir\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095e9e21-d6d2-4d98-a61d-2722143b78ef-host\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-system-cni-dir\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-tmp-dir\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0454db3-1642-4fd1-9b32-723666816224-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-cnibin\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-cnibin\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691391 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/095e9e21-d6d2-4d98-a61d-2722143b78ef-serviceca\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.691795 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0454db3-1642-4fd1-9b32-723666816224-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.691981 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.691961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/095e9e21-d6d2-4d98-a61d-2722143b78ef-serviceca\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.707238 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.707175 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:00:52.707238 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.707197 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:00:52.707238 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.707208 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:52.707433 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:52.707265 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:00:53.207249169 +0000 UTC m=+3.149262364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:52.708932 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.708904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rb5\" (UniqueName: \"kubernetes.io/projected/095e9e21-d6d2-4d98-a61d-2722143b78ef-kube-api-access-86rb5\") pod \"node-ca-cbs6f\" (UID: \"095e9e21-d6d2-4d98-a61d-2722143b78ef\") " pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:52.709380 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.709350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzgr\" (UniqueName: \"kubernetes.io/projected/25724863-3fd3-4d40-a01e-520f9c8313c3-kube-api-access-9bzgr\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:52.709870 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.709849 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:00:52.710176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.710149 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjz58\" (UniqueName: \"kubernetes.io/projected/c9e4f1e4-ad30-4373-94df-80c9fe81a36f-kube-api-access-xjz58\") pod \"node-resolver-kcnp9\" (UID: \"c9e4f1e4-ad30-4373-94df-80c9fe81a36f\") " pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.710255 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.710210 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbvj\" (UniqueName: \"kubernetes.io/projected/a0454db3-1642-4fd1-9b32-723666816224-kube-api-access-znbvj\") pod \"multus-additional-cni-plugins-tvsdn\" (UID: \"a0454db3-1642-4fd1-9b32-723666816224\") " pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.775253 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.775224 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" Jun 10 13:00:52.783167 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.783130 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7tfw" Jun 10 13:00:52.794382 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.794361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpxb4" Jun 10 13:00:52.798934 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.798904 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:00:52.805483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.805464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:00:52.812014 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.811992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" Jun 10 13:00:52.818528 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.818510 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcnp9" Jun 10 13:00:52.824265 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.824248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" Jun 10 13:00:52.830824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:52.830807 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cbs6f" Jun 10 13:00:53.194453 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.194417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:53.194623 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.194477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:53.194623 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.194541 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:53.194623 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.194564 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:53.194623 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.194613 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:00:54.194597033 +0000 UTC m=+4.136610233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:53.194796 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.194634 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:00:54.194624069 +0000 UTC m=+4.136637270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:53.295046 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.295004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:53.295212 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.295186 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:00:53.295212 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.295209 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:00:53.295333 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.295222 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:53.295333 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.295282 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:00:54.295263407 +0000 UTC m=+4.237276598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:53.397309 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.397028 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e4f1e4_ad30_4373_94df_80c9fe81a36f.slice/crio-192e8bfc0b27cf30120601450809d13e1888454f2b274df821b4b921206b2c51 WatchSource:0}: Error finding container 192e8bfc0b27cf30120601450809d13e1888454f2b274df821b4b921206b2c51: Status 404 returned error can't find the container with id 192e8bfc0b27cf30120601450809d13e1888454f2b274df821b4b921206b2c51 Jun 10 13:00:53.397666 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.397506 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07f1adb_426f_42d7_8f81_52983d908246.slice/crio-186f9bc20a754f661574ce0924951abfc6dd6018cfdd6fbf9941820a0abd5290 WatchSource:0}: Error finding container 186f9bc20a754f661574ce0924951abfc6dd6018cfdd6fbf9941820a0abd5290: Status 404 returned error can't find the container with id 186f9bc20a754f661574ce0924951abfc6dd6018cfdd6fbf9941820a0abd5290 Jun 10 13:00:53.398766 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.398682 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e688e4_31dd_403f_867c_5e9012ddb5a7.slice/crio-76d900877314c0d769b7faa268bf6ea10229e18c39b1668325e4127542a07524 WatchSource:0}: Error finding container 76d900877314c0d769b7faa268bf6ea10229e18c39b1668325e4127542a07524: Status 404 returned error can't find the container with id 76d900877314c0d769b7faa268bf6ea10229e18c39b1668325e4127542a07524 Jun 10 13:00:53.399736 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.399718 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ffd465_415a_42e5_bd60_be45e2e60890.slice/crio-449731ebc285f368dce4fa38233483d1db50a28dd7f4d4e0c727a9662e7332c8 WatchSource:0}: Error finding container 449731ebc285f368dce4fa38233483d1db50a28dd7f4d4e0c727a9662e7332c8: Status 404 returned error can't find the container with id 449731ebc285f368dce4fa38233483d1db50a28dd7f4d4e0c727a9662e7332c8 Jun 10 13:00:53.422440 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.422350 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c59700d_d06a_4359_85e3_9184a55014af.slice/crio-984ce78c75b82cc5f8514eff78da32b5f4b21a72185bf3b51e0577478ee02660 WatchSource:0}: Error finding container 984ce78c75b82cc5f8514eff78da32b5f4b21a72185bf3b51e0577478ee02660: Status 404 returned error can't find the container with id 984ce78c75b82cc5f8514eff78da32b5f4b21a72185bf3b51e0577478ee02660 Jun 10 13:00:53.425086 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.425064 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0454db3_1642_4fd1_9b32_723666816224.slice/crio-640bd945c09db2d07340e8d8dd2dcc2e80ecfc5914dd1507f8dbc139eef94292 WatchSource:0}: Error finding container 640bd945c09db2d07340e8d8dd2dcc2e80ecfc5914dd1507f8dbc139eef94292: Status 404 returned error can't find the container with id 640bd945c09db2d07340e8d8dd2dcc2e80ecfc5914dd1507f8dbc139eef94292 Jun 10 13:00:53.425967 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.425943 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095e9e21_d6d2_4d98_a61d_2722143b78ef.slice/crio-06b523e650cf9a595d2a5d730f4b3d6232d94fa2c0ca3bc3b9e29439e406cdcf WatchSource:0}: Error finding container 06b523e650cf9a595d2a5d730f4b3d6232d94fa2c0ca3bc3b9e29439e406cdcf: Status 404 returned error can't find the container with id 06b523e650cf9a595d2a5d730f4b3d6232d94fa2c0ca3bc3b9e29439e406cdcf Jun 10 13:00:53.427066 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.427038 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272e5243_db29_4751_abba_597ed272b81f.slice/crio-f409b8cf47dc4f85e6bcd6303384b57d5423992ea01b8ae1caf05422cc0f5214 WatchSource:0}: Error finding container f409b8cf47dc4f85e6bcd6303384b57d5423992ea01b8ae1caf05422cc0f5214: Status 404 returned error can't find the container with id f409b8cf47dc4f85e6bcd6303384b57d5423992ea01b8ae1caf05422cc0f5214 Jun 10 13:00:53.427526 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:00:53.427505 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f915b1e_4531_4ff2_a86a_9be8c3355a55.slice/crio-179fbe2f9b0785499c2535e9178308508e07bbad88ab3b64541adcf9f369b5a7 WatchSource:0}: Error finding container 179fbe2f9b0785499c2535e9178308508e07bbad88ab3b64541adcf9f369b5a7: Status 404 returned error can't find the container with id 179fbe2f9b0785499c2535e9178308508e07bbad88ab3b64541adcf9f369b5a7 Jun 10 13:00:53.548692 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.548627 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:55:52 +0000 UTC" deadline="2027-12-14 11:00:23.825933079 +0000 UTC" Jun 10 13:00:53.548692 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.548690 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13245h59m30.277245915s" Jun 10 13:00:53.555935 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.555915 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:53.556032 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:53.556015 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:00:53.566299 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.566269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" event={"ID":"b34c1dd48d0ad7bd636471024083f38f","Type":"ContainerStarted","Data":"7fe5403091e7a9b6b19547c41288d032d733ece5ff0bb767a47962e0844cb3c0"} Jun 10 13:00:53.568320 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.568297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7tfw" event={"ID":"6f915b1e-4531-4ff2-a86a-9be8c3355a55","Type":"ContainerStarted","Data":"179fbe2f9b0785499c2535e9178308508e07bbad88ab3b64541adcf9f369b5a7"} Jun 10 13:00:53.569390 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.569362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerStarted","Data":"640bd945c09db2d07340e8d8dd2dcc2e80ecfc5914dd1507f8dbc139eef94292"} Jun 10 13:00:53.573374 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.573348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"984ce78c75b82cc5f8514eff78da32b5f4b21a72185bf3b51e0577478ee02660"} Jun 10 13:00:53.574279 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.574260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" event={"ID":"96ffd465-415a-42e5-bd60-be45e2e60890","Type":"ContainerStarted","Data":"449731ebc285f368dce4fa38233483d1db50a28dd7f4d4e0c727a9662e7332c8"} Jun 10 13:00:53.575309 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.575282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpxb4" event={"ID":"b07f1adb-426f-42d7-8f81-52983d908246","Type":"ContainerStarted","Data":"186f9bc20a754f661574ce0924951abfc6dd6018cfdd6fbf9941820a0abd5290"} Jun 10 13:00:53.580289 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.580271 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x7g6s" event={"ID":"272e5243-db29-4751-abba-597ed272b81f","Type":"ContainerStarted","Data":"f409b8cf47dc4f85e6bcd6303384b57d5423992ea01b8ae1caf05422cc0f5214"} Jun 10 13:00:53.584675 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.584656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cbs6f" event={"ID":"095e9e21-d6d2-4d98-a61d-2722143b78ef","Type":"ContainerStarted","Data":"06b523e650cf9a595d2a5d730f4b3d6232d94fa2c0ca3bc3b9e29439e406cdcf"} Jun 10 13:00:53.586253 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.586231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" event={"ID":"e4e688e4-31dd-403f-867c-5e9012ddb5a7","Type":"ContainerStarted","Data":"76d900877314c0d769b7faa268bf6ea10229e18c39b1668325e4127542a07524"} Jun 10 13:00:53.588464 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:53.588447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcnp9" event={"ID":"c9e4f1e4-ad30-4373-94df-80c9fe81a36f","Type":"ContainerStarted","Data":"192e8bfc0b27cf30120601450809d13e1888454f2b274df821b4b921206b2c51"} Jun 10 13:00:54.207970 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.207929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:54.208190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.208009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:54.208190 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.208161 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:54.208305 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.208221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:00:56.208202336 +0000 UTC m=+6.150215547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:54.208691 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.208665 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:54.208791 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.208719 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:00:56.208704556 +0000 UTC m=+6.150717758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:54.309165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.309129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:54.309340 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.309299 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:00:54.309340 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.309316 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:00:54.309340 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.309328 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:54.309497 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.309381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:00:56.30936487 +0000 UTC m=+6.251378081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:54.549429 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.549361 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:55:52 +0000 UTC" deadline="2028-03-15 02:56:08.76612642 +0000 UTC" Jun 10 13:00:54.549429 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.549425 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15445h55m14.21670541s" Jun 10 13:00:54.558691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.558079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:54.558691 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.558195 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:00:54.558691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.558571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:54.558691 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:54.558658 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:00:54.599429 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.599399 2561 generic.go:356] "Generic (PLEG): container finished" podID="2c8e7e5c3e3b873cc5c1665483d3722f" containerID="207e3e0ccb044575b6b69ce4f427d55b739a15dd9c3897e94348f87991393fb9" exitCode=0 Jun 10 13:00:54.599917 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.599886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" event={"ID":"2c8e7e5c3e3b873cc5c1665483d3722f","Type":"ContainerDied","Data":"207e3e0ccb044575b6b69ce4f427d55b739a15dd9c3897e94348f87991393fb9"} Jun 10 13:00:54.627945 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:54.626979 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-233.ec2.internal" podStartSLOduration=3.626962066 podStartE2EDuration="3.626962066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:00:53.592506795 +0000 UTC m=+3.534520005" watchObservedRunningTime="2026-06-10 13:00:54.626962066 +0000 UTC m=+4.568975276" Jun 10 13:00:55.556333 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:55.556300 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:55.556792 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:55.556455 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:00:55.622051 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:55.622011 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" event={"ID":"2c8e7e5c3e3b873cc5c1665483d3722f","Type":"ContainerStarted","Data":"2c836042311a5ff859897245586ec2a631de1ae441a9e145b900001212f8643a"} Jun 10 13:00:56.224774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:56.224035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:56.224774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:56.224110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:56.224774 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.224233 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:56.224774 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.224290 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:01:00.22427205 +0000 UTC m=+10.166285244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:00:56.224774 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.224685 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:56.224774 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.224737 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:00.224720503 +0000 UTC m=+10.166733697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:00:56.325679 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:56.325083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:56.325679 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.325249 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:00:56.325679 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.325268 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:00:56.325679 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.325280 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:56.325679 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.325329 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:00.325312644 +0000 UTC m=+10.267325850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:00:56.559427 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:56.558731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:56.559427 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.558864 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:00:56.559427 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:56.559245 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:56.559427 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:56.559334 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:00:57.556250 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:57.556219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:57.556516 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:57.556365 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:00:58.556321 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:58.556274 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:00:58.556719 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:58.556407 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:00:58.556719 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:58.556435 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:00:58.556719 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:58.556622 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:00:59.555809 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:00:59.555777 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:00:59.556000 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:00:59.555965 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:00.258652 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:00.258617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:00.259121 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:00.258682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:00.259121 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.258790 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:00.259121 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.258859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:01:08.258824943 +0000 UTC m=+18.200838131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:00.259278 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.259225 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:00.259320 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.259279 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:08.259263267 +0000 UTC m=+18.201276462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:00.359317 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:00.359281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:00.359506 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.359452 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:00.359506 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.359471 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:00.359506 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.359483 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:00.359683 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.359536 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:08.359518922 +0000 UTC m=+18.301532113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:00.557340 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:00.557262 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:00.557458 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.557367 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:00.557784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:00.557767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:00.557924 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:00.557873 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:01.555952 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:01.555916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:01.556445 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:01.556074 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:02.556991 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:02.556953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:02.557458 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:02.557099 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:02.557458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:02.557155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:02.557458 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:02.557297 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:03.555656 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:03.555621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:03.555806 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:03.555744 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:04.556542 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:04.556508 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:04.556542 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:04.556535 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:04.557067 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:04.556648 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:04.557067 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:04.556767 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:05.555691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:05.555655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:05.555894 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:05.555794 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:06.556443 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:06.556404 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:06.556887 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:06.556549 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:06.556887 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:06.556608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:06.556887 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:06.556739 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:07.556049 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:07.556009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:07.556264 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:07.556149 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:08.320259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:08.320221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:08.320763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:08.320290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:08.320763 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.320396 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:08.320763 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.320419 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:08.320763 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.320473 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:24.32045237 +0000 UTC m=+34.262465563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:08.320763 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.320493 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:01:24.320483327 +0000 UTC m=+34.262496515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:08.421112 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:08.421074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:08.421272 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.421239 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:08.421272 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.421259 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:08.421272 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.421273 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:08.421389 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.421331 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:24.421314892 +0000 UTC m=+34.363328080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:08.555876 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:08.555822 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:08.556071 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:08.555849 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:08.556071 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.555986 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:08.556071 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:08.556061 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:09.556329 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:09.556285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:09.556905 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:09.556429 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:10.556583 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:10.556543 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:10.557046 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:10.556644 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:10.557046 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:10.556742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:10.557046 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:10.556894 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:11.556537 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:11.556506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:11.556712 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:11.556640 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:12.556269 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:12.556225 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:12.556269 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:12.556255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:12.556499 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:12.556337 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:12.556499 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:12.556442 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:13.555504 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.555477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:13.556105 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:13.555587 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:13.658743 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.658599 2561 generic.go:356] "Generic (PLEG): container finished" podID="a0454db3-1642-4fd1-9b32-723666816224" containerID="09e91cc879e84cac3b8a621b3281c61c198f8c4ee0d995940584d036dad10323" exitCode=0 Jun 10 13:01:13.658873 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.658696 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerDied","Data":"09e91cc879e84cac3b8a621b3281c61c198f8c4ee0d995940584d036dad10323"} Jun 10 13:01:13.661416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.661392 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:01:13.662174 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.662147 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c59700d-d06a-4359-85e3-9184a55014af" containerID="507c0733ed984248ef0984feb393dc8f2d1b7e7f06e84a3ad09911085d3a4e50" exitCode=1 Jun 10 13:01:13.662283 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.662228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerDied","Data":"507c0733ed984248ef0984feb393dc8f2d1b7e7f06e84a3ad09911085d3a4e50"} Jun 10 13:01:13.662344 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.662298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"83762a29059de608ac7c5786d9e16632d3bb8bdc36fa39a6fdc43e45b0a86f61"} Jun 10 13:01:13.664120 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.664040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" event={"ID":"96ffd465-415a-42e5-bd60-be45e2e60890","Type":"ContainerStarted","Data":"2344bc9c157e84c5f2c85610e635b7075b9bd261465eaffee31d3afe5306f24f"} Jun 10 13:01:13.666395 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.666370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x7g6s" event={"ID":"272e5243-db29-4751-abba-597ed272b81f","Type":"ContainerStarted","Data":"9efebfed6c8ad51c645a42751b353862c806481b640a0a87b69a12d8419c6d56"} Jun 10 13:01:13.667773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.667743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cbs6f" event={"ID":"095e9e21-d6d2-4d98-a61d-2722143b78ef","Type":"ContainerStarted","Data":"26ddd8ef9d2df57e297ae3081ff837efeabe3afecaea000e16e93e2497057736"} Jun 10 13:01:13.669486 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.669457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" event={"ID":"e4e688e4-31dd-403f-867c-5e9012ddb5a7","Type":"ContainerStarted","Data":"a2366639169b609142dca26568911a343e963664991c67aa67a08f3fa68283da"} Jun 10 13:01:13.671475 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.671449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcnp9" event={"ID":"c9e4f1e4-ad30-4373-94df-80c9fe81a36f","Type":"ContainerStarted","Data":"b9806a1f14ec676f747bf8dee8993ed5df11dc6d8e0f4f6c1de84ca9fbdc9f7c"} Jun 10 13:01:13.672928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.672904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7tfw" event={"ID":"6f915b1e-4531-4ff2-a86a-9be8c3355a55","Type":"ContainerStarted","Data":"31c115f516e7111bc7ec45ebed86a5a8027eb60ec0f2add5ae331c1f44a10ea8"} Jun 10 13:01:13.689764 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.689728 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-233.ec2.internal" podStartSLOduration=22.689716784 podStartE2EDuration="22.689716784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:00:55.641952738 +0000 UTC m=+5.583965950" watchObservedRunningTime="2026-06-10 13:01:13.689716784 +0000 UTC m=+23.631729994" Jun 10 13:01:13.711202 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.711157 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cbs6f" podStartSLOduration=4.317202526 podStartE2EDuration="23.711140137s" totalImagesPullingTime="19.393937611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:13.710464187 +0000 UTC m=+23.652477399" watchObservedRunningTime="2026-06-10 13:01:13.711140137 +0000 UTC m=+23.653153349" Jun 10 13:01:13.758511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.758461 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tbf7p" podStartSLOduration=4.355384243 podStartE2EDuration="23.75844429s" totalImagesPullingTime="19.403060047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:13.736424173 +0000 UTC m=+23.678437382" watchObservedRunningTime="2026-06-10 13:01:13.75844429 +0000 UTC m=+23.700457504" Jun 10 13:01:13.758799 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.758771 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q7tfw" podStartSLOduration=4.35500207 podStartE2EDuration="23.758761058s" totalImagesPullingTime="19.403758988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:13.758329852 +0000 UTC m=+23.700343063" watchObservedRunningTime="2026-06-10 13:01:13.758761058 +0000 UTC m=+23.700774270" Jun 10 13:01:13.773114 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.773081 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x7g6s" podStartSLOduration=13.036285254 podStartE2EDuration="23.773065973s" totalImagesPullingTime="10.736780719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:13.772894681 +0000 UTC m=+23.714907903" watchObservedRunningTime="2026-06-10 13:01:13.773065973 +0000 UTC m=+23.715079187" Jun 10 13:01:13.792350 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:13.792319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kcnp9" podStartSLOduration=13.025629965 podStartE2EDuration="23.792308136s" totalImagesPullingTime="10.766678171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:13.792013936 +0000 UTC m=+23.734027146" watchObservedRunningTime="2026-06-10 13:01:13.792308136 +0000 UTC m=+23.734321346" Jun 10 13:01:14.523979 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.523955 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 13:01:14.537453 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.537180 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T13:01:14.523976009Z","UUID":"4090cfb7-b823-418f-85be-3433d3437ef0","Handler":null,"Name":"","Endpoint":""} Jun 10 13:01:14.538608 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.538588 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 13:01:14.538697 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.538623 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 13:01:14.555909 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.555883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:14.556206 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:14.556005 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:14.556258 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.555883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:14.556338 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:14.556317 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:14.678644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.678572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:01:14.679036 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.679007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"ddb17f96ee19cb8f60b740c0fbbb7dca742dd18a960e59ff6446685e2d8001c8"} Jun 10 13:01:14.679128 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.679085 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"7e0bbc5f3f5f747d83db43d2a045803f62608fa3d617bb44ac26d25b27cb26f8"} Jun 10 13:01:14.679128 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.679125 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"dee1cb2f9dd8fcf550f0f00887e2bad88815f2eece98a9888ab7e7524d8d71fc"} Jun 10 13:01:14.679200 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.679154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"b2470f68d153fa1dd03f61b613100907c2c6f973646232fcbf4f5e60a49abd5b"} Jun 10 13:01:14.680891 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.680806 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpxb4" event={"ID":"b07f1adb-426f-42d7-8f81-52983d908246","Type":"ContainerStarted","Data":"e5c5718442d4803ba5cb683036fda54b676f77119337fb4d58aba598e1013574"} Jun 10 13:01:14.683034 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.683004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" event={"ID":"e4e688e4-31dd-403f-867c-5e9012ddb5a7","Type":"ContainerStarted","Data":"9c0227fd112d2564b1a61bb1037ab73f972eb8bb55d22088d5a32bf1951cd209"} Jun 10 13:01:14.697610 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:14.697556 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cpxb4" podStartSLOduration=5.275332825 podStartE2EDuration="24.697538547s" totalImagesPullingTime="19.422205722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:14.696890804 +0000 UTC m=+24.638904040" watchObservedRunningTime="2026-06-10 13:01:14.697538547 +0000 UTC m=+24.639551759" Jun 10 13:01:15.555765 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:15.555736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:15.556035 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:15.555874 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:16.556212 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:16.555985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:16.556821 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:16.556041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:16.556821 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:16.556288 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:16.556821 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:16.556334 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:16.691034 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:16.691002 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:01:16.691486 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:16.691463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"0e3d0ea0a744dcb140cfca43f3088586965ad425fb6914ba79ee63e4aeef795e"} Jun 10 13:01:16.693759 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:16.693734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" event={"ID":"e4e688e4-31dd-403f-867c-5e9012ddb5a7","Type":"ContainerStarted","Data":"76662fea6a15387871073b5616006b4a02815df888526ddacda9c6b91003549c"} Jun 10 13:01:16.713879 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:16.713811 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzwg" podStartSLOduration=4.803741063 podStartE2EDuration="26.713797236s" totalImagesPullingTime="21.910056173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:16.713353925 +0000 UTC m=+26.655367135" watchObservedRunningTime="2026-06-10 13:01:16.713797236 +0000 UTC m=+26.655810447" Jun 10 13:01:17.296174 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:17.296138 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:01:17.296680 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:17.296655 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:01:17.556572 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:17.556495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:17.556943 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:17.556635 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:17.696825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:17.696782 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:01:17.697207 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:17.697173 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x7g6s" Jun 10 13:01:18.556310 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.556155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:18.556417 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.556161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:18.556417 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:18.556391 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:18.556530 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:18.556500 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:18.700532 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.700438 2561 generic.go:356] "Generic (PLEG): container finished" podID="a0454db3-1642-4fd1-9b32-723666816224" containerID="bb169923ec3ef96d7a66a9f0304b6f5445a80ea08ae11409f6174d47b9a40462" exitCode=0 Jun 10 13:01:18.700532 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.700516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerDied","Data":"bb169923ec3ef96d7a66a9f0304b6f5445a80ea08ae11409f6174d47b9a40462"} Jun 10 13:01:18.704023 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.703998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:01:18.704460 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.704436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"b445a007a7ae8a2a3085c9ee5c5892e3c0765852829fa54c4ac613d7bc2e6bd4"} Jun 10 13:01:18.704639 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.704617 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:01:18.704776 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.704759 2561 scope.go:117] "RemoveContainer" containerID="507c0733ed984248ef0984feb393dc8f2d1b7e7f06e84a3ad09911085d3a4e50" Jun 10 13:01:18.721326 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:18.721308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:01:19.556028 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.555995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:19.556184 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:19.556109 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:19.711627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.711600 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:01:19.712218 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.712191 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" event={"ID":"5c59700d-d06a-4359-85e3-9184a55014af","Type":"ContainerStarted","Data":"c7c43457897427c839bbd621a0d900e54d44064eb01137fa3b6de35a089963da"} Jun 10 13:01:19.712730 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.712586 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:01:19.712730 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.712676 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:01:19.747268 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.747085 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:01:19.750661 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:19.750588 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" podStartSLOduration=9.813178253 podStartE2EDuration="29.750566905s" totalImagesPullingTime="19.937388652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:19.748813428 +0000 UTC m=+29.690826640" watchObservedRunningTime="2026-06-10 13:01:19.750566905 +0000 UTC m=+29.692580117" Jun 10 13:01:20.516742 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.516570 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t79fc"] Jun 10 13:01:20.517016 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.516862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:20.517016 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:20.516958 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:20.517229 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.517204 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fk5k7"] Jun 10 13:01:20.517351 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.517298 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:20.517395 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:20.517383 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:20.519581 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.519548 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ntrxb"] Jun 10 13:01:20.519675 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.519634 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:20.519727 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:20.519709 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:20.716294 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.716200 2561 generic.go:356] "Generic (PLEG): container finished" podID="a0454db3-1642-4fd1-9b32-723666816224" containerID="0adeb099c576e7608fcfe04a4e1ef7531283854671f3cc82d61edb3340689165" exitCode=0 Jun 10 13:01:20.716755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:20.716282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerDied","Data":"0adeb099c576e7608fcfe04a4e1ef7531283854671f3cc82d61edb3340689165"} Jun 10 13:01:21.555785 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:21.555752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:21.555785 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:21.555787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:21.556025 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:21.555894 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:21.556025 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:21.556008 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:22.555687 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:22.555658 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:22.556201 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:22.555784 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:22.723026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:22.722992 2561 generic.go:356] "Generic (PLEG): container finished" podID="a0454db3-1642-4fd1-9b32-723666816224" containerID="fa2827d2be03535e97aba95b4436589bda4a84487be8e0c19ca2953523b399d2" exitCode=0 Jun 10 13:01:22.723190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:22.723072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerDied","Data":"fa2827d2be03535e97aba95b4436589bda4a84487be8e0c19ca2953523b399d2"} Jun 10 13:01:23.556274 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:23.556242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:23.557017 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:23.556386 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:23.557017 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:23.556737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:23.557017 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:23.556845 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:24.336303 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:24.336271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:24.336458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:24.336321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:24.336458 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.336444 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:24.336529 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.336499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs podName:25724863-3fd3-4d40-a01e-520f9c8313c3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:56.33648414 +0000 UTC m=+66.278497328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs") pod "network-metrics-daemon-ntrxb" (UID: "25724863-3fd3-4d40-a01e-520f9c8313c3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:24.336529 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.336444 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:24.336643 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.336555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret podName:e360f1a8-c94e-4367-a134-f31a74dfc75e nodeName:}" failed. No retries permitted until 2026-06-10 13:01:56.336544938 +0000 UTC m=+66.278558126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret") pod "global-pull-secret-syncer-fk5k7" (UID: "e360f1a8-c94e-4367-a134-f31a74dfc75e") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:24.437102 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:24.437069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:24.437275 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.437192 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:24.437275 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.437206 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:24.437275 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.437214 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4725q for pod openshift-network-diagnostics/network-check-target-t79fc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:24.437275 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.437272 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q podName:5d96b256-bfbf-4715-a148-c6b48142cd61 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:56.437256768 +0000 UTC m=+66.379269967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4725q" (UniqueName: "kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q") pod "network-check-target-t79fc" (UID: "5d96b256-bfbf-4715-a148-c6b48142cd61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:24.555509 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:24.555472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:24.555662 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:24.555601 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:25.556303 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:25.556276 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:25.556719 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:25.556275 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:25.556719 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:25.556403 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk5k7" podUID="e360f1a8-c94e-4367-a134-f31a74dfc75e" Jun 10 13:01:25.556719 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:25.556487 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntrxb" podUID="25724863-3fd3-4d40-a01e-520f9c8313c3" Jun 10 13:01:26.556943 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.556390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:26.556943 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:26.556524 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t79fc" podUID="5d96b256-bfbf-4715-a148-c6b48142cd61" Jun 10 13:01:26.738823 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.738787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerStarted","Data":"35429efc82408538d95af9a0cad7e6755127b32b1fd4e1c8921366f3c2e647f2"} Jun 10 13:01:26.877867 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.877817 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-233.ec2.internal" event="NodeReady" Jun 10 13:01:26.878001 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.877966 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 13:01:26.939857 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.939786 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4z7vv"] Jun 10 13:01:26.942625 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.942608 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rrr2b"] Jun 10 13:01:26.942753 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.942738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:26.945299 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.945282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:26.945502 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.945464 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vr97x\"" Jun 10 13:01:26.945502 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.945468 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 13:01:26.945769 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.945751 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 13:01:26.946416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.946397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 13:01:26.948026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.948009 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pxsg\"" Jun 10 13:01:26.948324 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.948306 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 13:01:26.948457 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.948396 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 13:01:26.953657 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.953638 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4z7vv"] Jun 10 13:01:26.959270 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:26.959246 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rrr2b"] Jun 10 13:01:27.054823 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.054745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2183d0bd-df11-46bb-993f-1930c57a9be8-cert\") pod \"ingress-canary-4z7vv\" (UID: \"2183d0bd-df11-46bb-993f-1930c57a9be8\") " pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.054823 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.054779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qdf9\" (UniqueName: \"kubernetes.io/projected/2183d0bd-df11-46bb-993f-1930c57a9be8-kube-api-access-5qdf9\") pod \"ingress-canary-4z7vv\" (UID: \"2183d0bd-df11-46bb-993f-1930c57a9be8\") " pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.054823 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.054798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f66a153-b726-44e3-bdd2-c2cedaea9151-tmp-dir\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.054823 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.054815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f66a153-b726-44e3-bdd2-c2cedaea9151-config-volume\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.055105 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.054908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlj5d\" (UniqueName: \"kubernetes.io/projected/7f66a153-b726-44e3-bdd2-c2cedaea9151-kube-api-access-zlj5d\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.055105 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.054973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.156143 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2183d0bd-df11-46bb-993f-1930c57a9be8-cert\") pod \"ingress-canary-4z7vv\" (UID: \"2183d0bd-df11-46bb-993f-1930c57a9be8\") " pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.156143 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qdf9\" (UniqueName: \"kubernetes.io/projected/2183d0bd-df11-46bb-993f-1930c57a9be8-kube-api-access-5qdf9\") pod \"ingress-canary-4z7vv\" (UID: \"2183d0bd-df11-46bb-993f-1930c57a9be8\") " pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.156302 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f66a153-b726-44e3-bdd2-c2cedaea9151-tmp-dir\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.156302 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f66a153-b726-44e3-bdd2-c2cedaea9151-config-volume\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.156302 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlj5d\" (UniqueName: \"kubernetes.io/projected/7f66a153-b726-44e3-bdd2-c2cedaea9151-kube-api-access-zlj5d\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.156302 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.156497 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:27.156432 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:27.156497 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:27.156487 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls podName:7f66a153-b726-44e3-bdd2-c2cedaea9151 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:27.656470815 +0000 UTC m=+37.598484003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls") pod "dns-default-rrr2b" (UID: "7f66a153-b726-44e3-bdd2-c2cedaea9151") : secret "dns-default-metrics-tls" not found Jun 10 13:01:27.156664 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156520 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f66a153-b726-44e3-bdd2-c2cedaea9151-tmp-dir\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.156893 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.156873 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f66a153-b726-44e3-bdd2-c2cedaea9151-config-volume\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.160417 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.160387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2183d0bd-df11-46bb-993f-1930c57a9be8-cert\") pod \"ingress-canary-4z7vv\" (UID: \"2183d0bd-df11-46bb-993f-1930c57a9be8\") " pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.169999 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.169971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qdf9\" (UniqueName: \"kubernetes.io/projected/2183d0bd-df11-46bb-993f-1930c57a9be8-kube-api-access-5qdf9\") pod \"ingress-canary-4z7vv\" (UID: \"2183d0bd-df11-46bb-993f-1930c57a9be8\") " pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.170113 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.170031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlj5d\" (UniqueName: \"kubernetes.io/projected/7f66a153-b726-44e3-bdd2-c2cedaea9151-kube-api-access-zlj5d\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.252543 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.252517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4z7vv" Jun 10 13:01:27.385512 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.385484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4z7vv"] Jun 10 13:01:27.389070 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:27.389039 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2183d0bd_df11_46bb_993f_1930c57a9be8.slice/crio-ded80883270303d2aa4a27bf9cdce45b54398cdf0c3195c03f11bf9c757460a8 WatchSource:0}: Error finding container ded80883270303d2aa4a27bf9cdce45b54398cdf0c3195c03f11bf9c757460a8: Status 404 returned error can't find the container with id ded80883270303d2aa4a27bf9cdce45b54398cdf0c3195c03f11bf9c757460a8 Jun 10 13:01:27.555750 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.555710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:27.555962 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.555912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:27.558252 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.558236 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:01:27.558807 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.558791 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:01:27.558948 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.558932 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mssf9\"" Jun 10 13:01:27.659423 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.659395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:27.659553 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:27.659535 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:27.659658 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:27.659626 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls podName:7f66a153-b726-44e3-bdd2-c2cedaea9151 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:28.659610841 +0000 UTC m=+38.601624028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls") pod "dns-default-rrr2b" (UID: "7f66a153-b726-44e3-bdd2-c2cedaea9151") : secret "dns-default-metrics-tls" not found Jun 10 13:01:27.743453 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.743420 2561 generic.go:356] "Generic (PLEG): container finished" podID="a0454db3-1642-4fd1-9b32-723666816224" containerID="35429efc82408538d95af9a0cad7e6755127b32b1fd4e1c8921366f3c2e647f2" exitCode=0 Jun 10 13:01:27.743611 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.743512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerDied","Data":"35429efc82408538d95af9a0cad7e6755127b32b1fd4e1c8921366f3c2e647f2"} Jun 10 13:01:27.744946 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:27.744582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4z7vv" event={"ID":"2183d0bd-df11-46bb-993f-1930c57a9be8","Type":"ContainerStarted","Data":"ded80883270303d2aa4a27bf9cdce45b54398cdf0c3195c03f11bf9c757460a8"} Jun 10 13:01:28.556797 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.556566 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:28.559559 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.559534 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:01:28.560548 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.560532 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhtjq\"" Jun 10 13:01:28.560658 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.560584 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:01:28.667180 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.667146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:28.667343 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:28.667279 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:28.667399 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:28.667362 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls podName:7f66a153-b726-44e3-bdd2-c2cedaea9151 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:30.667339215 +0000 UTC m=+40.609352421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls") pod "dns-default-rrr2b" (UID: "7f66a153-b726-44e3-bdd2-c2cedaea9151") : secret "dns-default-metrics-tls" not found Jun 10 13:01:28.751386 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.751351 2561 generic.go:356] "Generic (PLEG): container finished" podID="a0454db3-1642-4fd1-9b32-723666816224" containerID="a4d556865d1d8f5d5f9ba6743b4dabe0613a3cf14a96695304bf072d2ed273a8" exitCode=0 Jun 10 13:01:28.751553 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:28.751414 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerDied","Data":"a4d556865d1d8f5d5f9ba6743b4dabe0613a3cf14a96695304bf072d2ed273a8"} Jun 10 13:01:29.756418 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:29.756380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" event={"ID":"a0454db3-1642-4fd1-9b32-723666816224","Type":"ContainerStarted","Data":"a39147b6ecc84827f5c002b7d90969f7d9e519da09bc002cee5d876cab75d249"} Jun 10 13:01:29.757694 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:29.757673 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4z7vv" event={"ID":"2183d0bd-df11-46bb-993f-1930c57a9be8","Type":"ContainerStarted","Data":"8e52d6bd05b7470a0490599ed292c7837ecf7c0b45a81a597a897913f0bf66bb"} Jun 10 13:01:29.783153 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:29.783115 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tvsdn" podStartSLOduration=9.951163118 podStartE2EDuration="39.783103591s" totalImagesPullingTime="29.831940473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:29.781666283 +0000 UTC m=+39.723679504" watchObservedRunningTime="2026-06-10 13:01:29.783103591 +0000 UTC m=+39.725116801" Jun 10 13:01:29.798702 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:29.798662 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4z7vv" podStartSLOduration=2.086218725 podStartE2EDuration="3.798649781s" totalImagesPullingTime="1.712431056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:29.797947768 +0000 UTC m=+39.739960982" watchObservedRunningTime="2026-06-10 13:01:29.798649781 +0000 UTC m=+39.740662982" Jun 10 13:01:30.679655 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:30.679625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:30.679813 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:30.679752 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:30.679813 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:30.679801 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls podName:7f66a153-b726-44e3-bdd2-c2cedaea9151 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:34.679789291 +0000 UTC m=+44.621802479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls") pod "dns-default-rrr2b" (UID: "7f66a153-b726-44e3-bdd2-c2cedaea9151") : secret "dns-default-metrics-tls" not found Jun 10 13:01:33.032506 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.032447 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp"] Jun 10 13:01:33.057790 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.057763 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw"] Jun 10 13:01:33.057940 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.057897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" Jun 10 13:01:33.061093 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.061071 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vq6kw\"" Jun 10 13:01:33.079632 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.079606 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b685c9fc-qrkrx"] Jun 10 13:01:33.079743 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.079610 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.083101 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.083075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 13:01:33.083782 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.083763 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 13:01:33.084057 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.084040 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:01:33.084105 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.084043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 13:01:33.084105 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.084043 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-299hr\"" Jun 10 13:01:33.105765 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.105749 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-4qw9d"] Jun 10 13:01:33.105898 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.105884 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.108381 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.108364 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 13:01:33.108792 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.108768 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 13:01:33.110046 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.109495 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 13:01:33.110046 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.109738 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 13:01:33.110046 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.109943 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wq4nc\"" Jun 10 13:01:33.110046 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.109995 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 13:01:33.112314 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.110404 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 13:01:33.129726 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.129704 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw"] Jun 10 13:01:33.129726 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.129730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp"] Jun 10 13:01:33.129867 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.129743 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b685c9fc-qrkrx"] Jun 10 13:01:33.129867 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.129755 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4qw9d"] Jun 10 13:01:33.129867 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.129818 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.134582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.134563 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 13:01:33.134682 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.134668 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-47679\"" Jun 10 13:01:33.134897 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.134880 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 13:01:33.135006 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.134991 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 13:01:33.135254 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.135233 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 13:01:33.141615 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.141597 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 13:01:33.144364 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.144348 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5x5xx"] Jun 10 13:01:33.169782 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.169764 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5x5xx"] Jun 10 13:01:33.169887 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.169855 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.172484 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.172465 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 13:01:33.173025 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.173002 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:01:33.173125 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.173003 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 13:01:33.173377 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.173365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lrj2f\"" Jun 10 13:01:33.174057 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.174044 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 13:01:33.179625 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.179606 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 13:01:33.196512 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnxp\" (UniqueName: \"kubernetes.io/projected/ec11856e-ed93-42d2-b754-194bdb71437b-kube-api-access-mwnxp\") pod \"network-check-source-dbd9cf844-c75mp\" (UID: \"ec11856e-ed93-42d2-b754-194bdb71437b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" Jun 10 13:01:33.196607 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.196607 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.196607 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgrj\" (UniqueName: \"kubernetes.io/projected/0c0b04d6-e894-41b6-995c-ff572033d287-kube-api-access-mkgrj\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.196754 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-stats-auth\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.196754 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12f9f46b-a017-4281-8817-b47721e80dbe-config\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.196754 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj4ls\" (UniqueName: \"kubernetes.io/projected/12f9f46b-a017-4281-8817-b47721e80dbe-kube-api-access-xj4ls\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.196887 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-default-certificate\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.196922 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.196886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12f9f46b-a017-4281-8817-b47721e80dbe-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.236215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.236192 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8cb9b45b6-5xw5m"] Jun 10 13:01:33.257785 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.257758 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cb9b45b6-5xw5m"] Jun 10 13:01:33.257890 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.257883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.260527 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.260509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 13:01:33.260621 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.260516 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 13:01:33.260944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.260924 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-flbrr\"" Jun 10 13:01:33.261134 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.261119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 13:01:33.266332 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.266313 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 13:01:33.297526 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.297477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12f9f46b-a017-4281-8817-b47721e80dbe-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.297526 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.297506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-config\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.297634 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.297528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v76nf\" (UniqueName: \"kubernetes.io/projected/baa26f6d-3ab4-498f-86b4-9ad68af49da2-kube-api-access-v76nf\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.297634 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.297553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-trusted-ca\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.297785 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.297624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnxp\" (UniqueName: \"kubernetes.io/projected/ec11856e-ed93-42d2-b754-194bdb71437b-kube-api-access-mwnxp\") pod \"network-check-source-dbd9cf844-c75mp\" (UID: \"ec11856e-ed93-42d2-b754-194bdb71437b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.297989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/baa26f6d-3ab4-498f-86b4-9ad68af49da2-snapshots\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgrj\" (UniqueName: \"kubernetes.io/projected/0c0b04d6-e894-41b6-995c-ff572033d287-kube-api-access-mkgrj\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-stats-auth\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.298228 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.298232 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:33.79820215 +0000 UTC m=+43.740215355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : configmap references non-existent config key: service-ca.crt Jun 10 13:01:33.298384 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.298301 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:33.798288472 +0000 UTC m=+43.740301664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : secret "router-metrics-certs-default" not found Jun 10 13:01:33.298798 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12f9f46b-a017-4281-8817-b47721e80dbe-config\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.298798 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj4ls\" (UniqueName: \"kubernetes.io/projected/12f9f46b-a017-4281-8817-b47721e80dbe-kube-api-access-xj4ls\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.298798 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa26f6d-3ab4-498f-86b4-9ad68af49da2-trusted-ca-bundle\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.298984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8tv5\" (UniqueName: \"kubernetes.io/projected/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-kube-api-access-g8tv5\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.298984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298862 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12f9f46b-a017-4281-8817-b47721e80dbe-config\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.298984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa26f6d-3ab4-498f-86b4-9ad68af49da2-service-ca-bundle\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.298984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.298958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baa26f6d-3ab4-498f-86b4-9ad68af49da2-tmp\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.299171 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.299020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-default-certificate\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.299171 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.299050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa26f6d-3ab4-498f-86b4-9ad68af49da2-serving-cert\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.299273 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.299207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-serving-cert\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.302533 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.302296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12f9f46b-a017-4281-8817-b47721e80dbe-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.303165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.303144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-default-certificate\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.303646 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.303623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-stats-auth\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.307377 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.307352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgrj\" (UniqueName: \"kubernetes.io/projected/0c0b04d6-e894-41b6-995c-ff572033d287-kube-api-access-mkgrj\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.308433 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.308414 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnxp\" (UniqueName: \"kubernetes.io/projected/ec11856e-ed93-42d2-b754-194bdb71437b-kube-api-access-mwnxp\") pod \"network-check-source-dbd9cf844-c75mp\" (UID: \"ec11856e-ed93-42d2-b754-194bdb71437b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" Jun 10 13:01:33.316230 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.316209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj4ls\" (UniqueName: \"kubernetes.io/projected/12f9f46b-a017-4281-8817-b47721e80dbe-kube-api-access-xj4ls\") pod \"service-ca-operator-6bc5ff68f5-9vsbw\" (UID: \"12f9f46b-a017-4281-8817-b47721e80dbe\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.367221 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.367198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" Jun 10 13:01:33.388363 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.388347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" Jun 10 13:01:33.399819 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.399800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa26f6d-3ab4-498f-86b4-9ad68af49da2-serving-cert\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.399925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.399839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-image-registry-private-configuration\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.399925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.399862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.399925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.399882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-bound-sa-token\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.399925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.399899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-installation-pull-secrets\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.399925 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.399917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-certificates\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.400159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa26f6d-3ab4-498f-86b4-9ad68af49da2-trusted-ca-bundle\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8tv5\" (UniqueName: \"kubernetes.io/projected/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-kube-api-access-g8tv5\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.400159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh7cc\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-kube-api-access-jh7cc\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.400159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa26f6d-3ab4-498f-86b4-9ad68af49da2-service-ca-bundle\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baa26f6d-3ab4-498f-86b4-9ad68af49da2-tmp\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-serving-cert\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-ca-trust-extracted\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-trusted-ca\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-config\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v76nf\" (UniqueName: \"kubernetes.io/projected/baa26f6d-3ab4-498f-86b4-9ad68af49da2-kube-api-access-v76nf\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-trusted-ca\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.400345 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/baa26f6d-3ab4-498f-86b4-9ad68af49da2-snapshots\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400706 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baa26f6d-3ab4-498f-86b4-9ad68af49da2-tmp\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400760 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa26f6d-3ab4-498f-86b4-9ad68af49da2-service-ca-bundle\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.400852 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.400815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/baa26f6d-3ab4-498f-86b4-9ad68af49da2-snapshots\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.401111 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.401082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa26f6d-3ab4-498f-86b4-9ad68af49da2-trusted-ca-bundle\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.401286 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.401264 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-config\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.401355 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.401326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-trusted-ca\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.402360 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.402334 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/baa26f6d-3ab4-498f-86b4-9ad68af49da2-serving-cert\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.402966 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.402946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-serving-cert\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.408078 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.408059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v76nf\" (UniqueName: \"kubernetes.io/projected/baa26f6d-3ab4-498f-86b4-9ad68af49da2-kube-api-access-v76nf\") pod \"insights-operator-896549976-4qw9d\" (UID: \"baa26f6d-3ab4-498f-86b4-9ad68af49da2\") " pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.408269 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.408253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8tv5\" (UniqueName: \"kubernetes.io/projected/e0d942a6-c8db-4c8e-b405-3a1a7e0a4379-kube-api-access-g8tv5\") pod \"console-operator-668fdbf85c-5x5xx\" (UID: \"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379\") " pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.438314 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.438286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4qw9d" Jun 10 13:01:33.478947 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.478821 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:33.501242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh7cc\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-kube-api-access-jh7cc\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501321 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-ca-trust-extracted\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501375 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-trusted-ca\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501430 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-image-registry-private-configuration\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501430 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501560 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-bound-sa-token\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501560 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-installation-pull-secrets\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.501560 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.501503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-certificates\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.502531 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.502505 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:01:33.502531 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.502532 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cb9b45b6-5xw5m: secret "image-registry-tls" not found Jun 10 13:01:33.502725 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.502592 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls podName:2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:34.002570129 +0000 UTC m=+43.944583318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls") pod "image-registry-8cb9b45b6-5xw5m" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65") : secret "image-registry-tls" not found Jun 10 13:01:33.503421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.503086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-ca-trust-extracted\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.504605 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.504573 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-image-registry-private-configuration\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.507491 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.507461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-installation-pull-secrets\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.512478 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.512364 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-certificates\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.513361 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.513313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-trusted-ca\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.513758 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.513733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-bound-sa-token\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.514594 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.514554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh7cc\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-kube-api-access-jh7cc\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:33.540572 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.540460 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp"] Jun 10 13:01:33.560391 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:33.560345 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec11856e_ed93_42d2_b754_194bdb71437b.slice/crio-397700c74ce6a0fdd5dbe7094f95a3b317770f73268f7691e9c23099104cc5a9 WatchSource:0}: Error finding container 397700c74ce6a0fdd5dbe7094f95a3b317770f73268f7691e9c23099104cc5a9: Status 404 returned error can't find the container with id 397700c74ce6a0fdd5dbe7094f95a3b317770f73268f7691e9c23099104cc5a9 Jun 10 13:01:33.617184 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.617157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw"] Jun 10 13:01:33.621711 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:33.621676 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f9f46b_a017_4281_8817_b47721e80dbe.slice/crio-1299dddacf91fd5f9adae07e0d363879a4959726bd727702a592751d532e8f73 WatchSource:0}: Error finding container 1299dddacf91fd5f9adae07e0d363879a4959726bd727702a592751d532e8f73: Status 404 returned error can't find the container with id 1299dddacf91fd5f9adae07e0d363879a4959726bd727702a592751d532e8f73 Jun 10 13:01:33.648814 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.648785 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4qw9d"] Jun 10 13:01:33.651526 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:33.651500 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa26f6d_3ab4_498f_86b4_9ad68af49da2.slice/crio-2ef5e205cf7246a770cdddd9b312fdddc99bc4a89eeb3b5b3928fd7d3052ea6b WatchSource:0}: Error finding container 2ef5e205cf7246a770cdddd9b312fdddc99bc4a89eeb3b5b3928fd7d3052ea6b: Status 404 returned error can't find the container with id 2ef5e205cf7246a770cdddd9b312fdddc99bc4a89eeb3b5b3928fd7d3052ea6b Jun 10 13:01:33.666216 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.666190 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5x5xx"] Jun 10 13:01:33.668937 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:33.668902 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d942a6_c8db_4c8e_b405_3a1a7e0a4379.slice/crio-169a91a141133b437ba9a27e78aef287f44c3976c09167dd63eba278787a9199 WatchSource:0}: Error finding container 169a91a141133b437ba9a27e78aef287f44c3976c09167dd63eba278787a9199: Status 404 returned error can't find the container with id 169a91a141133b437ba9a27e78aef287f44c3976c09167dd63eba278787a9199 Jun 10 13:01:33.767849 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.767789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" event={"ID":"ec11856e-ed93-42d2-b754-194bdb71437b","Type":"ContainerStarted","Data":"397700c74ce6a0fdd5dbe7094f95a3b317770f73268f7691e9c23099104cc5a9"} Jun 10 13:01:33.769206 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.769174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" event={"ID":"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379","Type":"ContainerStarted","Data":"169a91a141133b437ba9a27e78aef287f44c3976c09167dd63eba278787a9199"} Jun 10 13:01:33.770334 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.770307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4qw9d" event={"ID":"baa26f6d-3ab4-498f-86b4-9ad68af49da2","Type":"ContainerStarted","Data":"2ef5e205cf7246a770cdddd9b312fdddc99bc4a89eeb3b5b3928fd7d3052ea6b"} Jun 10 13:01:33.771516 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.771493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" event={"ID":"12f9f46b-a017-4281-8817-b47721e80dbe","Type":"ContainerStarted","Data":"1299dddacf91fd5f9adae07e0d363879a4959726bd727702a592751d532e8f73"} Jun 10 13:01:33.804921 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.804900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.805017 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:33.804964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:33.805078 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.805057 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 13:01:33.805110 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.805100 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:34.805086728 +0000 UTC m=+44.747099917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : configmap references non-existent config key: service-ca.crt Jun 10 13:01:33.805148 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:33.805119 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:34.805106659 +0000 UTC m=+44.747119846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : secret "router-metrics-certs-default" not found Jun 10 13:01:34.006683 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:34.006653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:34.006854 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.006817 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:01:34.006898 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.006855 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cb9b45b6-5xw5m: secret "image-registry-tls" not found Jun 10 13:01:34.006931 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.006912 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls podName:2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:35.006897462 +0000 UTC m=+44.948910650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls") pod "image-registry-8cb9b45b6-5xw5m" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65") : secret "image-registry-tls" not found Jun 10 13:01:34.713626 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:34.713594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:34.714112 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.713783 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:34.714112 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.713883 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls podName:7f66a153-b726-44e3-bdd2-c2cedaea9151 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:42.713857334 +0000 UTC m=+52.655870522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls") pod "dns-default-rrr2b" (UID: "7f66a153-b726-44e3-bdd2-c2cedaea9151") : secret "dns-default-metrics-tls" not found Jun 10 13:01:34.814667 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:34.814630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:34.814871 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:34.814748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:34.814871 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.814805 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 13:01:34.814978 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.814893 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:36.814874357 +0000 UTC m=+46.756887564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : secret "router-metrics-certs-default" not found Jun 10 13:01:34.814978 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:34.814914 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:36.814903035 +0000 UTC m=+46.756916223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : configmap references non-existent config key: service-ca.crt Jun 10 13:01:35.017165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:35.017131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:35.017371 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:35.017317 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:01:35.017371 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:35.017342 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cb9b45b6-5xw5m: secret "image-registry-tls" not found Jun 10 13:01:35.017486 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:35.017412 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls podName:2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:37.017390913 +0000 UTC m=+46.959404102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls") pod "image-registry-8cb9b45b6-5xw5m" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65") : secret "image-registry-tls" not found Jun 10 13:01:36.833946 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:36.833900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:36.834545 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:36.834043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:36.834545 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:36.834110 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:40.834086523 +0000 UTC m=+50.776099717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : configmap references non-existent config key: service-ca.crt Jun 10 13:01:36.834545 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:36.834183 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 13:01:36.834545 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:36.834245 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:40.834226474 +0000 UTC m=+50.776239665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : secret "router-metrics-certs-default" not found Jun 10 13:01:37.034900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:37.034862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:37.035056 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:37.034965 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:01:37.035056 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:37.034985 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cb9b45b6-5xw5m: secret "image-registry-tls" not found Jun 10 13:01:37.035056 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:37.035039 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls podName:2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:41.035023665 +0000 UTC m=+50.977036853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls") pod "image-registry-8cb9b45b6-5xw5m" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65") : secret "image-registry-tls" not found Jun 10 13:01:39.789819 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.789782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" event={"ID":"ec11856e-ed93-42d2-b754-194bdb71437b","Type":"ContainerStarted","Data":"56889e10e660f361057971b5916542bc8ccf592f2ebe69650b1f77a4fc19497a"} Jun 10 13:01:39.791534 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.791514 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/0.log" Jun 10 13:01:39.791644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.791553 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d942a6-c8db-4c8e-b405-3a1a7e0a4379" containerID="52c35f7ac366c54cc52e4825e53c7d7275513bc3b2e50c9800d354089eea940a" exitCode=255 Jun 10 13:01:39.791644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.791631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" event={"ID":"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379","Type":"ContainerDied","Data":"52c35f7ac366c54cc52e4825e53c7d7275513bc3b2e50c9800d354089eea940a"} Jun 10 13:01:39.791822 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.791804 2561 scope.go:117] "RemoveContainer" containerID="52c35f7ac366c54cc52e4825e53c7d7275513bc3b2e50c9800d354089eea940a" Jun 10 13:01:39.793364 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.793332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4qw9d" event={"ID":"baa26f6d-3ab4-498f-86b4-9ad68af49da2","Type":"ContainerStarted","Data":"92bdac58fb8856949c63eb3697b2ebb22bfa9dd40184823849f3bd5dd30a0921"} Jun 10 13:01:39.795038 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.795016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" event={"ID":"12f9f46b-a017-4281-8817-b47721e80dbe","Type":"ContainerStarted","Data":"49cf067ad0f63f311f323face2431bf222526746ada80e47b5c9c2da0685274d"} Jun 10 13:01:39.845174 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.845126 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-c75mp" podStartSLOduration=1.551436592 podStartE2EDuration="6.845108044s" totalImagesPullingTime="5.293671452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:39.844334807 +0000 UTC m=+49.786348019" watchObservedRunningTime="2026-06-10 13:01:39.845108044 +0000 UTC m=+49.787121257" Jun 10 13:01:39.871716 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.871668 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-4qw9d" podStartSLOduration=1.6587778819999999 podStartE2EDuration="6.871652023s" totalImagesPullingTime="5.212874141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:39.871523732 +0000 UTC m=+49.813536943" watchObservedRunningTime="2026-06-10 13:01:39.871652023 +0000 UTC m=+49.813665232" Jun 10 13:01:39.923374 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:39.923319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" podStartSLOduration=1.6849168460000001 podStartE2EDuration="6.923297117s" totalImagesPullingTime="5.238380271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:39.920966188 +0000 UTC m=+49.862979399" watchObservedRunningTime="2026-06-10 13:01:39.923297117 +0000 UTC m=+49.865310328" Jun 10 13:01:40.799631 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.799602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:01:40.800091 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.800075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/0.log" Jun 10 13:01:40.800165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.800117 2561 generic.go:356] "Generic (PLEG): container finished" podID="e0d942a6-c8db-4c8e-b405-3a1a7e0a4379" containerID="8a4d664756d2f5540960c1dbfb25d281ab17db8b913ba60680f873ecd8bff361" exitCode=255 Jun 10 13:01:40.800222 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.800193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" event={"ID":"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379","Type":"ContainerDied","Data":"8a4d664756d2f5540960c1dbfb25d281ab17db8b913ba60680f873ecd8bff361"} Jun 10 13:01:40.800275 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.800260 2561 scope.go:117] "RemoveContainer" containerID="52c35f7ac366c54cc52e4825e53c7d7275513bc3b2e50c9800d354089eea940a" Jun 10 13:01:40.800475 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.800446 2561 scope.go:117] "RemoveContainer" containerID="8a4d664756d2f5540960c1dbfb25d281ab17db8b913ba60680f873ecd8bff361" Jun 10 13:01:40.800677 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:40.800652 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5x5xx_openshift-console-operator(e0d942a6-c8db-4c8e-b405-3a1a7e0a4379)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" podUID="e0d942a6-c8db-4c8e-b405-3a1a7e0a4379" Jun 10 13:01:40.868626 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.868597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:40.868776 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:40.868756 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 13:01:40.868890 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:40.868867 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:48.868826361 +0000 UTC m=+58.810839555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : secret "router-metrics-certs-default" not found Jun 10 13:01:40.869084 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:40.869057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:40.869259 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:40.869237 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:48.869218727 +0000 UTC m=+58.811231919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : configmap references non-existent config key: service-ca.crt Jun 10 13:01:41.070601 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:41.070511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:41.070743 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:41.070658 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:01:41.070743 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:41.070672 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cb9b45b6-5xw5m: secret "image-registry-tls" not found Jun 10 13:01:41.070743 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:41.070736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls podName:2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:49.070719461 +0000 UTC m=+59.012732650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls") pod "image-registry-8cb9b45b6-5xw5m" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65") : secret "image-registry-tls" not found Jun 10 13:01:41.805234 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:41.805208 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:01:41.805587 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:41.805531 2561 scope.go:117] "RemoveContainer" containerID="8a4d664756d2f5540960c1dbfb25d281ab17db8b913ba60680f873ecd8bff361" Jun 10 13:01:41.805702 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:41.805680 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5x5xx_openshift-console-operator(e0d942a6-c8db-4c8e-b405-3a1a7e0a4379)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" podUID="e0d942a6-c8db-4c8e-b405-3a1a7e0a4379" Jun 10 13:01:42.784491 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:42.784462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:42.784645 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:42.784565 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:42.784645 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:42.784611 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls podName:7f66a153-b726-44e3-bdd2-c2cedaea9151 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:58.784598793 +0000 UTC m=+68.726611980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls") pod "dns-default-rrr2b" (UID: "7f66a153-b726-44e3-bdd2-c2cedaea9151") : secret "dns-default-metrics-tls" not found Jun 10 13:01:43.372592 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:43.372571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcnp9_c9e4f1e4-ad30-4373-94df-80c9fe81a36f/dns-node-resolver/0.log" Jun 10 13:01:43.479982 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:43.479957 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:43.480083 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:43.480028 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:43.480340 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:43.480328 2561 scope.go:117] "RemoveContainer" containerID="8a4d664756d2f5540960c1dbfb25d281ab17db8b913ba60680f873ecd8bff361" Jun 10 13:01:43.480488 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:43.480471 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5x5xx_openshift-console-operator(e0d942a6-c8db-4c8e-b405-3a1a7e0a4379)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" podUID="e0d942a6-c8db-4c8e-b405-3a1a7e0a4379" Jun 10 13:01:44.374757 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:44.374731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cbs6f_095e9e21-d6d2-4d98-a61d-2722143b78ef/node-ca/0.log" Jun 10 13:01:44.973638 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:44.973613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4z7vv_2183d0bd-df11-46bb-993f-1930c57a9be8/serve-healthcheck-canary/0.log" Jun 10 13:01:48.931263 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:48.931213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:48.931634 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:48.931299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:01:48.931634 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:48.931389 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 13:01:48.931634 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:48.931408 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:04.931387974 +0000 UTC m=+74.873401175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : configmap references non-existent config key: service-ca.crt Jun 10 13:01:48.931634 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:48.931434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs podName:0c0b04d6-e894-41b6-995c-ff572033d287 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:04.931422511 +0000 UTC m=+74.873435699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs") pod "router-default-5b685c9fc-qrkrx" (UID: "0c0b04d6-e894-41b6-995c-ff572033d287") : secret "router-metrics-certs-default" not found Jun 10 13:01:49.133307 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:49.133268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") pod \"image-registry-8cb9b45b6-5xw5m\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:01:49.133447 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:49.133422 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:01:49.133447 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:49.133442 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cb9b45b6-5xw5m: secret "image-registry-tls" not found Jun 10 13:01:49.133538 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:01:49.133494 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls podName:2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:05.13347977 +0000 UTC m=+75.075492958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls") pod "image-registry-8cb9b45b6-5xw5m" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65") : secret "image-registry-tls" not found Jun 10 13:01:51.738216 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:51.738184 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b6k2t" Jun 10 13:01:56.386564 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.386526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:56.387028 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.386611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:56.389143 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.389125 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:01:56.390036 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.390021 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:01:56.399342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.399319 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e360f1a8-c94e-4367-a134-f31a74dfc75e-original-pull-secret\") pod \"global-pull-secret-syncer-fk5k7\" (UID: \"e360f1a8-c94e-4367-a134-f31a74dfc75e\") " pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:56.399342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.399328 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25724863-3fd3-4d40-a01e-520f9c8313c3-metrics-certs\") pod \"network-metrics-daemon-ntrxb\" (UID: \"25724863-3fd3-4d40-a01e-520f9c8313c3\") " pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:56.487380 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.487358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:56.489587 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.489570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4725q\" (UniqueName: \"kubernetes.io/projected/5d96b256-bfbf-4715-a148-c6b48142cd61-kube-api-access-4725q\") pod \"network-check-target-t79fc\" (UID: \"5d96b256-bfbf-4715-a148-c6b48142cd61\") " pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:56.555970 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.555946 2561 scope.go:117] "RemoveContainer" containerID="8a4d664756d2f5540960c1dbfb25d281ab17db8b913ba60680f873ecd8bff361" Jun 10 13:01:56.667756 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.667667 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mssf9\"" Jun 10 13:01:56.669972 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.669953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk5k7" Jun 10 13:01:56.675621 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.675605 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntrxb" Jun 10 13:01:56.768467 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.768439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhtjq\"" Jun 10 13:01:56.778187 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.777943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:56.806781 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.806753 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fk5k7"] Jun 10 13:01:56.810338 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:56.810299 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode360f1a8_c94e_4367_a134_f31a74dfc75e.slice/crio-c3e78d96deaefc50592fd594c1bc79d1f0ca95ed94f4ca515b16c643f4b5aa21 WatchSource:0}: Error finding container c3e78d96deaefc50592fd594c1bc79d1f0ca95ed94f4ca515b16c643f4b5aa21: Status 404 returned error can't find the container with id c3e78d96deaefc50592fd594c1bc79d1f0ca95ed94f4ca515b16c643f4b5aa21 Jun 10 13:01:56.828466 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.828444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ntrxb"] Jun 10 13:01:56.832303 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:56.831949 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25724863_3fd3_4d40_a01e_520f9c8313c3.slice/crio-c7ccb77859d01cb4a4890d25ae2464adbfbee98834c5648c20442521d242d999 WatchSource:0}: Error finding container c7ccb77859d01cb4a4890d25ae2464adbfbee98834c5648c20442521d242d999: Status 404 returned error can't find the container with id c7ccb77859d01cb4a4890d25ae2464adbfbee98834c5648c20442521d242d999 Jun 10 13:01:56.857172 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.857139 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ntrxb" event={"ID":"25724863-3fd3-4d40-a01e-520f9c8313c3","Type":"ContainerStarted","Data":"c7ccb77859d01cb4a4890d25ae2464adbfbee98834c5648c20442521d242d999"} Jun 10 13:01:56.858359 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.858336 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fk5k7" event={"ID":"e360f1a8-c94e-4367-a134-f31a74dfc75e","Type":"ContainerStarted","Data":"c3e78d96deaefc50592fd594c1bc79d1f0ca95ed94f4ca515b16c643f4b5aa21"} Jun 10 13:01:56.860419 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.860397 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:01:56.860517 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.860460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" event={"ID":"e0d942a6-c8db-4c8e-b405-3a1a7e0a4379","Type":"ContainerStarted","Data":"13b854233b6933ad2682ccb72e50812495f4e912557e60d90bf84c909540a653"} Jun 10 13:01:56.860720 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.860699 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:56.882392 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.882333 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" podStartSLOduration=18.69138698 podStartE2EDuration="23.882311828s" totalImagesPullingTime="5.190924848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:56.881079935 +0000 UTC m=+66.823093148" watchObservedRunningTime="2026-06-10 13:01:56.882311828 +0000 UTC m=+66.824325039" Jun 10 13:01:56.898272 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.898246 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-5x5xx" Jun 10 13:01:56.915291 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:56.915262 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t79fc"] Jun 10 13:01:56.918928 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:56.918867 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d96b256_bfbf_4715_a148_c6b48142cd61.slice/crio-9f1427b8df810abbf67358ae7915f21b8df8967dae97785817143fc57892f537 WatchSource:0}: Error finding container 9f1427b8df810abbf67358ae7915f21b8df8967dae97785817143fc57892f537: Status 404 returned error can't find the container with id 9f1427b8df810abbf67358ae7915f21b8df8967dae97785817143fc57892f537 Jun 10 13:01:57.865923 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:57.865877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t79fc" event={"ID":"5d96b256-bfbf-4715-a148-c6b48142cd61","Type":"ContainerStarted","Data":"2c2e660ea94af02501f54fa984cd4a50ffdc28c6b95bb59fb797437ac894a1fa"} Jun 10 13:01:57.866355 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:57.865951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t79fc" event={"ID":"5d96b256-bfbf-4715-a148-c6b48142cd61","Type":"ContainerStarted","Data":"9f1427b8df810abbf67358ae7915f21b8df8967dae97785817143fc57892f537"} Jun 10 13:01:57.866355 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:57.865984 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:01:57.885399 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:57.885229 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t79fc" podStartSLOduration=67.885212854 podStartE2EDuration="1m7.885212854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:57.884568043 +0000 UTC m=+67.826581253" watchObservedRunningTime="2026-06-10 13:01:57.885212854 +0000 UTC m=+67.827226064" Jun 10 13:01:58.809230 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:58.809073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:58.811785 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:58.811758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f66a153-b726-44e3-bdd2-c2cedaea9151-metrics-tls\") pod \"dns-default-rrr2b\" (UID: \"7f66a153-b726-44e3-bdd2-c2cedaea9151\") " pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:58.871807 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:58.871772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ntrxb" event={"ID":"25724863-3fd3-4d40-a01e-520f9c8313c3","Type":"ContainerStarted","Data":"5f53fa3e97b52dbd3905e56b3f6d75abaf66857f1089092497a9203518f23e75"} Jun 10 13:01:58.872232 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:58.871825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ntrxb" event={"ID":"25724863-3fd3-4d40-a01e-520f9c8313c3","Type":"ContainerStarted","Data":"c39705e272e7658d52a853c98529fddca187959cc6554ff5b016166df87c3d62"} Jun 10 13:01:58.892471 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:58.892408 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ntrxb" podStartSLOduration=67.476088694 podStartE2EDuration="1m8.892391853s" totalImagesPullingTime="1.416303159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:58.891135222 +0000 UTC m=+68.833148444" watchObservedRunningTime="2026-06-10 13:01:58.892391853 +0000 UTC m=+68.834405063" Jun 10 13:01:59.060584 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:59.060499 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pxsg\"" Jun 10 13:01:59.068898 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:59.068868 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrr2b" Jun 10 13:01:59.214131 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:59.214099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rrr2b"] Jun 10 13:01:59.216913 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:01:59.216883 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f66a153_b726_44e3_bdd2_c2cedaea9151.slice/crio-faa6cd395f16b37cc9c44bd2ed0efdc7698573ef2a69677d3423a8a2f7d7a621 WatchSource:0}: Error finding container faa6cd395f16b37cc9c44bd2ed0efdc7698573ef2a69677d3423a8a2f7d7a621: Status 404 returned error can't find the container with id faa6cd395f16b37cc9c44bd2ed0efdc7698573ef2a69677d3423a8a2f7d7a621 Jun 10 13:01:59.876960 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:01:59.876921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrr2b" event={"ID":"7f66a153-b726-44e3-bdd2-c2cedaea9151","Type":"ContainerStarted","Data":"faa6cd395f16b37cc9c44bd2ed0efdc7698573ef2a69677d3423a8a2f7d7a621"} Jun 10 13:02:01.885958 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:01.885917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fk5k7" event={"ID":"e360f1a8-c94e-4367-a134-f31a74dfc75e","Type":"ContainerStarted","Data":"feffeddc632db75fc0c31ba83899402d85a17b6ee634b96252c0e2eb0f0c549f"} Jun 10 13:02:01.902537 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:01.902488 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fk5k7" podStartSLOduration=67.755551697 podStartE2EDuration="1m11.902474283s" totalImagesPullingTime="4.146922586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:01.901824923 +0000 UTC m=+71.843838134" watchObservedRunningTime="2026-06-10 13:02:01.902474283 +0000 UTC m=+71.844487539" Jun 10 13:02:02.892094 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.892056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrr2b" event={"ID":"7f66a153-b726-44e3-bdd2-c2cedaea9151","Type":"ContainerStarted","Data":"43453b5f80c31d0590c59d0ab0207962ebef136224f03b9da034515d5350b63a"} Jun 10 13:02:02.892549 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.892114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrr2b" event={"ID":"7f66a153-b726-44e3-bdd2-c2cedaea9151","Type":"ContainerStarted","Data":"16718161d16eb57fef78d13b6286c86dae63e40374d05c447398fd1f4d1de099"} Jun 10 13:02:02.964980 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.964933 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rrr2b" podStartSLOduration=33.735625705 podStartE2EDuration="36.964917321s" totalImagesPullingTime="3.229291616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:02.928390705 +0000 UTC m=+72.870403915" watchObservedRunningTime="2026-06-10 13:02:02.964917321 +0000 UTC m=+72.906930534" Jun 10 13:02:02.965884 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.965865 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-st45b"] Jun 10 13:02:02.969048 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.969031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:02.974596 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.974414 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 13:02:02.979445 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.979428 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c57wb\"" Jun 10 13:02:02.979670 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.979654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 13:02:02.994504 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.994453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-st45b"] Jun 10 13:02:02.998595 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:02.998576 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8cb9b45b6-5xw5m"] Jun 10 13:02:02.998783 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:02:02.998763 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" podUID="2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" Jun 10 13:02:03.043261 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.043239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.043352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.043287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwtfz\" (UniqueName: \"kubernetes.io/projected/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-kube-api-access-dwtfz\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.043352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.043340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-data-volume\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.043422 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.043384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.043454 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.043431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-crio-socket\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.060781 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.060757 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf"] Jun 10 13:02:03.066065 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.066024 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.067272 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.067253 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-5qblf"] Jun 10 13:02:03.069603 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.069557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 13:02:03.070111 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.070090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:03.070206 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.070181 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6cb52\"" Jun 10 13:02:03.070557 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.070456 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 13:02:03.070879 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.070861 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df4744d49-7fpnj"] Jun 10 13:02:03.074637 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.074618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.077442 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.077422 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 13:02:03.077518 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.077476 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qfd7b\"" Jun 10 13:02:03.078450 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.078435 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 13:02:03.081383 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.081362 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf"] Jun 10 13:02:03.090056 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.090030 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-5qblf"] Jun 10 13:02:03.111821 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.111800 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4744d49-7fpnj"] Jun 10 13:02:03.144577 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.144577 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-crio-socket\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.144726 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e62268f7-5d33-419f-b9a1-832ddaebcd15-registry-certificates\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.144726 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-registry-tls\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.144726 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e62268f7-5d33-419f-b9a1-832ddaebcd15-image-registry-private-configuration\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.144726 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-crio-socket\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144739 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/06e3fb06-22ad-4a36-81d6-7e813018a906-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kr2sf\" (UID: \"06e3fb06-22ad-4a36-81d6-7e813018a906\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwsh\" (UniqueName: \"kubernetes.io/projected/a065cfcd-7862-474c-9f98-07c050d8542b-kube-api-access-wvwsh\") pod \"downloads-6657875f97-5qblf\" (UID: \"a065cfcd-7862-474c-9f98-07c050d8542b\") " pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06e3fb06-22ad-4a36-81d6-7e813018a906-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kr2sf\" (UID: \"06e3fb06-22ad-4a36-81d6-7e813018a906\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e62268f7-5d33-419f-b9a1-832ddaebcd15-ca-trust-extracted\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-bound-sa-token\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwtfz\" (UniqueName: \"kubernetes.io/projected/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-kube-api-access-dwtfz\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.144944 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e62268f7-5d33-419f-b9a1-832ddaebcd15-installation-pull-secrets\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.145352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.144961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gp67\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-kube-api-access-4gp67\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.145352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.145018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-data-volume\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.145352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.145057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e62268f7-5d33-419f-b9a1-832ddaebcd15-trusted-ca\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.145352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.145303 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-data-volume\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.145352 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.145348 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.146943 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.146924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.161824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.161795 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwtfz\" (UniqueName: \"kubernetes.io/projected/23ae59c2-fb0f-49a1-9a87-6a640bb3acfe-kube-api-access-dwtfz\") pod \"insights-runtime-extractor-st45b\" (UID: \"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe\") " pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.245957 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.245918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e62268f7-5d33-419f-b9a1-832ddaebcd15-registry-certificates\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.245957 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.245958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-registry-tls\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.246207 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.245990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e62268f7-5d33-419f-b9a1-832ddaebcd15-image-registry-private-configuration\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.246207 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/06e3fb06-22ad-4a36-81d6-7e813018a906-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kr2sf\" (UID: \"06e3fb06-22ad-4a36-81d6-7e813018a906\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.246207 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwsh\" (UniqueName: \"kubernetes.io/projected/a065cfcd-7862-474c-9f98-07c050d8542b-kube-api-access-wvwsh\") pod \"downloads-6657875f97-5qblf\" (UID: \"a065cfcd-7862-474c-9f98-07c050d8542b\") " pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:03.246359 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06e3fb06-22ad-4a36-81d6-7e813018a906-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kr2sf\" (UID: \"06e3fb06-22ad-4a36-81d6-7e813018a906\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.246359 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e62268f7-5d33-419f-b9a1-832ddaebcd15-ca-trust-extracted\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.246485 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-bound-sa-token\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.246485 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e62268f7-5d33-419f-b9a1-832ddaebcd15-installation-pull-secrets\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.246731 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gp67\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-kube-api-access-4gp67\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.246731 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e62268f7-5d33-419f-b9a1-832ddaebcd15-ca-trust-extracted\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.247109 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e62268f7-5d33-419f-b9a1-832ddaebcd15-trusted-ca\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.247109 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.246916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e62268f7-5d33-419f-b9a1-832ddaebcd15-registry-certificates\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.247351 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.247324 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/06e3fb06-22ad-4a36-81d6-7e813018a906-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kr2sf\" (UID: \"06e3fb06-22ad-4a36-81d6-7e813018a906\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.248117 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.248093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e62268f7-5d33-419f-b9a1-832ddaebcd15-trusted-ca\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.248813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.248793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e62268f7-5d33-419f-b9a1-832ddaebcd15-installation-pull-secrets\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.248924 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.248849 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e62268f7-5d33-419f-b9a1-832ddaebcd15-image-registry-private-configuration\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.249458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.249428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06e3fb06-22ad-4a36-81d6-7e813018a906-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kr2sf\" (UID: \"06e3fb06-22ad-4a36-81d6-7e813018a906\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.249458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.249444 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-registry-tls\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.260823 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.260805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-bound-sa-token\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.260924 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.260869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwsh\" (UniqueName: \"kubernetes.io/projected/a065cfcd-7862-474c-9f98-07c050d8542b-kube-api-access-wvwsh\") pod \"downloads-6657875f97-5qblf\" (UID: \"a065cfcd-7862-474c-9f98-07c050d8542b\") " pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:03.261452 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.261436 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gp67\" (UniqueName: \"kubernetes.io/projected/e62268f7-5d33-419f-b9a1-832ddaebcd15-kube-api-access-4gp67\") pod \"image-registry-7df4744d49-7fpnj\" (UID: \"e62268f7-5d33-419f-b9a1-832ddaebcd15\") " pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.278299 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.278276 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-st45b" Jun 10 13:02:03.377137 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.377099 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" Jun 10 13:02:03.383261 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.383239 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:03.390813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.390790 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-flbrr\"" Jun 10 13:02:03.399161 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.399108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.416151 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.415971 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-st45b"] Jun 10 13:02:03.543456 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.543432 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf"] Jun 10 13:02:03.546235 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:03.546195 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e3fb06_22ad_4a36_81d6_7e813018a906.slice/crio-dcb61449359860dee49ec16996087247b85d0965c7f8e9b405d38b69c0b47e2c WatchSource:0}: Error finding container dcb61449359860dee49ec16996087247b85d0965c7f8e9b405d38b69c0b47e2c: Status 404 returned error can't find the container with id dcb61449359860dee49ec16996087247b85d0965c7f8e9b405d38b69c0b47e2c Jun 10 13:02:03.560202 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.560139 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-5qblf"] Jun 10 13:02:03.563874 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:03.563824 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda065cfcd_7862_474c_9f98_07c050d8542b.slice/crio-3884c2881e0f954cfcebc0ced0b68199834993a6f97e84955873ff6241ffad03 WatchSource:0}: Error finding container 3884c2881e0f954cfcebc0ced0b68199834993a6f97e84955873ff6241ffad03: Status 404 returned error can't find the container with id 3884c2881e0f954cfcebc0ced0b68199834993a6f97e84955873ff6241ffad03 Jun 10 13:02:03.577848 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.577799 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4744d49-7fpnj"] Jun 10 13:02:03.583266 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:03.583244 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62268f7_5d33_419f_b9a1_832ddaebcd15.slice/crio-f02afa1d93f7324ed5b63394fe67dfa150f30cd384f5952c44e4dc37655c993e WatchSource:0}: Error finding container f02afa1d93f7324ed5b63394fe67dfa150f30cd384f5952c44e4dc37655c993e: Status 404 returned error can't find the container with id f02afa1d93f7324ed5b63394fe67dfa150f30cd384f5952c44e4dc37655c993e Jun 10 13:02:03.897081 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.897044 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" event={"ID":"e62268f7-5d33-419f-b9a1-832ddaebcd15","Type":"ContainerStarted","Data":"30ec4ffd83993a6c12465ebe67b69d66cc9f967bac29fc139bd4ea63472b24d8"} Jun 10 13:02:03.897492 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.897100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" event={"ID":"e62268f7-5d33-419f-b9a1-832ddaebcd15","Type":"ContainerStarted","Data":"f02afa1d93f7324ed5b63394fe67dfa150f30cd384f5952c44e4dc37655c993e"} Jun 10 13:02:03.897492 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.897182 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:03.898665 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.898642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st45b" event={"ID":"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe","Type":"ContainerStarted","Data":"1d196bb8538759601b76bc8aa037d46bbabf53f67514f452ac87700015a73b96"} Jun 10 13:02:03.898777 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.898687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st45b" event={"ID":"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe","Type":"ContainerStarted","Data":"021690cde66ccb72ee9a7aebc07bb09dcc4fbee0a3251d3ec1566005ecde10b6"} Jun 10 13:02:03.899693 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.899674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-5qblf" event={"ID":"a065cfcd-7862-474c-9f98-07c050d8542b","Type":"ContainerStarted","Data":"3884c2881e0f954cfcebc0ced0b68199834993a6f97e84955873ff6241ffad03"} Jun 10 13:02:03.900884 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.900862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" event={"ID":"06e3fb06-22ad-4a36-81d6-7e813018a906","Type":"ContainerStarted","Data":"dcb61449359860dee49ec16996087247b85d0965c7f8e9b405d38b69c0b47e2c"} Jun 10 13:02:03.900947 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.900910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:02:03.900990 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.900977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rrr2b" Jun 10 13:02:03.907248 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.907233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:02:03.916189 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.916142 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" podStartSLOduration=0.916126493 podStartE2EDuration="916.126493ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:03.915767838 +0000 UTC m=+73.857781047" watchObservedRunningTime="2026-06-10 13:02:03.916126493 +0000 UTC m=+73.858139701" Jun 10 13:02:03.952891 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.952858 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-image-registry-private-configuration\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953043 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.952911 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-trusted-ca\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953043 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.952941 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-ca-trust-extracted\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953043 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953035 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-certificates\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953206 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953063 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh7cc\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-kube-api-access-jh7cc\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953206 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953108 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-installation-pull-secrets\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953206 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953137 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-bound-sa-token\") pod \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\" (UID: \"2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65\") " Jun 10 13:02:03.953682 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953449 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:02:03.953778 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953706 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:02:03.953893 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953872 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-trusted-ca\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:03.953893 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.953893 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-ca-trust-extracted\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:03.955070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.955039 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:02:03.956217 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.956187 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:02:03.956370 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.956344 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-kube-api-access-jh7cc" (OuterVolumeSpecName: "kube-api-access-jh7cc") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "kube-api-access-jh7cc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:02:03.956995 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.956971 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:02:03.957452 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:03.957428 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" (UID: "2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:02:04.054740 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.054699 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-certificates\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:04.054740 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.054737 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh7cc\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-kube-api-access-jh7cc\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:04.054984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.054753 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-installation-pull-secrets\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:04.054984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.054766 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-bound-sa-token\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:04.054984 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.054780 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-image-registry-private-configuration\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:04.909923 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.909892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cb9b45b6-5xw5m" Jun 10 13:02:04.909923 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.909897 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st45b" event={"ID":"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe","Type":"ContainerStarted","Data":"fd085b862b590c90f6dae820df80bceb88c238fdff08e7d5925a578e1f927cf6"} Jun 10 13:02:04.949659 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.949622 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8cb9b45b6-5xw5m"] Jun 10 13:02:04.954952 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.954920 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8cb9b45b6-5xw5m"] Jun 10 13:02:04.962128 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.962103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:04.963215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.962426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:04.963215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.962804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c0b04d6-e894-41b6-995c-ff572033d287-service-ca-bundle\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:04.965593 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:04.965571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0b04d6-e894-41b6-995c-ff572033d287-metrics-certs\") pod \"router-default-5b685c9fc-qrkrx\" (UID: \"0c0b04d6-e894-41b6-995c-ff572033d287\") " pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:05.063238 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:05.063216 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65-registry-tls\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:02:05.218521 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:05.218456 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wq4nc\"" Jun 10 13:02:05.226739 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:05.226706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:05.916315 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:05.916276 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" event={"ID":"06e3fb06-22ad-4a36-81d6-7e813018a906","Type":"ContainerStarted","Data":"62dcce457e14590b568d6abc256b8c3e9797642b6ff539cee35d23f5f4e37465"} Jun 10 13:02:05.922443 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:05.922418 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b685c9fc-qrkrx"] Jun 10 13:02:05.925096 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:05.925071 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0b04d6_e894_41b6_995c_ff572033d287.slice/crio-7d7176273a80fb12cd9db1161770499af867fe8abfc3473757c6c05a4a7f1b2d WatchSource:0}: Error finding container 7d7176273a80fb12cd9db1161770499af867fe8abfc3473757c6c05a4a7f1b2d: Status 404 returned error can't find the container with id 7d7176273a80fb12cd9db1161770499af867fe8abfc3473757c6c05a4a7f1b2d Jun 10 13:02:05.934494 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:05.934148 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kr2sf" podStartSLOduration=1.5058918559999999 podStartE2EDuration="2.934130477s" totalImagesPullingTime="1.428238621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:05.934058842 +0000 UTC m=+75.876072054" watchObservedRunningTime="2026-06-10 13:02:05.934130477 +0000 UTC m=+75.876143688" Jun 10 13:02:06.561801 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:06.561766 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65" path="/var/lib/kubelet/pods/2fa1a9cc-2e70-4777-b10a-2cfe14ebbc65/volumes" Jun 10 13:02:06.922388 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:06.922302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st45b" event={"ID":"23ae59c2-fb0f-49a1-9a87-6a640bb3acfe","Type":"ContainerStarted","Data":"bbd2afa696ecc905feba8c42b4845c1767de66f89aca05b73c414668b077544a"} Jun 10 13:02:06.924699 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:06.924310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" event={"ID":"0c0b04d6-e894-41b6-995c-ff572033d287","Type":"ContainerStarted","Data":"8cfae34de7894391c8357808e1fee0969e33dfe3ea78154c5a9ddb13cd80ab65"} Jun 10 13:02:06.924699 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:06.924360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" event={"ID":"0c0b04d6-e894-41b6-995c-ff572033d287","Type":"ContainerStarted","Data":"7d7176273a80fb12cd9db1161770499af867fe8abfc3473757c6c05a4a7f1b2d"} Jun 10 13:02:06.943389 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:06.943324 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-st45b" podStartSLOduration=2.425546884 podStartE2EDuration="4.943304393s" totalImagesPullingTime="2.517757509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:02:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:06.942397982 +0000 UTC m=+76.884411192" watchObservedRunningTime="2026-06-10 13:02:06.943304393 +0000 UTC m=+76.885317605" Jun 10 13:02:06.963071 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:06.963019 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" podStartSLOduration=33.963006092 podStartE2EDuration="33.963006092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:06.962063979 +0000 UTC m=+76.904077190" watchObservedRunningTime="2026-06-10 13:02:06.963006092 +0000 UTC m=+76.905019302" Jun 10 13:02:07.227677 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:07.227648 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:07.230894 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:07.230872 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:07.931258 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:07.931177 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:07.932520 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:07.932495 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b685c9fc-qrkrx" Jun 10 13:02:09.209460 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.209420 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-758b5b6f4d-tcb2p"] Jun 10 13:02:09.238813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.238784 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758b5b6f4d-tcb2p"] Jun 10 13:02:09.238963 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.238941 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.241667 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.241640 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 13:02:09.241667 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.241663 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 13:02:09.243441 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.243419 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 13:02:09.243589 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.243426 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xk8jz\"" Jun 10 13:02:09.243691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.243553 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 13:02:09.243691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.243426 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 13:02:09.247775 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.247756 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 13:02:09.296883 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.296854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-oauth-serving-cert\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.296991 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.296897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-console-config\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.296991 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.296934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-trusted-ca-bundle\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.296991 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.296984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-oauth-config\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.297145 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.297052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-serving-cert\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.297145 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.297136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-service-ca\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.297237 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.297176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwrpz\" (UniqueName: \"kubernetes.io/projected/a1271b2f-a308-4170-85fe-355468aa8021-kube-api-access-gwrpz\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398153 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-oauth-serving-cert\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398308 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-console-config\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398308 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-trusted-ca-bundle\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398308 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-oauth-config\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398308 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-serving-cert\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-service-ca\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwrpz\" (UniqueName: \"kubernetes.io/projected/a1271b2f-a308-4170-85fe-355468aa8021-kube-api-access-gwrpz\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.398997 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.398948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-oauth-serving-cert\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.399311 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.399240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-service-ca\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.399311 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.399244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-console-config\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.399539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.399516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-trusted-ca-bundle\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.401603 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.401578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-serving-cert\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.401696 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.401626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-oauth-config\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.408369 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.408340 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwrpz\" (UniqueName: \"kubernetes.io/projected/a1271b2f-a308-4170-85fe-355468aa8021-kube-api-access-gwrpz\") pod \"console-758b5b6f4d-tcb2p\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.550790 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.550754 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:09.709642 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.709612 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758b5b6f4d-tcb2p"] Jun 10 13:02:09.712760 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:09.712732 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1271b2f_a308_4170_85fe_355468aa8021.slice/crio-a81911484368af21b771791bb9b3ed7d01b57a7594402719dc15c3c0daf68bbe WatchSource:0}: Error finding container a81911484368af21b771791bb9b3ed7d01b57a7594402719dc15c3c0daf68bbe: Status 404 returned error can't find the container with id a81911484368af21b771791bb9b3ed7d01b57a7594402719dc15c3c0daf68bbe Jun 10 13:02:09.940326 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:09.940237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758b5b6f4d-tcb2p" event={"ID":"a1271b2f-a308-4170-85fe-355468aa8021","Type":"ContainerStarted","Data":"a81911484368af21b771791bb9b3ed7d01b57a7594402719dc15c3c0daf68bbe"} Jun 10 13:02:11.435953 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.435919 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4"] Jun 10 13:02:11.438139 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.438098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:11.440755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.440731 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hrhxd\"" Jun 10 13:02:11.441086 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.441063 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 13:02:11.449273 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.449250 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4"] Jun 10 13:02:11.515520 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.515486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed4b8356-57d5-4253-8e51-64f75dc8f6a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f6gv4\" (UID: \"ed4b8356-57d5-4253-8e51-64f75dc8f6a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:11.616621 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:11.616582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed4b8356-57d5-4253-8e51-64f75dc8f6a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f6gv4\" (UID: \"ed4b8356-57d5-4253-8e51-64f75dc8f6a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:11.616782 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:02:11.616752 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 13:02:11.616890 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:02:11.616845 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b8356-57d5-4253-8e51-64f75dc8f6a2-tls-certificates podName:ed4b8356-57d5-4253-8e51-64f75dc8f6a2 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:12.116809836 +0000 UTC m=+82.058823048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ed4b8356-57d5-4253-8e51-64f75dc8f6a2-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-f6gv4" (UID: "ed4b8356-57d5-4253-8e51-64f75dc8f6a2") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 13:02:12.121479 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.121441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed4b8356-57d5-4253-8e51-64f75dc8f6a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f6gv4\" (UID: \"ed4b8356-57d5-4253-8e51-64f75dc8f6a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:12.124483 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.124454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed4b8356-57d5-4253-8e51-64f75dc8f6a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-f6gv4\" (UID: \"ed4b8356-57d5-4253-8e51-64f75dc8f6a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:12.350589 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.350356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:12.778277 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.778119 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4"] Jun 10 13:02:12.781501 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:12.781473 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4b8356_57d5_4253_8e51_64f75dc8f6a2.slice/crio-08e475d9379d1e977afb61c246966b82a3d1a7c5b58dd309e042244ce15f9f77 WatchSource:0}: Error finding container 08e475d9379d1e977afb61c246966b82a3d1a7c5b58dd309e042244ce15f9f77: Status 404 returned error can't find the container with id 08e475d9379d1e977afb61c246966b82a3d1a7c5b58dd309e042244ce15f9f77 Jun 10 13:02:12.958477 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.958393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758b5b6f4d-tcb2p" event={"ID":"a1271b2f-a308-4170-85fe-355468aa8021","Type":"ContainerStarted","Data":"5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb"} Jun 10 13:02:12.959904 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.959871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" event={"ID":"ed4b8356-57d5-4253-8e51-64f75dc8f6a2","Type":"ContainerStarted","Data":"08e475d9379d1e977afb61c246966b82a3d1a7c5b58dd309e042244ce15f9f77"} Jun 10 13:02:12.979532 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:12.979488 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-758b5b6f4d-tcb2p" podStartSLOduration=1.0209207 podStartE2EDuration="3.979471372s" totalImagesPullingTime="2.958550672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:12.978059396 +0000 UTC m=+82.920072608" watchObservedRunningTime="2026-06-10 13:02:12.979471372 +0000 UTC m=+82.921484583" Jun 10 13:02:13.913463 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:13.913418 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rrr2b" Jun 10 13:02:14.974632 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:14.974591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" event={"ID":"ed4b8356-57d5-4253-8e51-64f75dc8f6a2","Type":"ContainerStarted","Data":"9820123f3dcc6911d7eb27ec2cb498f4dcf1fcb7efbfb3fc6fc6b8d34e56ec44"} Jun 10 13:02:14.975083 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:14.974855 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:14.980212 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:14.980182 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" Jun 10 13:02:14.996394 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:14.996314 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-f6gv4" podStartSLOduration=2.790142459 podStartE2EDuration="3.996296747s" totalImagesPullingTime="1.206154288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:14.994580939 +0000 UTC m=+84.936594149" watchObservedRunningTime="2026-06-10 13:02:14.996296747 +0000 UTC m=+84.938309957" Jun 10 13:02:15.503250 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.503221 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-b66x2"] Jun 10 13:02:15.505404 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.505383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.508232 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.508208 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 13:02:15.509386 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.509355 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 13:02:15.509500 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.509411 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 13:02:15.509500 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.509431 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 13:02:15.509500 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.509360 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 13:02:15.509500 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.509365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7cngj\"" Jun 10 13:02:15.516663 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.516643 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-b66x2"] Jun 10 13:02:15.648902 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.648867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.649078 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.648931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.649078 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.648950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9b85\" (UniqueName: \"kubernetes.io/projected/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-kube-api-access-x9b85\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.649078 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.648971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.750115 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.750083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.750115 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.750116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9b85\" (UniqueName: \"kubernetes.io/projected/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-kube-api-access-x9b85\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.750335 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.750142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.750335 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.750199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.751003 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.750979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.753073 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.753044 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.753073 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.753049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.760895 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.759686 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9b85\" (UniqueName: \"kubernetes.io/projected/dcd4944b-e7b7-4ac3-9a34-fa2b6462643d-kube-api-access-x9b85\") pod \"prometheus-operator-7f7d445d84-b66x2\" (UID: \"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.817733 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.817696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" Jun 10 13:02:15.949169 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.949029 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-b66x2"] Jun 10 13:02:15.951659 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:15.951634 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd4944b_e7b7_4ac3_9a34_fa2b6462643d.slice/crio-8d0f01c6ea98860ce8005707f0ee5fcf257ad6cbeb64be339834a5866979da8b WatchSource:0}: Error finding container 8d0f01c6ea98860ce8005707f0ee5fcf257ad6cbeb64be339834a5866979da8b: Status 404 returned error can't find the container with id 8d0f01c6ea98860ce8005707f0ee5fcf257ad6cbeb64be339834a5866979da8b Jun 10 13:02:15.979276 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:15.979245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" event={"ID":"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d","Type":"ContainerStarted","Data":"8d0f01c6ea98860ce8005707f0ee5fcf257ad6cbeb64be339834a5866979da8b"} Jun 10 13:02:17.988264 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:17.988226 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" event={"ID":"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d","Type":"ContainerStarted","Data":"8ebd3768584e0ccc78f9f2752b097043c1cf1ae555760e834709abed0185c02f"} Jun 10 13:02:17.988644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:17.988290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" event={"ID":"dcd4944b-e7b7-4ac3-9a34-fa2b6462643d","Type":"ContainerStarted","Data":"b138df8916694b5352ee375d062ba40d3da42b9335495927eb5658df1ef983fe"} Jun 10 13:02:18.008913 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:18.008870 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b66x2" podStartSLOduration=1.828229125 podStartE2EDuration="3.008856839s" totalImagesPullingTime="1.180627714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:18.007363752 +0000 UTC m=+87.949376962" watchObservedRunningTime="2026-06-10 13:02:18.008856839 +0000 UTC m=+87.950870042" Jun 10 13:02:19.553381 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.551784 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:19.553381 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.552138 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:19.558590 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.558458 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:19.835314 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.835244 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9"] Jun 10 13:02:19.841171 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.841142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:19.844366 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.844344 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 13:02:19.844366 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.844358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 13:02:19.844366 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.844365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k8pqd\"" Jun 10 13:02:19.855200 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.855176 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9"] Jun 10 13:02:19.883162 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.883131 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-txqjq"] Jun 10 13:02:19.887299 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.887277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.889883 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.889863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 13:02:19.890002 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.889889 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 13:02:19.890215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.890199 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 13:02:19.892140 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.892117 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w77rr\"" Jun 10 13:02:19.986632 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-tls\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.986632 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-accelerators-collector-config\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.986915 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-textfile\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.986915 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986778 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-wtmp\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.986915 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.986915 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-root\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.987110 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ef35d2-7acc-4634-a11d-8c2354e91e40-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:19.987110 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ef35d2-7acc-4634-a11d-8c2354e91e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:19.987110 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.986988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5ef35d2-7acc-4634-a11d-8c2354e91e40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:19.987110 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.987014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7t9h\" (UniqueName: \"kubernetes.io/projected/c5ef35d2-7acc-4634-a11d-8c2354e91e40-kube-api-access-z7t9h\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:19.987110 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.987050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-sys\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.987110 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.987087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f2968a-1a85-4ade-9e9e-400821a36083-metrics-client-ca\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:19.987417 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:19.987117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6fch\" (UniqueName: \"kubernetes.io/projected/37f2968a-1a85-4ade-9e9e-400821a36083-kube-api-access-f6fch\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.000481 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.000452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:02:20.088247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-root\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ef35d2-7acc-4634-a11d-8c2354e91e40-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.088247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ef35d2-7acc-4634-a11d-8c2354e91e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5ef35d2-7acc-4634-a11d-8c2354e91e40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7t9h\" (UniqueName: \"kubernetes.io/projected/c5ef35d2-7acc-4634-a11d-8c2354e91e40-kube-api-access-z7t9h\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-sys\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f2968a-1a85-4ade-9e9e-400821a36083-metrics-client-ca\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6fch\" (UniqueName: \"kubernetes.io/projected/37f2968a-1a85-4ade-9e9e-400821a36083-kube-api-access-f6fch\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-tls\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088523 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-accelerators-collector-config\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088891 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-textfile\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088891 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-wtmp\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.088891 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.089061 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088891 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-wtmp\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.089061 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.088985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-textfile\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.089227 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.089190 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-sys\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.089306 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.089277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37f2968a-1a85-4ade-9e9e-400821a36083-root\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.089934 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.089905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f2968a-1a85-4ade-9e9e-400821a36083-metrics-client-ca\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.089934 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.089924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-accelerators-collector-config\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.090597 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.090567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ef35d2-7acc-4634-a11d-8c2354e91e40-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.092643 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.092605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ef35d2-7acc-4634-a11d-8c2354e91e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.093147 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.093123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.093268 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.093215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f2968a-1a85-4ade-9e9e-400821a36083-node-exporter-tls\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.093268 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.093245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5ef35d2-7acc-4634-a11d-8c2354e91e40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.101813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.101769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6fch\" (UniqueName: \"kubernetes.io/projected/37f2968a-1a85-4ade-9e9e-400821a36083-kube-api-access-f6fch\") pod \"node-exporter-txqjq\" (UID: \"37f2968a-1a85-4ade-9e9e-400821a36083\") " pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:20.104153 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.104134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7t9h\" (UniqueName: \"kubernetes.io/projected/c5ef35d2-7acc-4634-a11d-8c2354e91e40-kube-api-access-z7t9h\") pod \"openshift-state-metrics-65f78d5c66-zb6z9\" (UID: \"c5ef35d2-7acc-4634-a11d-8c2354e91e40\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.151001 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.150968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" Jun 10 13:02:20.198728 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:20.198689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-txqjq" Jun 10 13:02:24.625098 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.625048 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl"] Jun 10 13:02:24.628136 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.628110 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:24.628744 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.628720 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-769cbb9997-ph48z"] Jun 10 13:02:24.631012 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.630887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.633438 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.633416 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 13:02:24.633551 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.633490 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j46n2\"" Jun 10 13:02:24.639658 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.639633 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl"] Jun 10 13:02:24.655548 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.655517 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769cbb9997-ph48z"] Jun 10 13:02:24.731934 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.731897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-oauth-serving-cert\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.732126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.731950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a2d1596-b447-415b-b42f-be5108d40038-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:24.732126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.731984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-console-config\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.732126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.732039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66vcg\" (UniqueName: \"kubernetes.io/projected/7a2d1596-b447-415b-b42f-be5108d40038-kube-api-access-66vcg\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:24.732126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.732070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-oauth-config\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.732126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.732099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-trusted-ca-bundle\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.732392 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.732134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpkrk\" (UniqueName: \"kubernetes.io/projected/c9332364-ed42-4fca-b09e-04497d483417-kube-api-access-cpkrk\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.732392 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.732152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-serving-cert\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.732392 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.732175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-service-ca\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833322 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a2d1596-b447-415b-b42f-be5108d40038-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:24.833511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-console-config\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66vcg\" (UniqueName: \"kubernetes.io/projected/7a2d1596-b447-415b-b42f-be5108d40038-kube-api-access-66vcg\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:24.833511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-oauth-config\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-trusted-ca-bundle\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833511 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:02:24.833464 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 13:02:24.833749 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:02:24.833537 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a2d1596-b447-415b-b42f-be5108d40038-monitoring-plugin-cert podName:7a2d1596-b447-415b-b42f-be5108d40038 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:25.33351276 +0000 UTC m=+95.275525954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7a2d1596-b447-415b-b42f-be5108d40038-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-fj6wl" (UID: "7a2d1596-b447-415b-b42f-be5108d40038") : secret "monitoring-plugin-cert" not found Jun 10 13:02:24.833749 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpkrk\" (UniqueName: \"kubernetes.io/projected/c9332364-ed42-4fca-b09e-04497d483417-kube-api-access-cpkrk\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833749 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-serving-cert\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833749 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-service-ca\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.833970 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.833846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-oauth-serving-cert\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.834261 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.834238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-console-config\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.834586 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.834563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-oauth-serving-cert\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.835058 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.835009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-trusted-ca-bundle\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.835162 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.835091 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-service-ca\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.837062 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.837038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-serving-cert\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.837215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.837174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-oauth-config\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.843960 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.843918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpkrk\" (UniqueName: \"kubernetes.io/projected/c9332364-ed42-4fca-b09e-04497d483417-kube-api-access-cpkrk\") pod \"console-769cbb9997-ph48z\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:24.844049 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.843991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66vcg\" (UniqueName: \"kubernetes.io/projected/7a2d1596-b447-415b-b42f-be5108d40038-kube-api-access-66vcg\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:24.916429 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.916343 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df4744d49-7fpnj" Jun 10 13:02:24.948423 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:24.948388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:25.337199 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:25.337167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a2d1596-b447-415b-b42f-be5108d40038-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:25.339847 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:25.339804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a2d1596-b447-415b-b42f-be5108d40038-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fj6wl\" (UID: \"7a2d1596-b447-415b-b42f-be5108d40038\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:25.543692 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:25.543648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:27.210251 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:27.210210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f2968a_1a85_4ade_9e9e_400821a36083.slice/crio-0dd6306f729f6318cc53ce7ed31605655baeaa6ee00f19cf5501c38e96b75a8c WatchSource:0}: Error finding container 0dd6306f729f6318cc53ce7ed31605655baeaa6ee00f19cf5501c38e96b75a8c: Status 404 returned error can't find the container with id 0dd6306f729f6318cc53ce7ed31605655baeaa6ee00f19cf5501c38e96b75a8c Jun 10 13:02:27.392088 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:27.392054 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769cbb9997-ph48z"] Jun 10 13:02:27.400942 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:27.400914 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9332364_ed42_4fca_b09e_04497d483417.slice/crio-b9f09d5267c6787f9b7c1276b6be7a02b034be8ac8e60b25dc2ba555e6e587fa WatchSource:0}: Error finding container b9f09d5267c6787f9b7c1276b6be7a02b034be8ac8e60b25dc2ba555e6e587fa: Status 404 returned error can't find the container with id b9f09d5267c6787f9b7c1276b6be7a02b034be8ac8e60b25dc2ba555e6e587fa Jun 10 13:02:27.626561 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:27.626390 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9"] Jun 10 13:02:27.627867 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:27.627802 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl"] Jun 10 13:02:27.632120 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:27.632087 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ef35d2_7acc_4634_a11d_8c2354e91e40.slice/crio-3e21753c28bb25ce4f21880af8557e95020e55d0b1f76dcfbd9cc4566cc4cfa0 WatchSource:0}: Error finding container 3e21753c28bb25ce4f21880af8557e95020e55d0b1f76dcfbd9cc4566cc4cfa0: Status 404 returned error can't find the container with id 3e21753c28bb25ce4f21880af8557e95020e55d0b1f76dcfbd9cc4566cc4cfa0 Jun 10 13:02:27.632856 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:02:27.632727 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2d1596_b447_415b_b42f_be5108d40038.slice/crio-d9faa6cd11e47a335f2f073d2e41399bb74e911a636ea6474f4a55cccacc79e0 WatchSource:0}: Error finding container d9faa6cd11e47a335f2f073d2e41399bb74e911a636ea6474f4a55cccacc79e0: Status 404 returned error can't find the container with id d9faa6cd11e47a335f2f073d2e41399bb74e911a636ea6474f4a55cccacc79e0 Jun 10 13:02:28.040220 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.040173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" event={"ID":"c5ef35d2-7acc-4634-a11d-8c2354e91e40","Type":"ContainerStarted","Data":"360812e950e94d32320e4adcd9b67a60d32702f782b4d1f1c19610dbcd5a6fbd"} Jun 10 13:02:28.040433 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.040261 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" event={"ID":"c5ef35d2-7acc-4634-a11d-8c2354e91e40","Type":"ContainerStarted","Data":"590ffe1b8092f14a03ae12ebc7e3b1d447289d6b562de6fa0f00cbc78981f42c"} Jun 10 13:02:28.040433 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.040301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" event={"ID":"c5ef35d2-7acc-4634-a11d-8c2354e91e40","Type":"ContainerStarted","Data":"3e21753c28bb25ce4f21880af8557e95020e55d0b1f76dcfbd9cc4566cc4cfa0"} Jun 10 13:02:28.042509 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.042474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-5qblf" event={"ID":"a065cfcd-7862-474c-9f98-07c050d8542b","Type":"ContainerStarted","Data":"06941fbfa3e01b78cfdd7731d66aec3cc9236cda3733236f6b24b3aea85aeb5d"} Jun 10 13:02:28.043042 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.043022 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:28.044914 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.044825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" event={"ID":"7a2d1596-b447-415b-b42f-be5108d40038","Type":"ContainerStarted","Data":"d9faa6cd11e47a335f2f073d2e41399bb74e911a636ea6474f4a55cccacc79e0"} Jun 10 13:02:28.047089 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.047064 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txqjq" event={"ID":"37f2968a-1a85-4ade-9e9e-400821a36083","Type":"ContainerStarted","Data":"0dd6306f729f6318cc53ce7ed31605655baeaa6ee00f19cf5501c38e96b75a8c"} Jun 10 13:02:28.049217 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.049191 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769cbb9997-ph48z" event={"ID":"c9332364-ed42-4fca-b09e-04497d483417","Type":"ContainerStarted","Data":"e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac"} Jun 10 13:02:28.049330 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.049237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769cbb9997-ph48z" event={"ID":"c9332364-ed42-4fca-b09e-04497d483417","Type":"ContainerStarted","Data":"b9f09d5267c6787f9b7c1276b6be7a02b034be8ac8e60b25dc2ba555e6e587fa"} Jun 10 13:02:28.057656 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.057630 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-5qblf" Jun 10 13:02:28.062115 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.062062 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-5qblf" podStartSLOduration=1.278476717 podStartE2EDuration="25.062045883s" totalImagesPullingTime="23.783569166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:28.060873235 +0000 UTC m=+98.002886447" watchObservedRunningTime="2026-06-10 13:02:28.062045883 +0000 UTC m=+98.004059130" Jun 10 13:02:28.104768 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.104656 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-769cbb9997-ph48z" podStartSLOduration=4.104630905 podStartE2EDuration="4.104630905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:28.102905625 +0000 UTC m=+98.044918840" watchObservedRunningTime="2026-06-10 13:02:28.104630905 +0000 UTC m=+98.046644116" Jun 10 13:02:28.874466 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:28.874431 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t79fc" Jun 10 13:02:29.059588 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:29.057859 2561 generic.go:356] "Generic (PLEG): container finished" podID="37f2968a-1a85-4ade-9e9e-400821a36083" containerID="64599051411cce2eae8c4cceb19ab644cf3fc75f587407b00bd93c9dfe6b91d1" exitCode=0 Jun 10 13:02:29.059588 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:29.057934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txqjq" event={"ID":"37f2968a-1a85-4ade-9e9e-400821a36083","Type":"ContainerDied","Data":"64599051411cce2eae8c4cceb19ab644cf3fc75f587407b00bd93c9dfe6b91d1"} Jun 10 13:02:31.076144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.076102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txqjq" event={"ID":"37f2968a-1a85-4ade-9e9e-400821a36083","Type":"ContainerStarted","Data":"711bdec247e8767521ffc7b9daebc3d2d57a76a03e6769aca3829511151aea0c"} Jun 10 13:02:31.076691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.076173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txqjq" event={"ID":"37f2968a-1a85-4ade-9e9e-400821a36083","Type":"ContainerStarted","Data":"002b3fbadb1187cff2f4b655bec902f83b0f35ef7d7fa5d0a49baa878da071da"} Jun 10 13:02:31.079232 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.078765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" event={"ID":"c5ef35d2-7acc-4634-a11d-8c2354e91e40","Type":"ContainerStarted","Data":"c54026f05e84a76f882cd13e4822547bff7542e6648739f4af2a0362f6100da3"} Jun 10 13:02:31.080623 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.080593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" event={"ID":"7a2d1596-b447-415b-b42f-be5108d40038","Type":"ContainerStarted","Data":"466f2dbcb20e111ab2f43f96c9da7d9d470f813f428ff610e02a407407b04d09"} Jun 10 13:02:31.080841 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.080815 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:31.086337 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.086316 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" Jun 10 13:02:31.097372 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.097316 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-txqjq" podStartSLOduration=10.907341415 podStartE2EDuration="12.097298286s" totalImagesPullingTime="1.086800342s" totalInitContainerRuntime="103.156529ms" isStatefulPod=true podCreationTimestamp="2026-06-10 13:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:31.094516554 +0000 UTC m=+101.036529777" watchObservedRunningTime="2026-06-10 13:02:31.097298286 +0000 UTC m=+101.039311496" Jun 10 13:02:31.113399 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.113342 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zb6z9" podStartSLOduration=9.674517117 podStartE2EDuration="12.113324054s" totalImagesPullingTime="2.438806937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:31.113083461 +0000 UTC m=+101.055096672" watchObservedRunningTime="2026-06-10 13:02:31.113324054 +0000 UTC m=+101.055337266" Jun 10 13:02:31.130348 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:31.130298 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fj6wl" podStartSLOduration=4.514488136 podStartE2EDuration="7.130278719s" totalImagesPullingTime="2.615790583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:31.128489236 +0000 UTC m=+101.070502461" watchObservedRunningTime="2026-06-10 13:02:31.130278719 +0000 UTC m=+101.072291931" Jun 10 13:02:34.949446 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:34.949405 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:34.949909 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:34.949484 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:34.954819 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:34.954797 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:35.103871 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:35.103819 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:02:35.155349 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:02:35.155313 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758b5b6f4d-tcb2p"] Jun 10 13:03:00.181330 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.181267 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-758b5b6f4d-tcb2p" podUID="a1271b2f-a308-4170-85fe-355468aa8021" containerName="console" containerID="cri-o://5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb" gracePeriod=15 Jun 10 13:03:00.194979 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.194954 2561 generic.go:356] "Generic (PLEG): container finished" podID="12f9f46b-a017-4281-8817-b47721e80dbe" containerID="49cf067ad0f63f311f323face2431bf222526746ada80e47b5c9c2da0685274d" exitCode=0 Jun 10 13:03:00.195066 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.195023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" event={"ID":"12f9f46b-a017-4281-8817-b47721e80dbe","Type":"ContainerDied","Data":"49cf067ad0f63f311f323face2431bf222526746ada80e47b5c9c2da0685274d"} Jun 10 13:03:00.195342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.195325 2561 scope.go:117] "RemoveContainer" containerID="49cf067ad0f63f311f323face2431bf222526746ada80e47b5c9c2da0685274d" Jun 10 13:03:00.196696 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.196676 2561 generic.go:356] "Generic (PLEG): container finished" podID="baa26f6d-3ab4-498f-86b4-9ad68af49da2" containerID="92bdac58fb8856949c63eb3697b2ebb22bfa9dd40184823849f3bd5dd30a0921" exitCode=0 Jun 10 13:03:00.196779 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.196713 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4qw9d" event={"ID":"baa26f6d-3ab4-498f-86b4-9ad68af49da2","Type":"ContainerDied","Data":"92bdac58fb8856949c63eb3697b2ebb22bfa9dd40184823849f3bd5dd30a0921"} Jun 10 13:03:00.196999 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.196986 2561 scope.go:117] "RemoveContainer" containerID="92bdac58fb8856949c63eb3697b2ebb22bfa9dd40184823849f3bd5dd30a0921" Jun 10 13:03:00.489552 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.489528 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:03:00.637368 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637338 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-service-ca\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637505 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637390 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-console-config\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637505 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637418 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwrpz\" (UniqueName: \"kubernetes.io/projected/a1271b2f-a308-4170-85fe-355468aa8021-kube-api-access-gwrpz\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637505 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637447 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-trusted-ca-bundle\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637505 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637478 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-oauth-config\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637733 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637527 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-serving-cert\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637733 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637596 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-oauth-serving-cert\") pod \"a1271b2f-a308-4170-85fe-355468aa8021\" (UID: \"a1271b2f-a308-4170-85fe-355468aa8021\") " Jun 10 13:03:00.637884 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.637852 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:03:00.638540 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.638510 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:03:00.638652 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.638572 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:03:00.638941 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.638914 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-console-config" (OuterVolumeSpecName: "console-config") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:03:00.640127 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.640094 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1271b2f-a308-4170-85fe-355468aa8021-kube-api-access-gwrpz" (OuterVolumeSpecName: "kube-api-access-gwrpz") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "kube-api-access-gwrpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:03:00.640419 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.640341 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:03:00.640477 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.640460 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1271b2f-a308-4170-85fe-355468aa8021" (UID: "a1271b2f-a308-4170-85fe-355468aa8021"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:03:00.738644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738619 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-service-ca\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:00.738644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738646 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-console-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:00.738784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738660 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwrpz\" (UniqueName: \"kubernetes.io/projected/a1271b2f-a308-4170-85fe-355468aa8021-kube-api-access-gwrpz\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:00.738784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738674 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-trusted-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:00.738784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738687 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-oauth-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:00.738784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738700 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1271b2f-a308-4170-85fe-355468aa8021-console-serving-cert\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:00.738784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:00.738712 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1271b2f-a308-4170-85fe-355468aa8021-oauth-serving-cert\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:03:01.202589 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.202502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4qw9d" event={"ID":"baa26f6d-3ab4-498f-86b4-9ad68af49da2","Type":"ContainerStarted","Data":"52f54b39954bb8640cb7613cbe2eb27bffdbe46cbff2f1d08c4cf1664de7f270"} Jun 10 13:03:01.203755 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.203735 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1271b2f-a308-4170-85fe-355468aa8021" containerID="5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb" exitCode=0 Jun 10 13:03:01.203851 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.203771 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758b5b6f4d-tcb2p" Jun 10 13:03:01.203921 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.203851 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758b5b6f4d-tcb2p" event={"ID":"a1271b2f-a308-4170-85fe-355468aa8021","Type":"ContainerDied","Data":"5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb"} Jun 10 13:03:01.203921 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.203912 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758b5b6f4d-tcb2p" event={"ID":"a1271b2f-a308-4170-85fe-355468aa8021","Type":"ContainerDied","Data":"a81911484368af21b771791bb9b3ed7d01b57a7594402719dc15c3c0daf68bbe"} Jun 10 13:03:01.204022 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.203944 2561 scope.go:117] "RemoveContainer" containerID="5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb" Jun 10 13:03:01.205709 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.205691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9vsbw" event={"ID":"12f9f46b-a017-4281-8817-b47721e80dbe","Type":"ContainerStarted","Data":"c675b93eb2d72c603386b49f42e7dee9263d71e3d9afe60fbbc733c5018a2498"} Jun 10 13:03:01.212648 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.212629 2561 scope.go:117] "RemoveContainer" containerID="5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb" Jun 10 13:03:01.212913 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:03:01.212893 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb\": container with ID starting with 5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb not found: ID does not exist" containerID="5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb" Jun 10 13:03:01.212963 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.212921 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb"} err="failed to get container status \"5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb\": rpc error: code = NotFound desc = could not find container \"5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb\": container with ID starting with 5d99c7e3a32686840f2f270afa6167d4eb7fbda7f57c5c3ccd83818d7aa516fb not found: ID does not exist" Jun 10 13:03:01.261009 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.260982 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758b5b6f4d-tcb2p"] Jun 10 13:03:01.267586 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:01.267563 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-758b5b6f4d-tcb2p"] Jun 10 13:03:02.561050 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:02.561019 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1271b2f-a308-4170-85fe-355468aa8021" path="/var/lib/kubelet/pods/a1271b2f-a308-4170-85fe-355468aa8021/volumes" Jun 10 13:03:49.006857 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.006758 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f544d97f-rhf2x"] Jun 10 13:03:49.007289 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.007194 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1271b2f-a308-4170-85fe-355468aa8021" containerName="console" Jun 10 13:03:49.007289 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.007213 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1271b2f-a308-4170-85fe-355468aa8021" containerName="console" Jun 10 13:03:49.007365 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.007291 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1271b2f-a308-4170-85fe-355468aa8021" containerName="console" Jun 10 13:03:49.009027 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.009006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.021383 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.021359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f544d97f-rhf2x"] Jun 10 13:03:49.121803 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.121762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llv44\" (UniqueName: \"kubernetes.io/projected/6fe3e538-adce-4487-a0f7-d5f738a6f222-kube-api-access-llv44\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.121803 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.121808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-serving-cert\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.122051 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.121849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-oauth-config\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.122051 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.121930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-service-ca\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.122051 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.121968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-oauth-serving-cert\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.122051 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.121994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-trusted-ca-bundle\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.122228 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.122096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-config\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223364 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-config\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llv44\" (UniqueName: \"kubernetes.io/projected/6fe3e538-adce-4487-a0f7-d5f738a6f222-kube-api-access-llv44\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-serving-cert\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-oauth-config\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223696 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-service-ca\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223696 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-oauth-serving-cert\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.223696 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.223632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-trusted-ca-bundle\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.224288 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.224256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-config\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.224409 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.224313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-oauth-serving-cert\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.224409 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.224337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-service-ca\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.224486 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.224439 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-trusted-ca-bundle\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.226582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.226559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-serving-cert\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.226582 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.226573 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-oauth-config\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.233511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.233487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llv44\" (UniqueName: \"kubernetes.io/projected/6fe3e538-adce-4487-a0f7-d5f738a6f222-kube-api-access-llv44\") pod \"console-86f544d97f-rhf2x\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.320338 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.320244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:03:49.473417 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:49.473393 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f544d97f-rhf2x"] Jun 10 13:03:49.475317 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:03:49.475279 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe3e538_adce_4487_a0f7_d5f738a6f222.slice/crio-80d390d8802f361c4ce980081a73cf7bf1834d5abae45a06addfe1899d2042dd WatchSource:0}: Error finding container 80d390d8802f361c4ce980081a73cf7bf1834d5abae45a06addfe1899d2042dd: Status 404 returned error can't find the container with id 80d390d8802f361c4ce980081a73cf7bf1834d5abae45a06addfe1899d2042dd Jun 10 13:03:50.406071 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:50.406033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f544d97f-rhf2x" event={"ID":"6fe3e538-adce-4487-a0f7-d5f738a6f222","Type":"ContainerStarted","Data":"5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c"} Jun 10 13:03:50.406486 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:50.406088 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f544d97f-rhf2x" event={"ID":"6fe3e538-adce-4487-a0f7-d5f738a6f222","Type":"ContainerStarted","Data":"80d390d8802f361c4ce980081a73cf7bf1834d5abae45a06addfe1899d2042dd"} Jun 10 13:03:50.427280 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:50.427233 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f544d97f-rhf2x" podStartSLOduration=2.4272175 podStartE2EDuration="2.4272175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:50.426118331 +0000 UTC m=+180.368131543" watchObservedRunningTime="2026-06-10 13:03:50.4272175 +0000 UTC m=+180.369230709" Jun 10 13:03:57.137274 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.137225 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f544d97f-rhf2x"] Jun 10 13:03:57.185378 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.185346 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845bb65c6f-mgjxz"] Jun 10 13:03:57.187999 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.187980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.201716 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.201691 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845bb65c6f-mgjxz"] Jun 10 13:03:57.295055 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-service-ca\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.295243 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-oauth-serving-cert\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.295243 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-config\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.295243 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-oauth-config\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.295243 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-serving-cert\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.295416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-trusted-ca-bundle\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.295416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.295304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4xmq\" (UniqueName: \"kubernetes.io/projected/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-kube-api-access-m4xmq\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.395998 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.395912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-oauth-serving-cert\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.395998 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.395949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-config\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.395998 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.395974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-oauth-config\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.395998 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.395995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-serving-cert\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.396311 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.396016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-trusted-ca-bundle\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.396311 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.396055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4xmq\" (UniqueName: \"kubernetes.io/projected/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-kube-api-access-m4xmq\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.396311 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.396106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-service-ca\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.396744 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.396720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-oauth-serving-cert\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.396864 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.396774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-config\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.396962 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.396935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-service-ca\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.397121 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.397103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-trusted-ca-bundle\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.399193 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.399161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-oauth-config\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.399288 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.399235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-console-serving-cert\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.406892 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.406869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4xmq\" (UniqueName: \"kubernetes.io/projected/ee3ae7c0-a8b0-4c03-95c0-84db59d634e0-kube-api-access-m4xmq\") pod \"console-845bb65c6f-mgjxz\" (UID: \"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0\") " pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.496800 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.496763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:03:57.638952 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:57.638921 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845bb65c6f-mgjxz"] Jun 10 13:03:57.642059 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:03:57.642032 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3ae7c0_a8b0_4c03_95c0_84db59d634e0.slice/crio-cf6484031326b472fc7b833b90ad0733e4c7e2ada254805ab2eec550c2137275 WatchSource:0}: Error finding container cf6484031326b472fc7b833b90ad0733e4c7e2ada254805ab2eec550c2137275: Status 404 returned error can't find the container with id cf6484031326b472fc7b833b90ad0733e4c7e2ada254805ab2eec550c2137275 Jun 10 13:03:58.440130 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:58.440096 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845bb65c6f-mgjxz" event={"ID":"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0","Type":"ContainerStarted","Data":"26a113ffea687e08dcf3023d975d5faa9e00bc59cde40eaae365f32beef0233d"} Jun 10 13:03:58.440581 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:58.440144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845bb65c6f-mgjxz" event={"ID":"ee3ae7c0-a8b0-4c03-95c0-84db59d634e0","Type":"ContainerStarted","Data":"cf6484031326b472fc7b833b90ad0733e4c7e2ada254805ab2eec550c2137275"} Jun 10 13:03:58.461566 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:58.461505 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845bb65c6f-mgjxz" podStartSLOduration=1.461490008 podStartE2EDuration="1.461490008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:58.460381054 +0000 UTC m=+188.402394266" watchObservedRunningTime="2026-06-10 13:03:58.461490008 +0000 UTC m=+188.403503217" Jun 10 13:03:59.320775 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:03:59.320739 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:04:07.497031 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:07.496992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:04:07.497477 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:07.497080 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:04:07.501793 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:07.501770 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:04:08.481976 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:08.481947 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845bb65c6f-mgjxz" Jun 10 13:04:08.531272 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:08.531240 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-769cbb9997-ph48z"] Jun 10 13:04:22.158948 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.158889 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86f544d97f-rhf2x" podUID="6fe3e538-adce-4487-a0f7-d5f738a6f222" containerName="console" containerID="cri-o://5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c" gracePeriod=15 Jun 10 13:04:22.396677 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.396653 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:04:22.398047 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398029 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-service-ca\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398142 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398070 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llv44\" (UniqueName: \"kubernetes.io/projected/6fe3e538-adce-4487-a0f7-d5f738a6f222-kube-api-access-llv44\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398142 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398096 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-trusted-ca-bundle\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398142 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398137 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-config\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398293 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398190 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-serving-cert\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398293 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398224 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-oauth-serving-cert\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398293 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398279 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-oauth-config\") pod \"6fe3e538-adce-4487-a0f7-d5f738a6f222\" (UID: \"6fe3e538-adce-4487-a0f7-d5f738a6f222\") " Jun 10 13:04:22.398493 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398367 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:22.398552 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398527 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:22.398610 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398540 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-config" (OuterVolumeSpecName: "console-config") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:22.398670 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.398609 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:22.400244 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.400190 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe3e538-adce-4487-a0f7-d5f738a6f222-kube-api-access-llv44" (OuterVolumeSpecName: "kube-api-access-llv44") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "kube-api-access-llv44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:04:22.400385 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.400293 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:04:22.400465 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.400417 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fe3e538-adce-4487-a0f7-d5f738a6f222" (UID: "6fe3e538-adce-4487-a0f7-d5f738a6f222"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:04:22.499097 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499069 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.499097 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499096 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-serving-cert\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.499247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499106 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-oauth-serving-cert\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.499247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499115 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fe3e538-adce-4487-a0f7-d5f738a6f222-console-oauth-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.499247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499123 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-service-ca\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.499247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499132 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llv44\" (UniqueName: \"kubernetes.io/projected/6fe3e538-adce-4487-a0f7-d5f738a6f222-kube-api-access-llv44\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.499247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.499140 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fe3e538-adce-4487-a0f7-d5f738a6f222-trusted-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:22.530407 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.530379 2561 generic.go:356] "Generic (PLEG): container finished" podID="6fe3e538-adce-4487-a0f7-d5f738a6f222" containerID="5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c" exitCode=0 Jun 10 13:04:22.530503 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.530426 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f544d97f-rhf2x" Jun 10 13:04:22.530503 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.530471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f544d97f-rhf2x" event={"ID":"6fe3e538-adce-4487-a0f7-d5f738a6f222","Type":"ContainerDied","Data":"5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c"} Jun 10 13:04:22.530570 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.530518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f544d97f-rhf2x" event={"ID":"6fe3e538-adce-4487-a0f7-d5f738a6f222","Type":"ContainerDied","Data":"80d390d8802f361c4ce980081a73cf7bf1834d5abae45a06addfe1899d2042dd"} Jun 10 13:04:22.530570 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.530539 2561 scope.go:117] "RemoveContainer" containerID="5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c" Jun 10 13:04:22.539207 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.539187 2561 scope.go:117] "RemoveContainer" containerID="5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c" Jun 10 13:04:22.539442 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:04:22.539425 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c\": container with ID starting with 5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c not found: ID does not exist" containerID="5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c" Jun 10 13:04:22.539493 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.539448 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c"} err="failed to get container status \"5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c\": rpc error: code = NotFound desc = could not find container \"5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c\": container with ID starting with 5f37287c9b81f209499bf4ecb486ab9f2804d2ee3095d3cfa8879164ba1c8a1c not found: ID does not exist" Jun 10 13:04:22.551298 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.551276 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f544d97f-rhf2x"] Jun 10 13:04:22.560253 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:22.560233 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f544d97f-rhf2x"] Jun 10 13:04:24.560555 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:24.560512 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe3e538-adce-4487-a0f7-d5f738a6f222" path="/var/lib/kubelet/pods/6fe3e538-adce-4487-a0f7-d5f738a6f222/volumes" Jun 10 13:04:33.554563 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.554499 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-769cbb9997-ph48z" podUID="c9332364-ed42-4fca-b09e-04497d483417" containerName="console" containerID="cri-o://e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac" gracePeriod=15 Jun 10 13:04:33.798401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.798375 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:04:33.877292 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877218 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-trusted-ca-bundle\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877292 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877248 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-serving-cert\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877292 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877273 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-oauth-serving-cert\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877292 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877292 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-oauth-config\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877590 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877326 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-service-ca\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877590 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877370 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-console-config\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877590 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877414 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpkrk\" (UniqueName: \"kubernetes.io/projected/c9332364-ed42-4fca-b09e-04497d483417-kube-api-access-cpkrk\") pod \"c9332364-ed42-4fca-b09e-04497d483417\" (UID: \"c9332364-ed42-4fca-b09e-04497d483417\") " Jun 10 13:04:33.877783 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877758 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:33.877864 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877755 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-console-config" (OuterVolumeSpecName: "console-config") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:33.877968 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.877853 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:33.878235 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.878064 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:04:33.879583 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.879561 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:04:33.879583 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.879564 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9332364-ed42-4fca-b09e-04497d483417-kube-api-access-cpkrk" (OuterVolumeSpecName: "kube-api-access-cpkrk") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "kube-api-access-cpkrk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:04:33.879681 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.879633 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9332364-ed42-4fca-b09e-04497d483417" (UID: "c9332364-ed42-4fca-b09e-04497d483417"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:04:33.978009 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.977985 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-oauth-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:33.978009 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.978006 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-service-ca\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:33.978155 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.978016 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-console-config\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:33.978155 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.978024 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpkrk\" (UniqueName: \"kubernetes.io/projected/c9332364-ed42-4fca-b09e-04497d483417-kube-api-access-cpkrk\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:33.978155 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.978033 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-trusted-ca-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:33.978155 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.978041 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9332364-ed42-4fca-b09e-04497d483417-console-serving-cert\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:33.978155 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:33.978051 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9332364-ed42-4fca-b09e-04497d483417-oauth-serving-cert\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:04:34.577374 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.577342 2561 generic.go:356] "Generic (PLEG): container finished" podID="c9332364-ed42-4fca-b09e-04497d483417" containerID="e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac" exitCode=0 Jun 10 13:04:34.577688 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.577394 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769cbb9997-ph48z" Jun 10 13:04:34.577688 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.577428 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769cbb9997-ph48z" event={"ID":"c9332364-ed42-4fca-b09e-04497d483417","Type":"ContainerDied","Data":"e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac"} Jun 10 13:04:34.577688 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.577478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769cbb9997-ph48z" event={"ID":"c9332364-ed42-4fca-b09e-04497d483417","Type":"ContainerDied","Data":"b9f09d5267c6787f9b7c1276b6be7a02b034be8ac8e60b25dc2ba555e6e587fa"} Jun 10 13:04:34.577688 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.577500 2561 scope.go:117] "RemoveContainer" containerID="e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac" Jun 10 13:04:34.585459 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.585442 2561 scope.go:117] "RemoveContainer" containerID="e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac" Jun 10 13:04:34.585729 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:04:34.585707 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac\": container with ID starting with e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac not found: ID does not exist" containerID="e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac" Jun 10 13:04:34.585814 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.585735 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac"} err="failed to get container status \"e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac\": rpc error: code = NotFound desc = could not find container \"e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac\": container with ID starting with e11d57179e578801fca907aa0dc90ae9b81aa126bb010da602234b321f558cac not found: ID does not exist" Jun 10 13:04:34.595181 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.595156 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-769cbb9997-ph48z"] Jun 10 13:04:34.598918 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:34.598899 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-769cbb9997-ph48z"] Jun 10 13:04:36.561049 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:04:36.561016 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9332364-ed42-4fca-b09e-04497d483417" path="/var/lib/kubelet/pods/c9332364-ed42-4fca-b09e-04497d483417/volumes" Jun 10 13:05:06.744797 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.744752 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp"] Jun 10 13:05:06.745401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.745180 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe3e538-adce-4487-a0f7-d5f738a6f222" containerName="console" Jun 10 13:05:06.745401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.745198 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe3e538-adce-4487-a0f7-d5f738a6f222" containerName="console" Jun 10 13:05:06.745401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.745240 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9332364-ed42-4fca-b09e-04497d483417" containerName="console" Jun 10 13:05:06.745401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.745248 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9332364-ed42-4fca-b09e-04497d483417" containerName="console" Jun 10 13:05:06.745401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.745337 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9332364-ed42-4fca-b09e-04497d483417" containerName="console" Jun 10 13:05:06.745401 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.745349 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe3e538-adce-4487-a0f7-d5f738a6f222" containerName="console" Jun 10 13:05:06.749916 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.749893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.752481 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.752455 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:05:06.752481 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.752470 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z9vr\"" Jun 10 13:05:06.753442 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.753427 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:05:06.758218 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.758191 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp"] Jun 10 13:05:06.822610 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.822577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.822762 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.822649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.822762 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.822683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmpnh\" (UniqueName: \"kubernetes.io/projected/31150420-c0ae-4c66-9caf-d793021113cf-kube-api-access-lmpnh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.923840 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.923806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.923998 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.923875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.923998 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.923903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmpnh\" (UniqueName: \"kubernetes.io/projected/31150420-c0ae-4c66-9caf-d793021113cf-kube-api-access-lmpnh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.924244 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.924220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.924311 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.924244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:06.932255 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:06.932233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmpnh\" (UniqueName: \"kubernetes.io/projected/31150420-c0ae-4c66-9caf-d793021113cf-kube-api-access-lmpnh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:07.060259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:07.060181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:07.190530 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:07.190506 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp"] Jun 10 13:05:07.192584 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:05:07.192556 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31150420_c0ae_4c66_9caf_d793021113cf.slice/crio-cf335025be93958e8bb4b5644d5a68b9ea26fe2d27ffe3011a2fc2dbcafecde8 WatchSource:0}: Error finding container cf335025be93958e8bb4b5644d5a68b9ea26fe2d27ffe3011a2fc2dbcafecde8: Status 404 returned error can't find the container with id cf335025be93958e8bb4b5644d5a68b9ea26fe2d27ffe3011a2fc2dbcafecde8 Jun 10 13:05:07.697872 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:07.697817 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerStarted","Data":"cf335025be93958e8bb4b5644d5a68b9ea26fe2d27ffe3011a2fc2dbcafecde8"} Jun 10 13:05:14.726820 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:14.726781 2561 generic.go:356] "Generic (PLEG): container finished" podID="31150420-c0ae-4c66-9caf-d793021113cf" containerID="d3b4ec2d93c47f0d4339eeeebf2db2deeaaeb303d64ce2498f6e55c7853374d5" exitCode=0 Jun 10 13:05:14.727242 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:14.726876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerDied","Data":"d3b4ec2d93c47f0d4339eeeebf2db2deeaaeb303d64ce2498f6e55c7853374d5"} Jun 10 13:05:16.738896 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:16.738856 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerStarted","Data":"d48290e7e781d49c559f27e652f0286cdf7e2c54680853a0e324052baa61126d"} Jun 10 13:05:17.744387 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:17.744350 2561 generic.go:356] "Generic (PLEG): container finished" podID="31150420-c0ae-4c66-9caf-d793021113cf" containerID="d48290e7e781d49c559f27e652f0286cdf7e2c54680853a0e324052baa61126d" exitCode=0 Jun 10 13:05:17.744760 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:17.744433 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerDied","Data":"d48290e7e781d49c559f27e652f0286cdf7e2c54680853a0e324052baa61126d"} Jun 10 13:05:26.786354 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:26.786316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerStarted","Data":"ab362a07212274418cd8076b2e87e8e968bd462a1e6abbb3757223098b79a692"} Jun 10 13:05:26.808055 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:26.807906 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" podStartSLOduration=3.520256046 podStartE2EDuration="20.807885962s" totalImagesPullingTime="17.287629916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:26.806696028 +0000 UTC m=+276.748709234" watchObservedRunningTime="2026-06-10 13:05:26.807885962 +0000 UTC m=+276.749899164" Jun 10 13:05:27.792364 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:27.792329 2561 generic.go:356] "Generic (PLEG): container finished" podID="31150420-c0ae-4c66-9caf-d793021113cf" containerID="ab362a07212274418cd8076b2e87e8e968bd462a1e6abbb3757223098b79a692" exitCode=0 Jun 10 13:05:27.792731 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:27.792425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerDied","Data":"ab362a07212274418cd8076b2e87e8e968bd462a1e6abbb3757223098b79a692"} Jun 10 13:05:28.926366 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:28.926339 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:29.116070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.115972 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-bundle\") pod \"31150420-c0ae-4c66-9caf-d793021113cf\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " Jun 10 13:05:29.116070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.116028 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmpnh\" (UniqueName: \"kubernetes.io/projected/31150420-c0ae-4c66-9caf-d793021113cf-kube-api-access-lmpnh\") pod \"31150420-c0ae-4c66-9caf-d793021113cf\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " Jun 10 13:05:29.116070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.116071 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-util\") pod \"31150420-c0ae-4c66-9caf-d793021113cf\" (UID: \"31150420-c0ae-4c66-9caf-d793021113cf\") " Jun 10 13:05:29.116747 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.116715 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-bundle" (OuterVolumeSpecName: "bundle") pod "31150420-c0ae-4c66-9caf-d793021113cf" (UID: "31150420-c0ae-4c66-9caf-d793021113cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:05:29.118400 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.118371 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31150420-c0ae-4c66-9caf-d793021113cf-kube-api-access-lmpnh" (OuterVolumeSpecName: "kube-api-access-lmpnh") pod "31150420-c0ae-4c66-9caf-d793021113cf" (UID: "31150420-c0ae-4c66-9caf-d793021113cf"). InnerVolumeSpecName "kube-api-access-lmpnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:29.121247 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.121226 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-util" (OuterVolumeSpecName: "util") pod "31150420-c0ae-4c66-9caf-d793021113cf" (UID: "31150420-c0ae-4c66-9caf-d793021113cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:05:29.217176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.217142 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:05:29.217176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.217169 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmpnh\" (UniqueName: \"kubernetes.io/projected/31150420-c0ae-4c66-9caf-d793021113cf-kube-api-access-lmpnh\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:05:29.217176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.217179 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31150420-c0ae-4c66-9caf-d793021113cf-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:05:29.801606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.801576 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" Jun 10 13:05:29.801606 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.801594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7mbsp" event={"ID":"31150420-c0ae-4c66-9caf-d793021113cf","Type":"ContainerDied","Data":"cf335025be93958e8bb4b5644d5a68b9ea26fe2d27ffe3011a2fc2dbcafecde8"} Jun 10 13:05:29.801917 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:29.801637 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf335025be93958e8bb4b5644d5a68b9ea26fe2d27ffe3011a2fc2dbcafecde8" Jun 10 13:05:39.218054 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218020 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs"] Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218298 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="extract" Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218308 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="extract" Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218322 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="util" Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218328 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="util" Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218334 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="pull" Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218339 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="pull" Jun 10 13:05:39.218421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.218383 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="31150420-c0ae-4c66-9caf-d793021113cf" containerName="extract" Jun 10 13:05:39.221433 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.221414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.224132 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.224111 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:05:39.224237 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.224181 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:05:39.225218 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.225200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z9vr\"" Jun 10 13:05:39.230896 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.230873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs"] Jun 10 13:05:39.289717 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.289692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxgz\" (UniqueName: \"kubernetes.io/projected/600ab9f4-76f6-40d9-9dd5-457186720a1f-kube-api-access-qfxgz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.289871 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.289734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.289871 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.289762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.390927 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.390893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.391041 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.390975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxgz\" (UniqueName: \"kubernetes.io/projected/600ab9f4-76f6-40d9-9dd5-457186720a1f-kube-api-access-qfxgz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.391041 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.391010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.391290 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.391272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.391326 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.391299 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.399697 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.399673 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxgz\" (UniqueName: \"kubernetes.io/projected/600ab9f4-76f6-40d9-9dd5-457186720a1f-kube-api-access-qfxgz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.530020 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.529988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:39.663886 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.663861 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs"] Jun 10 13:05:39.666159 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:05:39.666126 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600ab9f4_76f6_40d9_9dd5_457186720a1f.slice/crio-acb62c6799886bc1b6eda1bc28c69abc18551c53177a3c31c83641310ee83f37 WatchSource:0}: Error finding container acb62c6799886bc1b6eda1bc28c69abc18551c53177a3c31c83641310ee83f37: Status 404 returned error can't find the container with id acb62c6799886bc1b6eda1bc28c69abc18551c53177a3c31c83641310ee83f37 Jun 10 13:05:39.840957 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.840887 2561 generic.go:356] "Generic (PLEG): container finished" podID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerID="c26d61976fe0f0b6b3720b2f7ee5efaefc51392917d403f9ec52d656623dbdea" exitCode=0 Jun 10 13:05:39.841077 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.840955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" event={"ID":"600ab9f4-76f6-40d9-9dd5-457186720a1f","Type":"ContainerDied","Data":"c26d61976fe0f0b6b3720b2f7ee5efaefc51392917d403f9ec52d656623dbdea"} Jun 10 13:05:39.841077 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:39.841002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" event={"ID":"600ab9f4-76f6-40d9-9dd5-457186720a1f","Type":"ContainerStarted","Data":"acb62c6799886bc1b6eda1bc28c69abc18551c53177a3c31c83641310ee83f37"} Jun 10 13:05:42.855349 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.855322 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" event={"ID":"600ab9f4-76f6-40d9-9dd5-457186720a1f","Type":"ContainerStarted","Data":"1ed211198ea1e9eeb3de32979d6d9252e9503daf87731462c5a83c822ed6e73d"} Jun 10 13:05:42.965320 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.965285 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-b9krk"] Jun 10 13:05:42.968365 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.968345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:42.971682 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.971664 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 13:05:42.971762 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.971666 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tpk8m\"" Jun 10 13:05:42.972324 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.972313 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 13:05:42.980249 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:42.980227 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-b9krk"] Jun 10 13:05:43.021415 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.021366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddv8\" (UniqueName: \"kubernetes.io/projected/dc64c3aa-cb95-40ea-99e4-edf5ae9b8771-kube-api-access-gddv8\") pod \"cert-manager-cainjector-5d99449ffd-b9krk\" (UID: \"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.021532 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.021451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc64c3aa-cb95-40ea-99e4-edf5ae9b8771-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-b9krk\" (UID: \"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.122927 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.122858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gddv8\" (UniqueName: \"kubernetes.io/projected/dc64c3aa-cb95-40ea-99e4-edf5ae9b8771-kube-api-access-gddv8\") pod \"cert-manager-cainjector-5d99449ffd-b9krk\" (UID: \"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.122927 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.122898 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc64c3aa-cb95-40ea-99e4-edf5ae9b8771-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-b9krk\" (UID: \"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.131460 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.131434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc64c3aa-cb95-40ea-99e4-edf5ae9b8771-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-b9krk\" (UID: \"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.131712 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.131688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddv8\" (UniqueName: \"kubernetes.io/projected/dc64c3aa-cb95-40ea-99e4-edf5ae9b8771-kube-api-access-gddv8\") pod \"cert-manager-cainjector-5d99449ffd-b9krk\" (UID: \"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.292170 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.292140 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" Jun 10 13:05:43.425742 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.425712 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-b9krk"] Jun 10 13:05:43.428436 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:05:43.428408 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc64c3aa_cb95_40ea_99e4_edf5ae9b8771.slice/crio-01905f8e85d432e70e85bd043eec1b3116f9466ee91a731141506a70f8fbf7d2 WatchSource:0}: Error finding container 01905f8e85d432e70e85bd043eec1b3116f9466ee91a731141506a70f8fbf7d2: Status 404 returned error can't find the container with id 01905f8e85d432e70e85bd043eec1b3116f9466ee91a731141506a70f8fbf7d2 Jun 10 13:05:43.860724 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.860685 2561 generic.go:356] "Generic (PLEG): container finished" podID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerID="1ed211198ea1e9eeb3de32979d6d9252e9503daf87731462c5a83c822ed6e73d" exitCode=0 Jun 10 13:05:43.861171 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.860768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" event={"ID":"600ab9f4-76f6-40d9-9dd5-457186720a1f","Type":"ContainerDied","Data":"1ed211198ea1e9eeb3de32979d6d9252e9503daf87731462c5a83c822ed6e73d"} Jun 10 13:05:43.862060 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:43.862031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" event={"ID":"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771","Type":"ContainerStarted","Data":"01905f8e85d432e70e85bd043eec1b3116f9466ee91a731141506a70f8fbf7d2"} Jun 10 13:05:44.869328 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:44.869294 2561 generic.go:356] "Generic (PLEG): container finished" podID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerID="64babae407eb21eb12fd17e26a0210f988aa6e37fc0c0decd95deff62b46d6bb" exitCode=0 Jun 10 13:05:44.869777 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:44.869337 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" event={"ID":"600ab9f4-76f6-40d9-9dd5-457186720a1f","Type":"ContainerDied","Data":"64babae407eb21eb12fd17e26a0210f988aa6e37fc0c0decd95deff62b46d6bb"} Jun 10 13:05:46.002256 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.002232 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:46.051576 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.051545 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-util\") pod \"600ab9f4-76f6-40d9-9dd5-457186720a1f\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " Jun 10 13:05:46.051694 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.051612 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfxgz\" (UniqueName: \"kubernetes.io/projected/600ab9f4-76f6-40d9-9dd5-457186720a1f-kube-api-access-qfxgz\") pod \"600ab9f4-76f6-40d9-9dd5-457186720a1f\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " Jun 10 13:05:46.051694 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.051650 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-bundle\") pod \"600ab9f4-76f6-40d9-9dd5-457186720a1f\" (UID: \"600ab9f4-76f6-40d9-9dd5-457186720a1f\") " Jun 10 13:05:46.052050 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.052023 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-bundle" (OuterVolumeSpecName: "bundle") pod "600ab9f4-76f6-40d9-9dd5-457186720a1f" (UID: "600ab9f4-76f6-40d9-9dd5-457186720a1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:05:46.054001 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.053973 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/600ab9f4-76f6-40d9-9dd5-457186720a1f-kube-api-access-qfxgz" (OuterVolumeSpecName: "kube-api-access-qfxgz") pod "600ab9f4-76f6-40d9-9dd5-457186720a1f" (UID: "600ab9f4-76f6-40d9-9dd5-457186720a1f"). InnerVolumeSpecName "kube-api-access-qfxgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:46.056209 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.056176 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-util" (OuterVolumeSpecName: "util") pod "600ab9f4-76f6-40d9-9dd5-457186720a1f" (UID: "600ab9f4-76f6-40d9-9dd5-457186720a1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:05:46.153159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.153089 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfxgz\" (UniqueName: \"kubernetes.io/projected/600ab9f4-76f6-40d9-9dd5-457186720a1f-kube-api-access-qfxgz\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:05:46.153159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.153115 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:05:46.153159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.153124 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/600ab9f4-76f6-40d9-9dd5-457186720a1f-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:05:46.878965 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.878878 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" Jun 10 13:05:46.878965 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.878891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff7fhs" event={"ID":"600ab9f4-76f6-40d9-9dd5-457186720a1f","Type":"ContainerDied","Data":"acb62c6799886bc1b6eda1bc28c69abc18551c53177a3c31c83641310ee83f37"} Jun 10 13:05:46.878965 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.878945 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acb62c6799886bc1b6eda1bc28c69abc18551c53177a3c31c83641310ee83f37" Jun 10 13:05:46.880550 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.880478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" event={"ID":"dc64c3aa-cb95-40ea-99e4-edf5ae9b8771","Type":"ContainerStarted","Data":"1f56442fc287ce160d6c414edb817782f9f586b31ac6f85c75b791d6dedc284c"} Jun 10 13:05:46.898185 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:46.898141 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-b9krk" podStartSLOduration=2.477854272 podStartE2EDuration="4.898127684s" totalImagesPullingTime="2.420273412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:46.8967277 +0000 UTC m=+296.838740911" watchObservedRunningTime="2026-06-10 13:05:46.898127684 +0000 UTC m=+296.840140894" Jun 10 13:05:50.487416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:50.487381 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:05:50.489902 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:50.489866 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:05:50.494724 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:50.494704 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:05:50.497254 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:50.497233 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:05:50.499432 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:50.499415 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 13:05:58.683312 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683281 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fnn9x"] Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683550 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="pull" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683560 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="pull" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683574 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="extract" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683580 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="extract" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683593 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="util" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683598 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="util" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.683639 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="600ab9f4-76f6-40d9-9dd5-457186720a1f" containerName="extract" Jun 10 13:05:58.736745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.736678 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fnn9x"] Jun 10 13:05:58.737159 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.736758 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:58.739711 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.739687 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nghpr\"" Jun 10 13:05:58.842458 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.842428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8a0a341-24cf-41d3-8a64-a68991dc71fa-bound-sa-token\") pod \"cert-manager-59c77684cc-fnn9x\" (UID: \"b8a0a341-24cf-41d3-8a64-a68991dc71fa\") " pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:58.842568 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.842490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6mtb\" (UniqueName: \"kubernetes.io/projected/b8a0a341-24cf-41d3-8a64-a68991dc71fa-kube-api-access-j6mtb\") pod \"cert-manager-59c77684cc-fnn9x\" (UID: \"b8a0a341-24cf-41d3-8a64-a68991dc71fa\") " pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:58.943569 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.943498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8a0a341-24cf-41d3-8a64-a68991dc71fa-bound-sa-token\") pod \"cert-manager-59c77684cc-fnn9x\" (UID: \"b8a0a341-24cf-41d3-8a64-a68991dc71fa\") " pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:58.943569 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.943552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6mtb\" (UniqueName: \"kubernetes.io/projected/b8a0a341-24cf-41d3-8a64-a68991dc71fa-kube-api-access-j6mtb\") pod \"cert-manager-59c77684cc-fnn9x\" (UID: \"b8a0a341-24cf-41d3-8a64-a68991dc71fa\") " pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:58.953732 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.953700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8a0a341-24cf-41d3-8a64-a68991dc71fa-bound-sa-token\") pod \"cert-manager-59c77684cc-fnn9x\" (UID: \"b8a0a341-24cf-41d3-8a64-a68991dc71fa\") " pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:58.953856 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:58.953734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6mtb\" (UniqueName: \"kubernetes.io/projected/b8a0a341-24cf-41d3-8a64-a68991dc71fa-kube-api-access-j6mtb\") pod \"cert-manager-59c77684cc-fnn9x\" (UID: \"b8a0a341-24cf-41d3-8a64-a68991dc71fa\") " pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:59.045775 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:59.045748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fnn9x" Jun 10 13:05:59.204648 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:59.204570 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fnn9x"] Jun 10 13:05:59.208450 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:05:59.208419 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8a0a341_24cf_41d3_8a64_a68991dc71fa.slice/crio-71a68ba7e7b41d39c6e7c992ad24b1e254ca5396217a12b6695f0669df625dfb WatchSource:0}: Error finding container 71a68ba7e7b41d39c6e7c992ad24b1e254ca5396217a12b6695f0669df625dfb: Status 404 returned error can't find the container with id 71a68ba7e7b41d39c6e7c992ad24b1e254ca5396217a12b6695f0669df625dfb Jun 10 13:05:59.935901 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:59.935865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fnn9x" event={"ID":"b8a0a341-24cf-41d3-8a64-a68991dc71fa","Type":"ContainerStarted","Data":"8d9d4bf90a4861be940ffc6582cfddaa67021c78d1dbdedfaf3a6cc3f254d719"} Jun 10 13:05:59.936283 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:59.935909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fnn9x" event={"ID":"b8a0a341-24cf-41d3-8a64-a68991dc71fa","Type":"ContainerStarted","Data":"71a68ba7e7b41d39c6e7c992ad24b1e254ca5396217a12b6695f0669df625dfb"} Jun 10 13:05:59.955982 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:05:59.955936 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fnn9x" podStartSLOduration=1.955921684 podStartE2EDuration="1.955921684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:59.955375928 +0000 UTC m=+309.897389139" watchObservedRunningTime="2026-06-10 13:05:59.955921684 +0000 UTC m=+309.897934893" Jun 10 13:06:05.083268 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.083235 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5"] Jun 10 13:06:05.085577 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.085555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.088231 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.088210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z9vr\"" Jun 10 13:06:05.088343 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.088239 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:06:05.089271 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.089253 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:06:05.095962 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.095944 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5"] Jun 10 13:06:05.190134 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.190106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.190257 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.190155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9s8\" (UniqueName: \"kubernetes.io/projected/504574fe-7b3b-4c94-b12b-509361b14e14-kube-api-access-hs9s8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.190257 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.190207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.291096 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.291065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.291257 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.291119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.291257 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.291158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9s8\" (UniqueName: \"kubernetes.io/projected/504574fe-7b3b-4c94-b12b-509361b14e14-kube-api-access-hs9s8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.291498 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.291474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.291558 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.291530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.299457 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.299437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9s8\" (UniqueName: \"kubernetes.io/projected/504574fe-7b3b-4c94-b12b-509361b14e14-kube-api-access-hs9s8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.395653 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.395586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:05.525667 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.525642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5"] Jun 10 13:06:05.527634 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:05.527602 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504574fe_7b3b_4c94_b12b_509361b14e14.slice/crio-1cfa54cc0b98408bcd94dae92836b1caf8c8bc88582112199284e6de836587ea WatchSource:0}: Error finding container 1cfa54cc0b98408bcd94dae92836b1caf8c8bc88582112199284e6de836587ea: Status 404 returned error can't find the container with id 1cfa54cc0b98408bcd94dae92836b1caf8c8bc88582112199284e6de836587ea Jun 10 13:06:05.961891 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.961863 2561 generic.go:356] "Generic (PLEG): container finished" podID="504574fe-7b3b-4c94-b12b-509361b14e14" containerID="37e4d5330399758e92ebcedac29b5cea90c4d92b0448719525bf91049fcc2da9" exitCode=0 Jun 10 13:06:05.962048 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.961969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" event={"ID":"504574fe-7b3b-4c94-b12b-509361b14e14","Type":"ContainerDied","Data":"37e4d5330399758e92ebcedac29b5cea90c4d92b0448719525bf91049fcc2da9"} Jun 10 13:06:05.962048 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.962004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" event={"ID":"504574fe-7b3b-4c94-b12b-509361b14e14","Type":"ContainerStarted","Data":"1cfa54cc0b98408bcd94dae92836b1caf8c8bc88582112199284e6de836587ea"} Jun 10 13:06:05.962451 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:05.962434 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:06:06.967681 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:06.967592 2561 generic.go:356] "Generic (PLEG): container finished" podID="504574fe-7b3b-4c94-b12b-509361b14e14" containerID="ab5c61c759991955f1b8e9fc61fbb2a8614f6ae0cb6af0a56e46c9b4ec082e8c" exitCode=0 Jun 10 13:06:06.967681 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:06.967672 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" event={"ID":"504574fe-7b3b-4c94-b12b-509361b14e14","Type":"ContainerDied","Data":"ab5c61c759991955f1b8e9fc61fbb2a8614f6ae0cb6af0a56e46c9b4ec082e8c"} Jun 10 13:06:07.973575 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:07.973534 2561 generic.go:356] "Generic (PLEG): container finished" podID="504574fe-7b3b-4c94-b12b-509361b14e14" containerID="ef5d5c996d77ad509d474b642c5d6a6b987c5642b43c4a92207ddc5d664be267" exitCode=0 Jun 10 13:06:07.973973 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:07.973614 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" event={"ID":"504574fe-7b3b-4c94-b12b-509361b14e14","Type":"ContainerDied","Data":"ef5d5c996d77ad509d474b642c5d6a6b987c5642b43c4a92207ddc5d664be267"} Jun 10 13:06:09.102807 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.102786 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:09.224146 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.224119 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs9s8\" (UniqueName: \"kubernetes.io/projected/504574fe-7b3b-4c94-b12b-509361b14e14-kube-api-access-hs9s8\") pod \"504574fe-7b3b-4c94-b12b-509361b14e14\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " Jun 10 13:06:09.224301 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.224160 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-util\") pod \"504574fe-7b3b-4c94-b12b-509361b14e14\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " Jun 10 13:06:09.224301 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.224192 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-bundle\") pod \"504574fe-7b3b-4c94-b12b-509361b14e14\" (UID: \"504574fe-7b3b-4c94-b12b-509361b14e14\") " Jun 10 13:06:09.224883 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.224857 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-bundle" (OuterVolumeSpecName: "bundle") pod "504574fe-7b3b-4c94-b12b-509361b14e14" (UID: "504574fe-7b3b-4c94-b12b-509361b14e14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:06:09.226275 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.226245 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504574fe-7b3b-4c94-b12b-509361b14e14-kube-api-access-hs9s8" (OuterVolumeSpecName: "kube-api-access-hs9s8") pod "504574fe-7b3b-4c94-b12b-509361b14e14" (UID: "504574fe-7b3b-4c94-b12b-509361b14e14"). InnerVolumeSpecName "kube-api-access-hs9s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:06:09.232318 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.232254 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-util" (OuterVolumeSpecName: "util") pod "504574fe-7b3b-4c94-b12b-509361b14e14" (UID: "504574fe-7b3b-4c94-b12b-509361b14e14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:06:09.325102 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.325066 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs9s8\" (UniqueName: \"kubernetes.io/projected/504574fe-7b3b-4c94-b12b-509361b14e14-kube-api-access-hs9s8\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:06:09.325102 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.325099 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:06:09.325102 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.325109 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/504574fe-7b3b-4c94-b12b-509361b14e14-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:06:09.983636 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.983605 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" Jun 10 13:06:09.983800 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.983606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6r6k5" event={"ID":"504574fe-7b3b-4c94-b12b-509361b14e14","Type":"ContainerDied","Data":"1cfa54cc0b98408bcd94dae92836b1caf8c8bc88582112199284e6de836587ea"} Jun 10 13:06:09.983800 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:09.983743 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cfa54cc0b98408bcd94dae92836b1caf8c8bc88582112199284e6de836587ea" Jun 10 13:06:15.958766 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.958729 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt"] Jun 10 13:06:15.959135 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959079 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="util" Jun 10 13:06:15.959135 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959092 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="util" Jun 10 13:06:15.959135 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959109 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="extract" Jun 10 13:06:15.959135 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959114 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="extract" Jun 10 13:06:15.959135 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959122 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="pull" Jun 10 13:06:15.959135 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959133 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="pull" Jun 10 13:06:15.959316 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.959190 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="504574fe-7b3b-4c94-b12b-509361b14e14" containerName="extract" Jun 10 13:06:15.962520 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.962498 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:15.965085 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.965053 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 13:06:15.965183 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.965136 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 13:06:15.966103 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.966087 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vjxjr\"" Jun 10 13:06:15.966204 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.966118 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 13:06:15.969941 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.969921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 13:06:15.985081 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:15.985060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt"] Jun 10 13:06:16.078389 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.078358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrdh6\" (UniqueName: \"kubernetes.io/projected/ade955df-24a1-4388-be7e-2924a9251afa-kube-api-access-mrdh6\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.078389 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.078392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ade955df-24a1-4388-be7e-2924a9251afa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.078567 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.078413 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ade955df-24a1-4388-be7e-2924a9251afa-manifests\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.078567 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.078467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ade955df-24a1-4388-be7e-2924a9251afa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.078567 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.078553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade955df-24a1-4388-be7e-2924a9251afa-tmp\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.179097 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.179073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrdh6\" (UniqueName: \"kubernetes.io/projected/ade955df-24a1-4388-be7e-2924a9251afa-kube-api-access-mrdh6\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.179190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.179102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ade955df-24a1-4388-be7e-2924a9251afa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.179190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.179121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ade955df-24a1-4388-be7e-2924a9251afa-manifests\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.179190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.179139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ade955df-24a1-4388-be7e-2924a9251afa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.179190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.179165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade955df-24a1-4388-be7e-2924a9251afa-tmp\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.179537 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.179516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ade955df-24a1-4388-be7e-2924a9251afa-manifests\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.181438 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.181416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade955df-24a1-4388-be7e-2924a9251afa-tmp\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.181722 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.181703 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ade955df-24a1-4388-be7e-2924a9251afa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.181824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.181777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ade955df-24a1-4388-be7e-2924a9251afa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.187416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.187389 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrdh6\" (UniqueName: \"kubernetes.io/projected/ade955df-24a1-4388-be7e-2924a9251afa-kube-api-access-mrdh6\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt\" (UID: \"ade955df-24a1-4388-be7e-2924a9251afa\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.274092 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.274067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:16.424432 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:16.424411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt"] Jun 10 13:06:16.427062 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:16.427023 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade955df_24a1_4388_be7e_2924a9251afa.slice/crio-f70e4174e358e535ca30640e66080293897a3cdfb8ff33165599b6ec1d425fc2 WatchSource:0}: Error finding container f70e4174e358e535ca30640e66080293897a3cdfb8ff33165599b6ec1d425fc2: Status 404 returned error can't find the container with id f70e4174e358e535ca30640e66080293897a3cdfb8ff33165599b6ec1d425fc2 Jun 10 13:06:17.019974 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:17.019902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" event={"ID":"ade955df-24a1-4388-be7e-2924a9251afa","Type":"ContainerStarted","Data":"f70e4174e358e535ca30640e66080293897a3cdfb8ff33165599b6ec1d425fc2"} Jun 10 13:06:20.037193 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:20.037148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" event={"ID":"ade955df-24a1-4388-be7e-2924a9251afa","Type":"ContainerStarted","Data":"ab2ebf7de3d5be738f527d0056b284f1861e5cc5fa3c9ffa8b2f8cd71c5beda7"} Jun 10 13:06:21.043288 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:21.043253 2561 generic.go:356] "Generic (PLEG): container finished" podID="ade955df-24a1-4388-be7e-2924a9251afa" containerID="ab2ebf7de3d5be738f527d0056b284f1861e5cc5fa3c9ffa8b2f8cd71c5beda7" exitCode=0 Jun 10 13:06:21.043651 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:21.043303 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" event={"ID":"ade955df-24a1-4388-be7e-2924a9251afa","Type":"ContainerDied","Data":"ab2ebf7de3d5be738f527d0056b284f1861e5cc5fa3c9ffa8b2f8cd71c5beda7"} Jun 10 13:06:22.049790 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:22.049751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" event={"ID":"ade955df-24a1-4388-be7e-2924a9251afa","Type":"ContainerStarted","Data":"713ed8fb486f9f37113e2c87b004c3f3a8eae11257d9965bda3dcba3aae03b16"} Jun 10 13:06:22.050164 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:22.049857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:22.078766 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:22.078722 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" podStartSLOduration=2.601446766 podStartE2EDuration="7.078710425s" totalImagesPullingTime="3.555047597s" totalInitContainerRuntime="922.216062ms" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:22.078175529 +0000 UTC m=+332.020188740" watchObservedRunningTime="2026-06-10 13:06:22.078710425 +0000 UTC m=+332.020723634" Jun 10 13:06:33.058543 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:33.058513 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt" Jun 10 13:06:37.955724 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:37.955689 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rqhm9"] Jun 10 13:06:37.959540 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:37.959523 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:37.964215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:37.964191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 13:06:37.964324 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:37.964219 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nd2hk\"" Jun 10 13:06:37.996881 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:37.996860 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rqhm9"] Jun 10 13:06:38.055161 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.055131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fcc392a-1239-416a-84ad-cb8bd9d4e843-cert\") pod \"odh-model-controller-6dc94f689f-rqhm9\" (UID: \"4fcc392a-1239-416a-84ad-cb8bd9d4e843\") " pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.055284 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.055201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhsmn\" (UniqueName: \"kubernetes.io/projected/4fcc392a-1239-416a-84ad-cb8bd9d4e843-kube-api-access-rhsmn\") pod \"odh-model-controller-6dc94f689f-rqhm9\" (UID: \"4fcc392a-1239-416a-84ad-cb8bd9d4e843\") " pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.156255 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.156225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fcc392a-1239-416a-84ad-cb8bd9d4e843-cert\") pod \"odh-model-controller-6dc94f689f-rqhm9\" (UID: \"4fcc392a-1239-416a-84ad-cb8bd9d4e843\") " pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.156392 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.156306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhsmn\" (UniqueName: \"kubernetes.io/projected/4fcc392a-1239-416a-84ad-cb8bd9d4e843-kube-api-access-rhsmn\") pod \"odh-model-controller-6dc94f689f-rqhm9\" (UID: \"4fcc392a-1239-416a-84ad-cb8bd9d4e843\") " pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.158812 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.158787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fcc392a-1239-416a-84ad-cb8bd9d4e843-cert\") pod \"odh-model-controller-6dc94f689f-rqhm9\" (UID: \"4fcc392a-1239-416a-84ad-cb8bd9d4e843\") " pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.188725 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.188664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhsmn\" (UniqueName: \"kubernetes.io/projected/4fcc392a-1239-416a-84ad-cb8bd9d4e843-kube-api-access-rhsmn\") pod \"odh-model-controller-6dc94f689f-rqhm9\" (UID: \"4fcc392a-1239-416a-84ad-cb8bd9d4e843\") " pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.269117 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.269090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:38.425205 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:38.425173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rqhm9"] Jun 10 13:06:38.428896 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:38.428864 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcc392a_1239_416a_84ad_cb8bd9d4e843.slice/crio-6ad3a42bf945ecc35bab53af2469c2bd5a7cc1da089eb6061c9339d2ff7b65af WatchSource:0}: Error finding container 6ad3a42bf945ecc35bab53af2469c2bd5a7cc1da089eb6061c9339d2ff7b65af: Status 404 returned error can't find the container with id 6ad3a42bf945ecc35bab53af2469c2bd5a7cc1da089eb6061c9339d2ff7b65af Jun 10 13:06:39.130255 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.130175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" event={"ID":"4fcc392a-1239-416a-84ad-cb8bd9d4e843","Type":"ContainerStarted","Data":"6ad3a42bf945ecc35bab53af2469c2bd5a7cc1da089eb6061c9339d2ff7b65af"} Jun 10 13:06:39.633584 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.633543 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b44b2"] Jun 10 13:06:39.636917 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.636901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.640229 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.640201 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 13:06:39.678775 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.678739 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b44b2"] Jun 10 13:06:39.772283 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.772253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwml\" (UniqueName: \"kubernetes.io/projected/76ebe1de-7523-4f25-859d-91ccbb1bd98b-kube-api-access-2nwml\") pod \"model-serving-api-5dd488fc48-b44b2\" (UID: \"76ebe1de-7523-4f25-859d-91ccbb1bd98b\") " pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.772519 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.772326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76ebe1de-7523-4f25-859d-91ccbb1bd98b-tls-certs\") pod \"model-serving-api-5dd488fc48-b44b2\" (UID: \"76ebe1de-7523-4f25-859d-91ccbb1bd98b\") " pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.873230 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.873194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwml\" (UniqueName: \"kubernetes.io/projected/76ebe1de-7523-4f25-859d-91ccbb1bd98b-kube-api-access-2nwml\") pod \"model-serving-api-5dd488fc48-b44b2\" (UID: \"76ebe1de-7523-4f25-859d-91ccbb1bd98b\") " pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.873414 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.873266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76ebe1de-7523-4f25-859d-91ccbb1bd98b-tls-certs\") pod \"model-serving-api-5dd488fc48-b44b2\" (UID: \"76ebe1de-7523-4f25-859d-91ccbb1bd98b\") " pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.876184 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.876155 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76ebe1de-7523-4f25-859d-91ccbb1bd98b-tls-certs\") pod \"model-serving-api-5dd488fc48-b44b2\" (UID: \"76ebe1de-7523-4f25-859d-91ccbb1bd98b\") " pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.893356 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.893284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwml\" (UniqueName: \"kubernetes.io/projected/76ebe1de-7523-4f25-859d-91ccbb1bd98b-kube-api-access-2nwml\") pod \"model-serving-api-5dd488fc48-b44b2\" (UID: \"76ebe1de-7523-4f25-859d-91ccbb1bd98b\") " pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:39.950260 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:39.950201 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:40.565623 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:40.565593 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ebe1de_7523_4f25_859d_91ccbb1bd98b.slice/crio-18c51c890b87b7db3370ccfda83714eac9dae6f337e11389a32e16ebfa257aa3 WatchSource:0}: Error finding container 18c51c890b87b7db3370ccfda83714eac9dae6f337e11389a32e16ebfa257aa3: Status 404 returned error can't find the container with id 18c51c890b87b7db3370ccfda83714eac9dae6f337e11389a32e16ebfa257aa3 Jun 10 13:06:40.577929 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:40.577900 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-b44b2"] Jun 10 13:06:41.143476 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:41.143432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" event={"ID":"76ebe1de-7523-4f25-859d-91ccbb1bd98b","Type":"ContainerStarted","Data":"18c51c890b87b7db3370ccfda83714eac9dae6f337e11389a32e16ebfa257aa3"} Jun 10 13:06:42.149888 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:42.149848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" event={"ID":"4fcc392a-1239-416a-84ad-cb8bd9d4e843","Type":"ContainerStarted","Data":"ad5084dd6a86cc226fa866307b2726ce919776b9c9ad0010571b285a94e3f923"} Jun 10 13:06:42.150359 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:42.149985 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:42.172563 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:42.172506 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" podStartSLOduration=1.930521522 podStartE2EDuration="5.172487821s" totalImagesPullingTime="3.241966299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:42.169514748 +0000 UTC m=+352.111527963" watchObservedRunningTime="2026-06-10 13:06:42.172487821 +0000 UTC m=+352.114501031" Jun 10 13:06:43.740215 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.740183 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw"] Jun 10 13:06:43.743769 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.743752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.746261 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.746236 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z9vr\"" Jun 10 13:06:43.746377 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.746236 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:06:43.746377 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.746295 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:06:43.755172 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.755152 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw"] Jun 10 13:06:43.779570 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.779545 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-768f854844-p7ntm"] Jun 10 13:06:43.782699 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.782679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.785022 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.785000 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 13:06:43.785137 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.785096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9qblb\"" Jun 10 13:06:43.785222 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.785204 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 13:06:43.794211 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.794191 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-768f854844-p7ntm"] Jun 10 13:06:43.810014 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.809990 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-tmp\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.810097 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.810021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvndf\" (UniqueName: \"kubernetes.io/projected/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-kube-api-access-cvndf\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.810140 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.810091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.810140 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.810121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75d87\" (UniqueName: \"kubernetes.io/projected/208b0ddb-c461-4464-a6a4-f7451d21e2da-kube-api-access-75d87\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.810221 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.810142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-tls-certs\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.810221 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.810201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.910676 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.910648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.910824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.910687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75d87\" (UniqueName: \"kubernetes.io/projected/208b0ddb-c461-4464-a6a4-f7451d21e2da-kube-api-access-75d87\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.910824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.910706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-tls-certs\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.910824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.910760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.910824 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.910799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-tmp\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.911081 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.910918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvndf\" (UniqueName: \"kubernetes.io/projected/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-kube-api-access-cvndf\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.911141 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.911123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.911342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.911321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.913177 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.913156 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-tmp\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.913305 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.913289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-tls-certs\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:43.918999 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.918972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75d87\" (UniqueName: \"kubernetes.io/projected/208b0ddb-c461-4464-a6a4-f7451d21e2da-kube-api-access-75d87\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:43.919088 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:43.919071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvndf\" (UniqueName: \"kubernetes.io/projected/e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc-kube-api-access-cvndf\") pod \"kube-auth-proxy-768f854844-p7ntm\" (UID: \"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc\") " pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:44.052720 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.052648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:44.092069 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.092036 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" Jun 10 13:06:44.167435 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.167397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" event={"ID":"76ebe1de-7523-4f25-859d-91ccbb1bd98b","Type":"ContainerStarted","Data":"9863768ecfca75a30e16467c0e94d6055bbd571f8dc6169132e68b5c1dc9e068"} Jun 10 13:06:44.168452 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.168424 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:44.193612 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.193558 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" podStartSLOduration=2.5917141360000002 podStartE2EDuration="5.193540368s" totalImagesPullingTime="2.601826232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:44.190212872 +0000 UTC m=+354.132226082" watchObservedRunningTime="2026-06-10 13:06:44.193540368 +0000 UTC m=+354.135553580" Jun 10 13:06:44.210020 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.209984 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw"] Jun 10 13:06:44.210914 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:44.210890 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208b0ddb_c461_4464_a6a4_f7451d21e2da.slice/crio-3cfcd2581f96cccbc53d3b6376516b9382fd310f11bc8da2c5effc72c69f8d5e WatchSource:0}: Error finding container 3cfcd2581f96cccbc53d3b6376516b9382fd310f11bc8da2c5effc72c69f8d5e: Status 404 returned error can't find the container with id 3cfcd2581f96cccbc53d3b6376516b9382fd310f11bc8da2c5effc72c69f8d5e Jun 10 13:06:44.247330 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:44.247304 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-768f854844-p7ntm"] Jun 10 13:06:44.251009 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:44.249734 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ff0b9d_f3a5_4890_9ac7_c5efc1142dcc.slice/crio-09ff494c169194e24c2e11ec57191a992c07133a18c89f9d65bbde827711695f WatchSource:0}: Error finding container 09ff494c169194e24c2e11ec57191a992c07133a18c89f9d65bbde827711695f: Status 404 returned error can't find the container with id 09ff494c169194e24c2e11ec57191a992c07133a18c89f9d65bbde827711695f Jun 10 13:06:45.175584 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:45.175505 2561 generic.go:356] "Generic (PLEG): container finished" podID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerID="6977147c533229df9d82eb2f7774b708d794ef7dcc2cdb64b4e93b80c9f48815" exitCode=0 Jun 10 13:06:45.175584 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:45.175564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" event={"ID":"208b0ddb-c461-4464-a6a4-f7451d21e2da","Type":"ContainerDied","Data":"6977147c533229df9d82eb2f7774b708d794ef7dcc2cdb64b4e93b80c9f48815"} Jun 10 13:06:45.176161 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:45.175618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" event={"ID":"208b0ddb-c461-4464-a6a4-f7451d21e2da","Type":"ContainerStarted","Data":"3cfcd2581f96cccbc53d3b6376516b9382fd310f11bc8da2c5effc72c69f8d5e"} Jun 10 13:06:45.177821 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:45.177790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" event={"ID":"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc","Type":"ContainerStarted","Data":"09ff494c169194e24c2e11ec57191a992c07133a18c89f9d65bbde827711695f"} Jun 10 13:06:47.190197 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:47.190090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" event={"ID":"e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc","Type":"ContainerStarted","Data":"719ebe34cd187564b56c34da837d3188fd82def417ff268b60f3d16b7586eee6"} Jun 10 13:06:47.192059 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:47.192028 2561 generic.go:356] "Generic (PLEG): container finished" podID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerID="2f7e2a34d49b04fa66928da6034fb361692001b04caf8c0e9ee3b68107356cc6" exitCode=0 Jun 10 13:06:47.192176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:47.192072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" event={"ID":"208b0ddb-c461-4464-a6a4-f7451d21e2da","Type":"ContainerDied","Data":"2f7e2a34d49b04fa66928da6034fb361692001b04caf8c0e9ee3b68107356cc6"} Jun 10 13:06:47.283439 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:47.283370 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-768f854844-p7ntm" podStartSLOduration=1.730254692 podStartE2EDuration="4.283348014s" totalImagesPullingTime="2.553093322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:47.281612238 +0000 UTC m=+357.223625448" watchObservedRunningTime="2026-06-10 13:06:47.283348014 +0000 UTC m=+357.225361227" Jun 10 13:06:48.198684 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.198653 2561 generic.go:356] "Generic (PLEG): container finished" podID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerID="a217b616a939109b262fb2cb184b23df39ef91454e71e22aed1c5e2326b8de0f" exitCode=0 Jun 10 13:06:48.199190 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.198741 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" event={"ID":"208b0ddb-c461-4464-a6a4-f7451d21e2da","Type":"ContainerDied","Data":"a217b616a939109b262fb2cb184b23df39ef91454e71e22aed1c5e2326b8de0f"} Jun 10 13:06:48.636355 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.636322 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bs5t2"] Jun 10 13:06:48.639463 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.639447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:48.646150 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.646125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-cert\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:48.646275 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.646165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrn6\" (UniqueName: \"kubernetes.io/projected/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-kube-api-access-qtrn6\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:48.651001 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.650983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 13:06:48.651317 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.651303 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-k924c\"" Jun 10 13:06:48.663941 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.663910 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bs5t2"] Jun 10 13:06:48.672757 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.672735 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf"] Jun 10 13:06:48.675920 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.675905 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.679778 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.679752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xzrhm\"" Jun 10 13:06:48.683671 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.683652 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 13:06:48.712939 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.712915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf"] Jun 10 13:06:48.746900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.746872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d3adb7-8d65-4a1c-8570-50c5f82b171e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lrmnf\" (UID: \"97d3adb7-8d65-4a1c-8570-50c5f82b171e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.747038 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.746914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-cert\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:48.747038 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.746942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrn6\" (UniqueName: \"kubernetes.io/projected/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-kube-api-access-qtrn6\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:48.747038 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.746999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjj5m\" (UniqueName: \"kubernetes.io/projected/97d3adb7-8d65-4a1c-8570-50c5f82b171e-kube-api-access-wjj5m\") pod \"llmisvc-controller-manager-864bfd7bc9-lrmnf\" (UID: \"97d3adb7-8d65-4a1c-8570-50c5f82b171e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.747155 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:06:48.747049 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 10 13:06:48.747155 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:06:48.747119 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-cert podName:7d65e7bc-78d0-4b52-ac18-c0dd29040d8f nodeName:}" failed. No retries permitted until 2026-06-10 13:06:49.247098653 +0000 UTC m=+359.189111846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-cert") pod "kserve-controller-manager-69fc866d76-bs5t2" (UID: "7d65e7bc-78d0-4b52-ac18-c0dd29040d8f") : secret "kserve-webhook-server-cert" not found Jun 10 13:06:48.771974 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.771945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrn6\" (UniqueName: \"kubernetes.io/projected/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-kube-api-access-qtrn6\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:48.848120 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.848086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d3adb7-8d65-4a1c-8570-50c5f82b171e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lrmnf\" (UID: \"97d3adb7-8d65-4a1c-8570-50c5f82b171e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.848324 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.848153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjj5m\" (UniqueName: \"kubernetes.io/projected/97d3adb7-8d65-4a1c-8570-50c5f82b171e-kube-api-access-wjj5m\") pod \"llmisvc-controller-manager-864bfd7bc9-lrmnf\" (UID: \"97d3adb7-8d65-4a1c-8570-50c5f82b171e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.850746 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.850720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d3adb7-8d65-4a1c-8570-50c5f82b171e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lrmnf\" (UID: \"97d3adb7-8d65-4a1c-8570-50c5f82b171e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.860480 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.860436 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjj5m\" (UniqueName: \"kubernetes.io/projected/97d3adb7-8d65-4a1c-8570-50c5f82b171e-kube-api-access-wjj5m\") pod \"llmisvc-controller-manager-864bfd7bc9-lrmnf\" (UID: \"97d3adb7-8d65-4a1c-8570-50c5f82b171e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:48.988358 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:48.988324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:49.164748 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.164693 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf"] Jun 10 13:06:49.164878 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:49.164780 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97d3adb7_8d65_4a1c_8570_50c5f82b171e.slice/crio-fa9551fa901b48307420eb578ae23c976f517cb841afc5a2c9bcaafaa1a92052 WatchSource:0}: Error finding container fa9551fa901b48307420eb578ae23c976f517cb841afc5a2c9bcaafaa1a92052: Status 404 returned error can't find the container with id fa9551fa901b48307420eb578ae23c976f517cb841afc5a2c9bcaafaa1a92052 Jun 10 13:06:49.205455 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.205418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" event={"ID":"97d3adb7-8d65-4a1c-8570-50c5f82b171e","Type":"ContainerStarted","Data":"fa9551fa901b48307420eb578ae23c976f517cb841afc5a2c9bcaafaa1a92052"} Jun 10 13:06:49.251465 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.251382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-cert\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:49.253937 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.253912 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d65e7bc-78d0-4b52-ac18-c0dd29040d8f-cert\") pod \"kserve-controller-manager-69fc866d76-bs5t2\" (UID: \"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:49.325342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.325313 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:49.352446 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.352418 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75d87\" (UniqueName: \"kubernetes.io/projected/208b0ddb-c461-4464-a6a4-f7451d21e2da-kube-api-access-75d87\") pod \"208b0ddb-c461-4464-a6a4-f7451d21e2da\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " Jun 10 13:06:49.352575 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.352453 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-bundle\") pod \"208b0ddb-c461-4464-a6a4-f7451d21e2da\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " Jun 10 13:06:49.352575 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.352486 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-util\") pod \"208b0ddb-c461-4464-a6a4-f7451d21e2da\" (UID: \"208b0ddb-c461-4464-a6a4-f7451d21e2da\") " Jun 10 13:06:49.353281 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.353257 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-bundle" (OuterVolumeSpecName: "bundle") pod "208b0ddb-c461-4464-a6a4-f7451d21e2da" (UID: "208b0ddb-c461-4464-a6a4-f7451d21e2da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:06:49.354749 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.354726 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/208b0ddb-c461-4464-a6a4-f7451d21e2da-kube-api-access-75d87" (OuterVolumeSpecName: "kube-api-access-75d87") pod "208b0ddb-c461-4464-a6a4-f7451d21e2da" (UID: "208b0ddb-c461-4464-a6a4-f7451d21e2da"). InnerVolumeSpecName "kube-api-access-75d87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:06:49.358383 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.358347 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-util" (OuterVolumeSpecName: "util") pod "208b0ddb-c461-4464-a6a4-f7451d21e2da" (UID: "208b0ddb-c461-4464-a6a4-f7451d21e2da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:06:49.453219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.453187 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75d87\" (UniqueName: \"kubernetes.io/projected/208b0ddb-c461-4464-a6a4-f7451d21e2da-kube-api-access-75d87\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:06:49.453219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.453214 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:06:49.453219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.453224 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/208b0ddb-c461-4464-a6a4-f7451d21e2da-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:06:49.548810 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.548724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:49.685955 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:49.685933 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bs5t2"] Jun 10 13:06:49.687793 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:49.687766 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d65e7bc_78d0_4b52_ac18_c0dd29040d8f.slice/crio-a7784469974f9b2298939bc0662f9abc24237691868ae3cab6eff753e9734407 WatchSource:0}: Error finding container a7784469974f9b2298939bc0662f9abc24237691868ae3cab6eff753e9734407: Status 404 returned error can't find the container with id a7784469974f9b2298939bc0662f9abc24237691868ae3cab6eff753e9734407 Jun 10 13:06:50.213873 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:50.213844 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" Jun 10 13:06:50.213873 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:50.213863 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lv6rw" event={"ID":"208b0ddb-c461-4464-a6a4-f7451d21e2da","Type":"ContainerDied","Data":"3cfcd2581f96cccbc53d3b6376516b9382fd310f11bc8da2c5effc72c69f8d5e"} Jun 10 13:06:50.214259 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:50.213944 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cfcd2581f96cccbc53d3b6376516b9382fd310f11bc8da2c5effc72c69f8d5e" Jun 10 13:06:50.215176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:50.215150 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" event={"ID":"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f","Type":"ContainerStarted","Data":"a7784469974f9b2298939bc0662f9abc24237691868ae3cab6eff753e9734407"} Jun 10 13:06:53.156805 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:53.156774 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-rqhm9" Jun 10 13:06:54.239116 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:54.239078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" event={"ID":"97d3adb7-8d65-4a1c-8570-50c5f82b171e","Type":"ContainerStarted","Data":"d4372fd6b767414bfe619c13548f45a86f95f8322c49dbc4e3c5e0b4e97abf2a"} Jun 10 13:06:54.239537 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:54.239193 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:06:54.240772 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:54.240749 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" event={"ID":"7d65e7bc-78d0-4b52-ac18-c0dd29040d8f","Type":"ContainerStarted","Data":"4af2977f5b1d883878b18246d3ad50802da9c6f5a1a402e67f0b5d3e5e2fb086"} Jun 10 13:06:54.240883 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:54.240822 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:06:54.268760 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:54.268718 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" podStartSLOduration=1.839505184 podStartE2EDuration="6.268704378s" totalImagesPullingTime="4.429199194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:54.268378356 +0000 UTC m=+364.210391567" watchObservedRunningTime="2026-06-10 13:06:54.268704378 +0000 UTC m=+364.210717590" Jun 10 13:06:54.301845 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:54.301769 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" podStartSLOduration=2.40061 podStartE2EDuration="6.301750976s" totalImagesPullingTime="3.901140976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:54.299419222 +0000 UTC m=+364.241432431" watchObservedRunningTime="2026-06-10 13:06:54.301750976 +0000 UTC m=+364.243764189" Jun 10 13:06:56.187463 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:56.187431 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-b44b2" Jun 10 13:06:58.483091 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.483056 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz"] Jun 10 13:06:58.484335 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.484306 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="pull" Jun 10 13:06:58.484499 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.484486 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="pull" Jun 10 13:06:58.484603 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.484593 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="extract" Jun 10 13:06:58.484668 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.484660 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="extract" Jun 10 13:06:58.484764 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.484756 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="util" Jun 10 13:06:58.484825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.484817 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="util" Jun 10 13:06:58.485103 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.485089 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="208b0ddb-c461-4464-a6a4-f7451d21e2da" containerName="extract" Jun 10 13:06:58.489340 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.489317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.499364 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.499346 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:06:58.500119 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.500105 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z9vr\"" Jun 10 13:06:58.503656 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.503641 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:06:58.530704 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.530683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.530784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.530725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxsn7\" (UniqueName: \"kubernetes.io/projected/82326c88-4190-4965-84f9-d0d727651357-kube-api-access-wxsn7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.530784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.530753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.572379 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.572348 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz"] Jun 10 13:06:58.631851 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.631815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.631964 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.631885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.631964 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.631923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxsn7\" (UniqueName: \"kubernetes.io/projected/82326c88-4190-4965-84f9-d0d727651357-kube-api-access-wxsn7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.632205 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.632186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.632277 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.632241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.648429 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.648407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxsn7\" (UniqueName: \"kubernetes.io/projected/82326c88-4190-4965-84f9-d0d727651357-kube-api-access-wxsn7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.798181 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.798092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:06:58.983055 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:58.983020 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz"] Jun 10 13:06:58.986030 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:06:58.985994 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82326c88_4190_4965_84f9_d0d727651357.slice/crio-764ca69e0552ad480debaf5c7b960c47fa06356ddbfcc599e21cc7008313a919 WatchSource:0}: Error finding container 764ca69e0552ad480debaf5c7b960c47fa06356ddbfcc599e21cc7008313a919: Status 404 returned error can't find the container with id 764ca69e0552ad480debaf5c7b960c47fa06356ddbfcc599e21cc7008313a919 Jun 10 13:06:59.265703 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.265665 2561 generic.go:356] "Generic (PLEG): container finished" podID="82326c88-4190-4965-84f9-d0d727651357" containerID="ebe3795bf6fa7a27dba1aadcbc8298ec9ad93f93a1b4849afd74fc790e0a1078" exitCode=0 Jun 10 13:06:59.265919 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.265757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" event={"ID":"82326c88-4190-4965-84f9-d0d727651357","Type":"ContainerDied","Data":"ebe3795bf6fa7a27dba1aadcbc8298ec9ad93f93a1b4849afd74fc790e0a1078"} Jun 10 13:06:59.265919 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.265808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" event={"ID":"82326c88-4190-4965-84f9-d0d727651357","Type":"ContainerStarted","Data":"764ca69e0552ad480debaf5c7b960c47fa06356ddbfcc599e21cc7008313a919"} Jun 10 13:06:59.912057 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.911946 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp"] Jun 10 13:06:59.915708 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.915687 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:06:59.919105 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.919080 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 13:06:59.919219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.919114 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 13:06:59.919219 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.919151 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-twkrj\"" Jun 10 13:06:59.936597 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.936574 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp"] Jun 10 13:06:59.941637 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.941617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlc69\" (UniqueName: \"kubernetes.io/projected/8d98ea33-b51b-49ea-a643-640c8cd1e4d8-kube-api-access-nlc69\") pod \"servicemesh-operator3-57f65f65fb-2gpnp\" (UID: \"8d98ea33-b51b-49ea-a643-640c8cd1e4d8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:06:59.941737 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:06:59.941678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8d98ea33-b51b-49ea-a643-640c8cd1e4d8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2gpnp\" (UID: \"8d98ea33-b51b-49ea-a643-640c8cd1e4d8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:00.042141 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.042112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8d98ea33-b51b-49ea-a643-640c8cd1e4d8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2gpnp\" (UID: \"8d98ea33-b51b-49ea-a643-640c8cd1e4d8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:00.042231 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.042200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlc69\" (UniqueName: \"kubernetes.io/projected/8d98ea33-b51b-49ea-a643-640c8cd1e4d8-kube-api-access-nlc69\") pod \"servicemesh-operator3-57f65f65fb-2gpnp\" (UID: \"8d98ea33-b51b-49ea-a643-640c8cd1e4d8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:00.044721 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.044704 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8d98ea33-b51b-49ea-a643-640c8cd1e4d8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2gpnp\" (UID: \"8d98ea33-b51b-49ea-a643-640c8cd1e4d8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:00.053442 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.053417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlc69\" (UniqueName: \"kubernetes.io/projected/8d98ea33-b51b-49ea-a643-640c8cd1e4d8-kube-api-access-nlc69\") pod \"servicemesh-operator3-57f65f65fb-2gpnp\" (UID: \"8d98ea33-b51b-49ea-a643-640c8cd1e4d8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:00.225576 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.225546 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:00.274304 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.273461 2561 generic.go:356] "Generic (PLEG): container finished" podID="82326c88-4190-4965-84f9-d0d727651357" containerID="2d8fb0b76acdcf2284861631abc4a485643d9bf39334c00d3305c96707ce728b" exitCode=0 Jun 10 13:07:00.274304 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.273535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" event={"ID":"82326c88-4190-4965-84f9-d0d727651357","Type":"ContainerDied","Data":"2d8fb0b76acdcf2284861631abc4a485643d9bf39334c00d3305c96707ce728b"} Jun 10 13:07:00.378938 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.378903 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp"] Jun 10 13:07:00.383234 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:00.383202 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d98ea33_b51b_49ea_a643_640c8cd1e4d8.slice/crio-fe7b896fe1f057e4d1961ff066462545eb4273b5ad8217a717eb88de6a8e1e67 WatchSource:0}: Error finding container fe7b896fe1f057e4d1961ff066462545eb4273b5ad8217a717eb88de6a8e1e67: Status 404 returned error can't find the container with id fe7b896fe1f057e4d1961ff066462545eb4273b5ad8217a717eb88de6a8e1e67 Jun 10 13:07:00.473060 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.473028 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f476bfb57-txcc5"] Jun 10 13:07:00.477719 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.477655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.483252 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.483175 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 13:07:00.483437 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.483416 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mt96n\"" Jun 10 13:07:00.491344 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.491317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f476bfb57-txcc5"] Jun 10 13:07:00.547191 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.547158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/34a77f14-c380-4fb8-a6fb-286b2e02dc26-redirect-config\") pod \"dashboard-redirect-f476bfb57-txcc5\" (UID: \"34a77f14-c380-4fb8-a6fb-286b2e02dc26\") " pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.547356 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.547244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx2h5\" (UniqueName: \"kubernetes.io/projected/34a77f14-c380-4fb8-a6fb-286b2e02dc26-kube-api-access-vx2h5\") pod \"dashboard-redirect-f476bfb57-txcc5\" (UID: \"34a77f14-c380-4fb8-a6fb-286b2e02dc26\") " pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.648464 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.648435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/34a77f14-c380-4fb8-a6fb-286b2e02dc26-redirect-config\") pod \"dashboard-redirect-f476bfb57-txcc5\" (UID: \"34a77f14-c380-4fb8-a6fb-286b2e02dc26\") " pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.648653 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.648491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx2h5\" (UniqueName: \"kubernetes.io/projected/34a77f14-c380-4fb8-a6fb-286b2e02dc26-kube-api-access-vx2h5\") pod \"dashboard-redirect-f476bfb57-txcc5\" (UID: \"34a77f14-c380-4fb8-a6fb-286b2e02dc26\") " pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.649154 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.649133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/34a77f14-c380-4fb8-a6fb-286b2e02dc26-redirect-config\") pod \"dashboard-redirect-f476bfb57-txcc5\" (UID: \"34a77f14-c380-4fb8-a6fb-286b2e02dc26\") " pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.662736 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.662714 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx2h5\" (UniqueName: \"kubernetes.io/projected/34a77f14-c380-4fb8-a6fb-286b2e02dc26-kube-api-access-vx2h5\") pod \"dashboard-redirect-f476bfb57-txcc5\" (UID: \"34a77f14-c380-4fb8-a6fb-286b2e02dc26\") " pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.790179 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.790102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" Jun 10 13:07:00.934951 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:00.934921 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f476bfb57-txcc5"] Jun 10 13:07:00.936014 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:00.935982 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a77f14_c380_4fb8_a6fb_286b2e02dc26.slice/crio-ada960459eb8f28f344bc9f389efcbbbf3212389f6cf0d253fda8b6b09be1b54 WatchSource:0}: Error finding container ada960459eb8f28f344bc9f389efcbbbf3212389f6cf0d253fda8b6b09be1b54: Status 404 returned error can't find the container with id ada960459eb8f28f344bc9f389efcbbbf3212389f6cf0d253fda8b6b09be1b54 Jun 10 13:07:01.281607 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:01.281566 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" event={"ID":"34a77f14-c380-4fb8-a6fb-286b2e02dc26","Type":"ContainerStarted","Data":"ada960459eb8f28f344bc9f389efcbbbf3212389f6cf0d253fda8b6b09be1b54"} Jun 10 13:07:01.284192 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:01.284163 2561 generic.go:356] "Generic (PLEG): container finished" podID="82326c88-4190-4965-84f9-d0d727651357" containerID="5c27558060ff1f815bd8da7a58b4420dd699d01c4718df391d5dd0f98d19297b" exitCode=0 Jun 10 13:07:01.284318 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:01.284211 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" event={"ID":"82326c88-4190-4965-84f9-d0d727651357","Type":"ContainerDied","Data":"5c27558060ff1f815bd8da7a58b4420dd699d01c4718df391d5dd0f98d19297b"} Jun 10 13:07:01.286468 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:01.286443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" event={"ID":"8d98ea33-b51b-49ea-a643-640c8cd1e4d8","Type":"ContainerStarted","Data":"fe7b896fe1f057e4d1961ff066462545eb4273b5ad8217a717eb88de6a8e1e67"} Jun 10 13:07:03.272510 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.272484 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:07:03.303381 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.303347 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" Jun 10 13:07:03.303539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.303344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arvqqz" event={"ID":"82326c88-4190-4965-84f9-d0d727651357","Type":"ContainerDied","Data":"764ca69e0552ad480debaf5c7b960c47fa06356ddbfcc599e21cc7008313a919"} Jun 10 13:07:03.303539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.303487 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="764ca69e0552ad480debaf5c7b960c47fa06356ddbfcc599e21cc7008313a919" Jun 10 13:07:03.375126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.375089 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-util\") pod \"82326c88-4190-4965-84f9-d0d727651357\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " Jun 10 13:07:03.375309 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.375142 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxsn7\" (UniqueName: \"kubernetes.io/projected/82326c88-4190-4965-84f9-d0d727651357-kube-api-access-wxsn7\") pod \"82326c88-4190-4965-84f9-d0d727651357\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " Jun 10 13:07:03.375309 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.375190 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-bundle\") pod \"82326c88-4190-4965-84f9-d0d727651357\" (UID: \"82326c88-4190-4965-84f9-d0d727651357\") " Jun 10 13:07:03.376351 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.376311 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-bundle" (OuterVolumeSpecName: "bundle") pod "82326c88-4190-4965-84f9-d0d727651357" (UID: "82326c88-4190-4965-84f9-d0d727651357"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:03.377732 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.377704 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82326c88-4190-4965-84f9-d0d727651357-kube-api-access-wxsn7" (OuterVolumeSpecName: "kube-api-access-wxsn7") pod "82326c88-4190-4965-84f9-d0d727651357" (UID: "82326c88-4190-4965-84f9-d0d727651357"). InnerVolumeSpecName "kube-api-access-wxsn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:03.380881 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.380851 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-util" (OuterVolumeSpecName: "util") pod "82326c88-4190-4965-84f9-d0d727651357" (UID: "82326c88-4190-4965-84f9-d0d727651357"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:03.476245 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.476211 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:03.476245 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.476243 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxsn7\" (UniqueName: \"kubernetes.io/projected/82326c88-4190-4965-84f9-d0d727651357-kube-api-access-wxsn7\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:03.476455 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:03.476260 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82326c88-4190-4965-84f9-d0d727651357-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:06.322167 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:06.322129 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" event={"ID":"34a77f14-c380-4fb8-a6fb-286b2e02dc26","Type":"ContainerStarted","Data":"4f8b7d155ba4a26c59df1a146dc2a8debc4f9f9c3e36205aff3a15795cc19b46"} Jun 10 13:07:06.323933 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:06.323901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" event={"ID":"8d98ea33-b51b-49ea-a643-640c8cd1e4d8","Type":"ContainerStarted","Data":"e656e4017d1e11953765d1c95781952371cb4ccdb95229937864c59876c5f742"} Jun 10 13:07:06.324049 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:06.324033 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:06.378836 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:06.378794 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f476bfb57-txcc5" podStartSLOduration=1.56767719 podStartE2EDuration="6.378780522s" totalImagesPullingTime="4.811103332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:06.377519988 +0000 UTC m=+376.319533202" watchObservedRunningTime="2026-06-10 13:07:06.378780522 +0000 UTC m=+376.320793757" Jun 10 13:07:06.438489 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:06.438433 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" podStartSLOduration=2.153826521 podStartE2EDuration="7.438417346s" totalImagesPullingTime="5.284590825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:06.437981006 +0000 UTC m=+376.379994219" watchObservedRunningTime="2026-06-10 13:07:06.438417346 +0000 UTC m=+376.380430556" Jun 10 13:07:12.045350 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045313 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6"] Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045656 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="util" Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045666 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="util" Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045673 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="extract" Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045678 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="extract" Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045691 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="pull" Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045697 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="pull" Jun 10 13:07:12.046026 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.045748 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="82326c88-4190-4965-84f9-d0d727651357" containerName="extract" Jun 10 13:07:12.051393 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.051373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.054716 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.054696 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 13:07:12.054804 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.054719 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 13:07:12.054974 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.054948 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 13:07:12.055083 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.054948 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qc4jj\"" Jun 10 13:07:12.055083 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.055028 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 13:07:12.064519 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.064497 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6"] Jun 10 13:07:12.151482 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0667a56d-b0fe-437f-83f6-360b8143e719-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.151482 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.151684 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.151684 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0667a56d-b0fe-437f-83f6-360b8143e719-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.151684 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.151783 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0667a56d-b0fe-437f-83f6-360b8143e719-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.151817 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.151802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2fj\" (UniqueName: \"kubernetes.io/projected/0667a56d-b0fe-437f-83f6-360b8143e719-kube-api-access-5v2fj\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252642 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0667a56d-b0fe-437f-83f6-360b8143e719-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252642 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0667a56d-b0fe-437f-83f6-360b8143e719-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0667a56d-b0fe-437f-83f6-360b8143e719-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.252928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.252859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2fj\" (UniqueName: \"kubernetes.io/projected/0667a56d-b0fe-437f-83f6-360b8143e719-kube-api-access-5v2fj\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.253759 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.253727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0667a56d-b0fe-437f-83f6-360b8143e719-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.255154 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.255123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0667a56d-b0fe-437f-83f6-360b8143e719-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.255527 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.255504 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.255854 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.255812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.255960 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.255945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0667a56d-b0fe-437f-83f6-360b8143e719-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.261790 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.261762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2fj\" (UniqueName: \"kubernetes.io/projected/0667a56d-b0fe-437f-83f6-360b8143e719-kube-api-access-5v2fj\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.261953 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.261797 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0667a56d-b0fe-437f-83f6-360b8143e719-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7pzh6\" (UID: \"0667a56d-b0fe-437f-83f6-360b8143e719\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.360952 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.360880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:12.507604 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:12.507578 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6"] Jun 10 13:07:12.509715 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:12.509683 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0667a56d_b0fe_437f_83f6_360b8143e719.slice/crio-fb8ec79504b9d5607d7684c7bb9042208a36f62f3add4a5ed85d53d4088905b4 WatchSource:0}: Error finding container fb8ec79504b9d5607d7684c7bb9042208a36f62f3add4a5ed85d53d4088905b4: Status 404 returned error can't find the container with id fb8ec79504b9d5607d7684c7bb9042208a36f62f3add4a5ed85d53d4088905b4 Jun 10 13:07:13.362721 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:13.362675 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" event={"ID":"0667a56d-b0fe-437f-83f6-360b8143e719","Type":"ContainerStarted","Data":"fb8ec79504b9d5607d7684c7bb9042208a36f62f3add4a5ed85d53d4088905b4"} Jun 10 13:07:15.155802 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:15.155765 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 10 13:07:15.156063 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:15.155846 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 10 13:07:15.375344 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:15.375302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" event={"ID":"0667a56d-b0fe-437f-83f6-360b8143e719","Type":"ContainerStarted","Data":"ddb8498e1cf7df32e95bb974e28b793c62457d2a997543110cfc87c9b8961775"} Jun 10 13:07:15.375525 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:15.375424 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:15.405062 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:15.404968 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" podStartSLOduration=0.761488756 podStartE2EDuration="3.404946534s" totalImagesPullingTime="2.643457778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:15.403268263 +0000 UTC m=+385.345281475" watchObservedRunningTime="2026-06-10 13:07:15.404946534 +0000 UTC m=+385.346959743" Jun 10 13:07:16.383415 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:16.383373 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-7pzh6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 13:07:16.383877 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:16.383431 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" podUID="0667a56d-b0fe-437f-83f6-360b8143e719" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:07:17.331589 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:17.331550 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2gpnp" Jun 10 13:07:19.382539 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:19.382503 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7pzh6" Jun 10 13:07:25.248647 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:25.248607 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lrmnf" Jun 10 13:07:25.251386 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:25.251363 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bs5t2" Jun 10 13:07:53.156619 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.156583 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4"] Jun 10 13:07:53.165618 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.165593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.171238 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.171215 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:07:53.171358 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.171327 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:07:53.172477 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.172453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t24dc\"" Jun 10 13:07:53.175671 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.175652 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4"] Jun 10 13:07:53.196284 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.196258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.196386 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.196306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.196386 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.196344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzn5\" (UniqueName: \"kubernetes.io/projected/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-kube-api-access-ptzn5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.297131 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.297096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzn5\" (UniqueName: \"kubernetes.io/projected/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-kube-api-access-ptzn5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.297310 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.297197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.297310 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.297242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.297683 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.297658 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.297781 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.297682 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.312334 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.312309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzn5\" (UniqueName: \"kubernetes.io/projected/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-kube-api-access-ptzn5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.475145 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.475121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:53.615063 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.615041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4"] Jun 10 13:07:53.616861 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:53.616818 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4a50d4_636e_43d6_9980_f1f0b1b0672c.slice/crio-42ae6dcbf9ca20318ee9725d09a2e59517f3d72102fbaa9f3f66bf4f35d7a1c6 WatchSource:0}: Error finding container 42ae6dcbf9ca20318ee9725d09a2e59517f3d72102fbaa9f3f66bf4f35d7a1c6: Status 404 returned error can't find the container with id 42ae6dcbf9ca20318ee9725d09a2e59517f3d72102fbaa9f3f66bf4f35d7a1c6 Jun 10 13:07:53.996763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:53.996734 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8"] Jun 10 13:07:54.000608 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.000593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.020571 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.020545 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8"] Jun 10 13:07:54.103965 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.103933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26mx\" (UniqueName: \"kubernetes.io/projected/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-kube-api-access-d26mx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.104109 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.103991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.104109 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.104051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.205365 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.205333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.205685 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.205387 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.205685 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.205456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d26mx\" (UniqueName: \"kubernetes.io/projected/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-kube-api-access-d26mx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.205754 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.205698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.205754 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.205734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.217965 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.217946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26mx\" (UniqueName: \"kubernetes.io/projected/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-kube-api-access-d26mx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.309761 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.309704 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:54.446695 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.446670 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8"] Jun 10 13:07:54.448784 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:54.448761 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddd6f37_4f31_44e9_a0ac_9fccc0f6a858.slice/crio-86b31d0853971b682029551110952f9b06569ada3b12bf698de66f8692bafd48 WatchSource:0}: Error finding container 86b31d0853971b682029551110952f9b06569ada3b12bf698de66f8692bafd48: Status 404 returned error can't find the container with id 86b31d0853971b682029551110952f9b06569ada3b12bf698de66f8692bafd48 Jun 10 13:07:54.510817 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.510785 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv"] Jun 10 13:07:54.515733 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.515713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.526032 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.526007 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv"] Jun 10 13:07:54.577524 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.577494 2561 generic.go:356] "Generic (PLEG): container finished" podID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerID="09279d6d33cb2d83af697c85b0685b84b9d8d24d54ac17d403bf2446e0664a0d" exitCode=0 Jun 10 13:07:54.577671 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.577577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" event={"ID":"addd6f37-4f31-44e9-a0ac-9fccc0f6a858","Type":"ContainerDied","Data":"09279d6d33cb2d83af697c85b0685b84b9d8d24d54ac17d403bf2446e0664a0d"} Jun 10 13:07:54.577671 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.577636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" event={"ID":"addd6f37-4f31-44e9-a0ac-9fccc0f6a858","Type":"ContainerStarted","Data":"86b31d0853971b682029551110952f9b06569ada3b12bf698de66f8692bafd48"} Jun 10 13:07:54.579130 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.579110 2561 generic.go:356] "Generic (PLEG): container finished" podID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerID="3f0e1eb4ab9b404261e11ff0632a2b9fea5207c8ddd2acd45a3ff0f23e437408" exitCode=0 Jun 10 13:07:54.579208 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.579144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" event={"ID":"5f4a50d4-636e-43d6-9980-f1f0b1b0672c","Type":"ContainerDied","Data":"3f0e1eb4ab9b404261e11ff0632a2b9fea5207c8ddd2acd45a3ff0f23e437408"} Jun 10 13:07:54.579208 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.579171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" event={"ID":"5f4a50d4-636e-43d6-9980-f1f0b1b0672c","Type":"ContainerStarted","Data":"42ae6dcbf9ca20318ee9725d09a2e59517f3d72102fbaa9f3f66bf4f35d7a1c6"} Jun 10 13:07:54.609785 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.609755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.609934 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.609804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rk9\" (UniqueName: \"kubernetes.io/projected/195d0b75-f402-422e-8c3a-c14d07440f98-kube-api-access-98rk9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.610018 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.609996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.711038 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.711000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.711254 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.711048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.711254 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.711087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rk9\" (UniqueName: \"kubernetes.io/projected/195d0b75-f402-422e-8c3a-c14d07440f98-kube-api-access-98rk9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.711447 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.711428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.711496 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.711456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.721416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.721394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rk9\" (UniqueName: \"kubernetes.io/projected/195d0b75-f402-422e-8c3a-c14d07440f98-kube-api-access-98rk9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.825541 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.825454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:54.903216 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.903186 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn"] Jun 10 13:07:54.907193 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.907173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:54.920037 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.919999 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn"] Jun 10 13:07:54.971095 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:54.971068 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv"] Jun 10 13:07:54.972564 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:54.972539 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195d0b75_f402_422e_8c3a_c14d07440f98.slice/crio-823e2013fd316f0408484db54e3eb54a6f8a24cc451342ceafd0e707d779611e WatchSource:0}: Error finding container 823e2013fd316f0408484db54e3eb54a6f8a24cc451342ceafd0e707d779611e: Status 404 returned error can't find the container with id 823e2013fd316f0408484db54e3eb54a6f8a24cc451342ceafd0e707d779611e Jun 10 13:07:55.013781 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.013760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.013909 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.013875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.013958 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.013905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4lr\" (UniqueName: \"kubernetes.io/projected/39a9bee6-63ba-48a3-b029-2aa487d89618-kube-api-access-kp4lr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.114959 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.114886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.114959 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.114925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4lr\" (UniqueName: \"kubernetes.io/projected/39a9bee6-63ba-48a3-b029-2aa487d89618-kube-api-access-kp4lr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.115157 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.114982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.115313 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.115288 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.115378 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.115315 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.126001 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.125978 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4lr\" (UniqueName: \"kubernetes.io/projected/39a9bee6-63ba-48a3-b029-2aa487d89618-kube-api-access-kp4lr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.219900 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.219869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:55.476371 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.476342 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn"] Jun 10 13:07:55.546759 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:07:55.546715 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a9bee6_63ba_48a3_b029_2aa487d89618.slice/crio-2f8cc67202530f63222e7a1d60a95690fa9798f419dcf3abb1c69dde227c9311 WatchSource:0}: Error finding container 2f8cc67202530f63222e7a1d60a95690fa9798f419dcf3abb1c69dde227c9311: Status 404 returned error can't find the container with id 2f8cc67202530f63222e7a1d60a95690fa9798f419dcf3abb1c69dde227c9311 Jun 10 13:07:55.585257 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.585223 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" event={"ID":"39a9bee6-63ba-48a3-b029-2aa487d89618","Type":"ContainerStarted","Data":"2f8cc67202530f63222e7a1d60a95690fa9798f419dcf3abb1c69dde227c9311"} Jun 10 13:07:55.586999 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.586972 2561 generic.go:356] "Generic (PLEG): container finished" podID="195d0b75-f402-422e-8c3a-c14d07440f98" containerID="1f32b14a9d1eff7d76ce1d01e758774d2be24eafcd522bc425d5001c38c89cb0" exitCode=0 Jun 10 13:07:55.587116 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.587002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" event={"ID":"195d0b75-f402-422e-8c3a-c14d07440f98","Type":"ContainerDied","Data":"1f32b14a9d1eff7d76ce1d01e758774d2be24eafcd522bc425d5001c38c89cb0"} Jun 10 13:07:55.587116 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.587054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" event={"ID":"195d0b75-f402-422e-8c3a-c14d07440f98","Type":"ContainerStarted","Data":"823e2013fd316f0408484db54e3eb54a6f8a24cc451342ceafd0e707d779611e"} Jun 10 13:07:55.589144 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.589121 2561 generic.go:356] "Generic (PLEG): container finished" podID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerID="e75dcf06c7ebe285ad1ffe8c383ccbf3d8f0e8bf8f9b01ec70e343e93fae9817" exitCode=0 Jun 10 13:07:55.589253 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.589197 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" event={"ID":"addd6f37-4f31-44e9-a0ac-9fccc0f6a858","Type":"ContainerDied","Data":"e75dcf06c7ebe285ad1ffe8c383ccbf3d8f0e8bf8f9b01ec70e343e93fae9817"} Jun 10 13:07:55.591333 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.591312 2561 generic.go:356] "Generic (PLEG): container finished" podID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerID="52e430bcd98f571c8f1d1f04a91a068139b6604af768543d5401fb4b3b399d5e" exitCode=0 Jun 10 13:07:55.591416 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:55.591388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" event={"ID":"5f4a50d4-636e-43d6-9980-f1f0b1b0672c","Type":"ContainerDied","Data":"52e430bcd98f571c8f1d1f04a91a068139b6604af768543d5401fb4b3b399d5e"} Jun 10 13:07:56.598876 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.598845 2561 generic.go:356] "Generic (PLEG): container finished" podID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerID="3195afed165d52098f4db86b841d327a0faf2bc2202b2a2e980f91102ad4a5fa" exitCode=0 Jun 10 13:07:56.599227 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.598925 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" event={"ID":"5f4a50d4-636e-43d6-9980-f1f0b1b0672c","Type":"ContainerDied","Data":"3195afed165d52098f4db86b841d327a0faf2bc2202b2a2e980f91102ad4a5fa"} Jun 10 13:07:56.600317 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.600299 2561 generic.go:356] "Generic (PLEG): container finished" podID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerID="2738c23330f197eb1114abb143a7f4ed0fa8ea1da2a1de66dda061b68424dab9" exitCode=0 Jun 10 13:07:56.600390 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.600370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" event={"ID":"39a9bee6-63ba-48a3-b029-2aa487d89618","Type":"ContainerDied","Data":"2738c23330f197eb1114abb143a7f4ed0fa8ea1da2a1de66dda061b68424dab9"} Jun 10 13:07:56.602305 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.602286 2561 generic.go:356] "Generic (PLEG): container finished" podID="195d0b75-f402-422e-8c3a-c14d07440f98" containerID="9c4e0ed69862d464dfbdff6677a535ff2f1dda08c2cf96595cb41f06d7d740fb" exitCode=0 Jun 10 13:07:56.602506 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.602311 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" event={"ID":"195d0b75-f402-422e-8c3a-c14d07440f98","Type":"ContainerDied","Data":"9c4e0ed69862d464dfbdff6677a535ff2f1dda08c2cf96595cb41f06d7d740fb"} Jun 10 13:07:56.604643 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.604616 2561 generic.go:356] "Generic (PLEG): container finished" podID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerID="2d1e143d4b41ff473f5a84891e1399d6b4f0a8a58c414477f1649e6189ab937e" exitCode=0 Jun 10 13:07:56.604721 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:56.604651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" event={"ID":"addd6f37-4f31-44e9-a0ac-9fccc0f6a858","Type":"ContainerDied","Data":"2d1e143d4b41ff473f5a84891e1399d6b4f0a8a58c414477f1649e6189ab937e"} Jun 10 13:07:57.614254 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.614213 2561 generic.go:356] "Generic (PLEG): container finished" podID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerID="e84780aff167087d5a1e543b4b2cc6a4a3fdb366063834de05f24b31254d2e49" exitCode=0 Jun 10 13:07:57.614594 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.614285 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" event={"ID":"39a9bee6-63ba-48a3-b029-2aa487d89618","Type":"ContainerDied","Data":"e84780aff167087d5a1e543b4b2cc6a4a3fdb366063834de05f24b31254d2e49"} Jun 10 13:07:57.616524 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.616494 2561 generic.go:356] "Generic (PLEG): container finished" podID="195d0b75-f402-422e-8c3a-c14d07440f98" containerID="5113ef0da2f0376e736cefdda022a29ba87d88a49a9fdce5438b484a16d3a1b1" exitCode=0 Jun 10 13:07:57.616603 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.616575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" event={"ID":"195d0b75-f402-422e-8c3a-c14d07440f98","Type":"ContainerDied","Data":"5113ef0da2f0376e736cefdda022a29ba87d88a49a9fdce5438b484a16d3a1b1"} Jun 10 13:07:57.775294 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.775268 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:57.834635 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.834613 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:57.838460 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.838438 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-util\") pod \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " Jun 10 13:07:57.838576 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.838481 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d26mx\" (UniqueName: \"kubernetes.io/projected/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-kube-api-access-d26mx\") pod \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " Jun 10 13:07:57.838576 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.838537 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-bundle\") pod \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\" (UID: \"addd6f37-4f31-44e9-a0ac-9fccc0f6a858\") " Jun 10 13:07:57.839150 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.839110 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-bundle" (OuterVolumeSpecName: "bundle") pod "addd6f37-4f31-44e9-a0ac-9fccc0f6a858" (UID: "addd6f37-4f31-44e9-a0ac-9fccc0f6a858"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:57.840713 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.840694 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-kube-api-access-d26mx" (OuterVolumeSpecName: "kube-api-access-d26mx") pod "addd6f37-4f31-44e9-a0ac-9fccc0f6a858" (UID: "addd6f37-4f31-44e9-a0ac-9fccc0f6a858"). InnerVolumeSpecName "kube-api-access-d26mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:57.843511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.843489 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-util" (OuterVolumeSpecName: "util") pod "addd6f37-4f31-44e9-a0ac-9fccc0f6a858" (UID: "addd6f37-4f31-44e9-a0ac-9fccc0f6a858"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:57.939904 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.939818 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptzn5\" (UniqueName: \"kubernetes.io/projected/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-kube-api-access-ptzn5\") pod \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " Jun 10 13:07:57.939904 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.939888 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-bundle\") pod \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " Jun 10 13:07:57.940057 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.939931 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-util\") pod \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\" (UID: \"5f4a50d4-636e-43d6-9980-f1f0b1b0672c\") " Jun 10 13:07:57.940100 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.940079 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d26mx\" (UniqueName: \"kubernetes.io/projected/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-kube-api-access-d26mx\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:57.940100 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.940089 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:57.940100 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.940097 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/addd6f37-4f31-44e9-a0ac-9fccc0f6a858-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:57.940380 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.940357 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-bundle" (OuterVolumeSpecName: "bundle") pod "5f4a50d4-636e-43d6-9980-f1f0b1b0672c" (UID: "5f4a50d4-636e-43d6-9980-f1f0b1b0672c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:57.941924 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.941900 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-kube-api-access-ptzn5" (OuterVolumeSpecName: "kube-api-access-ptzn5") pod "5f4a50d4-636e-43d6-9980-f1f0b1b0672c" (UID: "5f4a50d4-636e-43d6-9980-f1f0b1b0672c"). InnerVolumeSpecName "kube-api-access-ptzn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:57.945512 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:57.945493 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-util" (OuterVolumeSpecName: "util") pod "5f4a50d4-636e-43d6-9980-f1f0b1b0672c" (UID: "5f4a50d4-636e-43d6-9980-f1f0b1b0672c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:58.040507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.040478 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptzn5\" (UniqueName: \"kubernetes.io/projected/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-kube-api-access-ptzn5\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:58.040507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.040503 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:58.040507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.040511 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f4a50d4-636e-43d6-9980-f1f0b1b0672c-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:58.624555 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.624526 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" Jun 10 13:07:58.624987 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.624523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8" event={"ID":"addd6f37-4f31-44e9-a0ac-9fccc0f6a858","Type":"ContainerDied","Data":"86b31d0853971b682029551110952f9b06569ada3b12bf698de66f8692bafd48"} Jun 10 13:07:58.624987 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.624639 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86b31d0853971b682029551110952f9b06569ada3b12bf698de66f8692bafd48" Jun 10 13:07:58.626649 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.626628 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" Jun 10 13:07:58.626782 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.626658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4" event={"ID":"5f4a50d4-636e-43d6-9980-f1f0b1b0672c","Type":"ContainerDied","Data":"42ae6dcbf9ca20318ee9725d09a2e59517f3d72102fbaa9f3f66bf4f35d7a1c6"} Jun 10 13:07:58.626782 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.626700 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42ae6dcbf9ca20318ee9725d09a2e59517f3d72102fbaa9f3f66bf4f35d7a1c6" Jun 10 13:07:58.629036 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.629011 2561 generic.go:356] "Generic (PLEG): container finished" podID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerID="0c6e1e9de3c84af5fb171116998b301465793c2cc1d759f72560c747757d82a8" exitCode=0 Jun 10 13:07:58.629141 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.629068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" event={"ID":"39a9bee6-63ba-48a3-b029-2aa487d89618","Type":"ContainerDied","Data":"0c6e1e9de3c84af5fb171116998b301465793c2cc1d759f72560c747757d82a8"} Jun 10 13:07:58.764954 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.764927 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:58.848012 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.847980 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-bundle\") pod \"195d0b75-f402-422e-8c3a-c14d07440f98\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " Jun 10 13:07:58.848012 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.848013 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98rk9\" (UniqueName: \"kubernetes.io/projected/195d0b75-f402-422e-8c3a-c14d07440f98-kube-api-access-98rk9\") pod \"195d0b75-f402-422e-8c3a-c14d07440f98\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " Jun 10 13:07:58.848229 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.848060 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-util\") pod \"195d0b75-f402-422e-8c3a-c14d07440f98\" (UID: \"195d0b75-f402-422e-8c3a-c14d07440f98\") " Jun 10 13:07:58.848681 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.848640 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-bundle" (OuterVolumeSpecName: "bundle") pod "195d0b75-f402-422e-8c3a-c14d07440f98" (UID: "195d0b75-f402-422e-8c3a-c14d07440f98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:58.850262 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.850239 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/195d0b75-f402-422e-8c3a-c14d07440f98-kube-api-access-98rk9" (OuterVolumeSpecName: "kube-api-access-98rk9") pod "195d0b75-f402-422e-8c3a-c14d07440f98" (UID: "195d0b75-f402-422e-8c3a-c14d07440f98"). InnerVolumeSpecName "kube-api-access-98rk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:58.853858 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.853817 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-util" (OuterVolumeSpecName: "util") pod "195d0b75-f402-422e-8c3a-c14d07440f98" (UID: "195d0b75-f402-422e-8c3a-c14d07440f98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:58.949556 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.949531 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:58.949556 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.949554 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/195d0b75-f402-422e-8c3a-c14d07440f98-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:58.949735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:58.949564 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98rk9\" (UniqueName: \"kubernetes.io/projected/195d0b75-f402-422e-8c3a-c14d07440f98-kube-api-access-98rk9\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:59.636014 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.635980 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" Jun 10 13:07:59.636400 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.636012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv" event={"ID":"195d0b75-f402-422e-8c3a-c14d07440f98","Type":"ContainerDied","Data":"823e2013fd316f0408484db54e3eb54a6f8a24cc451342ceafd0e707d779611e"} Jun 10 13:07:59.636400 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.636064 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="823e2013fd316f0408484db54e3eb54a6f8a24cc451342ceafd0e707d779611e" Jun 10 13:07:59.773213 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.773185 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:07:59.856217 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.856190 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp4lr\" (UniqueName: \"kubernetes.io/projected/39a9bee6-63ba-48a3-b029-2aa487d89618-kube-api-access-kp4lr\") pod \"39a9bee6-63ba-48a3-b029-2aa487d89618\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " Jun 10 13:07:59.856347 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.856224 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-util\") pod \"39a9bee6-63ba-48a3-b029-2aa487d89618\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " Jun 10 13:07:59.856393 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.856363 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-bundle\") pod \"39a9bee6-63ba-48a3-b029-2aa487d89618\" (UID: \"39a9bee6-63ba-48a3-b029-2aa487d89618\") " Jun 10 13:07:59.856774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.856748 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-bundle" (OuterVolumeSpecName: "bundle") pod "39a9bee6-63ba-48a3-b029-2aa487d89618" (UID: "39a9bee6-63ba-48a3-b029-2aa487d89618"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:59.858316 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.858296 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a9bee6-63ba-48a3-b029-2aa487d89618-kube-api-access-kp4lr" (OuterVolumeSpecName: "kube-api-access-kp4lr") pod "39a9bee6-63ba-48a3-b029-2aa487d89618" (UID: "39a9bee6-63ba-48a3-b029-2aa487d89618"). InnerVolumeSpecName "kube-api-access-kp4lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:59.864272 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.864249 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-util" (OuterVolumeSpecName: "util") pod "39a9bee6-63ba-48a3-b029-2aa487d89618" (UID: "39a9bee6-63ba-48a3-b029-2aa487d89618"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:59.957757 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.957700 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:59.957757 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.957720 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp4lr\" (UniqueName: \"kubernetes.io/projected/39a9bee6-63ba-48a3-b029-2aa487d89618-kube-api-access-kp4lr\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:07:59.957757 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:07:59.957730 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39a9bee6-63ba-48a3-b029-2aa487d89618-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:08:00.643306 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:00.643256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" event={"ID":"39a9bee6-63ba-48a3-b029-2aa487d89618","Type":"ContainerDied","Data":"2f8cc67202530f63222e7a1d60a95690fa9798f419dcf3abb1c69dde227c9311"} Jun 10 13:08:00.643692 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:00.643331 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f8cc67202530f63222e7a1d60a95690fa9798f419dcf3abb1c69dde227c9311" Jun 10 13:08:00.643692 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:00.643275 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn" Jun 10 13:08:17.508960 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.508872 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk"] Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509241 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="pull" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509252 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="pull" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509262 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="pull" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509267 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="pull" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509276 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="extract" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509282 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="extract" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509289 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="util" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509295 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="util" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509308 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="util" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509313 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="util" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509319 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="extract" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509325 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="extract" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509335 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="pull" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509340 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="pull" Jun 10 13:08:17.509342 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509347 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509352 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509358 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="util" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509363 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="util" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509368 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="util" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509372 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="util" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509378 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="pull" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509383 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="pull" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509389 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509395 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509449 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="addd6f37-4f31-44e9-a0ac-9fccc0f6a858" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509457 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4a50d4-636e-43d6-9980-f1f0b1b0672c" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509464 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="195d0b75-f402-422e-8c3a-c14d07440f98" containerName="extract" Jun 10 13:08:17.509763 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.509472 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a9bee6-63ba-48a3-b029-2aa487d89618" containerName="extract" Jun 10 13:08:17.512529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.512513 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:17.515429 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.515407 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:08:17.515617 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.515603 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:08:17.516541 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.516522 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x64lk\"" Jun 10 13:08:17.527084 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.527063 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk"] Jun 10 13:08:17.595847 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.595807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5f6g\" (UniqueName: \"kubernetes.io/projected/afcaad19-2c73-465f-afc3-0bfedf66dcea-kube-api-access-r5f6g\") pod \"limitador-operator-controller-manager-859d7b78bd-pctzk\" (UID: \"afcaad19-2c73-465f-afc3-0bfedf66dcea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:17.697185 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.697139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5f6g\" (UniqueName: \"kubernetes.io/projected/afcaad19-2c73-465f-afc3-0bfedf66dcea-kube-api-access-r5f6g\") pod \"limitador-operator-controller-manager-859d7b78bd-pctzk\" (UID: \"afcaad19-2c73-465f-afc3-0bfedf66dcea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:17.712885 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.712823 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5f6g\" (UniqueName: \"kubernetes.io/projected/afcaad19-2c73-465f-afc3-0bfedf66dcea-kube-api-access-r5f6g\") pod \"limitador-operator-controller-manager-859d7b78bd-pctzk\" (UID: \"afcaad19-2c73-465f-afc3-0bfedf66dcea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:17.822406 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.822323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:17.971308 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:17.971281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk"] Jun 10 13:08:17.973337 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:08:17.973311 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafcaad19_2c73_465f_afc3_0bfedf66dcea.slice/crio-18aac07ca3eb41a27cef8147d9d6da27a91b75cff43d9843fc720aefd87ebf52 WatchSource:0}: Error finding container 18aac07ca3eb41a27cef8147d9d6da27a91b75cff43d9843fc720aefd87ebf52: Status 404 returned error can't find the container with id 18aac07ca3eb41a27cef8147d9d6da27a91b75cff43d9843fc720aefd87ebf52 Jun 10 13:08:18.739269 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:18.739235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" event={"ID":"afcaad19-2c73-465f-afc3-0bfedf66dcea","Type":"ContainerStarted","Data":"18aac07ca3eb41a27cef8147d9d6da27a91b75cff43d9843fc720aefd87ebf52"} Jun 10 13:08:20.752193 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:20.752151 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" event={"ID":"afcaad19-2c73-465f-afc3-0bfedf66dcea","Type":"ContainerStarted","Data":"35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f"} Jun 10 13:08:20.752644 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:20.752292 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:20.786422 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:20.786363 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" podStartSLOduration=1.5517192340000001 podStartE2EDuration="3.786347624s" totalImagesPullingTime="2.23462839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:20.783969912 +0000 UTC m=+450.725983125" watchObservedRunningTime="2026-06-10 13:08:20.786347624 +0000 UTC m=+450.728360834" Jun 10 13:08:31.759884 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:31.759851 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.197773 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.197736 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk"] Jun 10 13:08:37.198243 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.198045 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" containerName="manager" containerID="cri-o://35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f" gracePeriod=2 Jun 10 13:08:37.211657 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.211598 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk"] Jun 10 13:08:37.216474 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.216410 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"afcaad19-2c73-465f-afc3-0bfedf66dcea\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-pctzk\": pods \"limitador-operator-controller-manager-859d7b78bd-pctzk\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.233240 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.233215 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b"] Jun 10 13:08:37.233587 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.233575 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" containerName="manager" Jun 10 13:08:37.233634 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.233590 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" containerName="manager" Jun 10 13:08:37.233669 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.233662 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" containerName="manager" Jun 10 13:08:37.236731 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.236716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:08:37.250217 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.250194 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b"] Jun 10 13:08:37.278417 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.278388 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pctzk\" is forbidden: User \"system:node:ip-10-0-128-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-233.ec2.internal' and this object" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.360174 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.360133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9cs\" (UniqueName: \"kubernetes.io/projected/7dbb0cee-356b-4ec3-b4cb-99e0633d4acd-kube-api-access-bp9cs\") pod \"limitador-operator-controller-manager-859d7b78bd-zb26b\" (UID: \"7dbb0cee-356b-4ec3-b4cb-99e0633d4acd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:08:37.446205 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.446177 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.449079 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.449021 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pctzk\" is forbidden: User \"system:node:ip-10-0-128-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-233.ec2.internal' and this object" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.461635 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.461611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9cs\" (UniqueName: \"kubernetes.io/projected/7dbb0cee-356b-4ec3-b4cb-99e0633d4acd-kube-api-access-bp9cs\") pod \"limitador-operator-controller-manager-859d7b78bd-zb26b\" (UID: \"7dbb0cee-356b-4ec3-b4cb-99e0633d4acd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:08:37.489333 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.489304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9cs\" (UniqueName: \"kubernetes.io/projected/7dbb0cee-356b-4ec3-b4cb-99e0633d4acd-kube-api-access-bp9cs\") pod \"limitador-operator-controller-manager-859d7b78bd-zb26b\" (UID: \"7dbb0cee-356b-4ec3-b4cb-99e0633d4acd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:08:37.561982 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.561957 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5f6g\" (UniqueName: \"kubernetes.io/projected/afcaad19-2c73-465f-afc3-0bfedf66dcea-kube-api-access-r5f6g\") pod \"afcaad19-2c73-465f-afc3-0bfedf66dcea\" (UID: \"afcaad19-2c73-465f-afc3-0bfedf66dcea\") " Jun 10 13:08:37.563950 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.563927 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcaad19-2c73-465f-afc3-0bfedf66dcea-kube-api-access-r5f6g" (OuterVolumeSpecName: "kube-api-access-r5f6g") pod "afcaad19-2c73-465f-afc3-0bfedf66dcea" (UID: "afcaad19-2c73-465f-afc3-0bfedf66dcea"). InnerVolumeSpecName "kube-api-access-r5f6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:08:37.579070 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.579047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:08:37.662664 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.662638 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5f6g\" (UniqueName: \"kubernetes.io/projected/afcaad19-2c73-465f-afc3-0bfedf66dcea-kube-api-access-r5f6g\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:08:37.729152 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.729125 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b"] Jun 10 13:08:37.730768 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:08:37.730743 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbb0cee_356b_4ec3_b4cb_99e0633d4acd.slice/crio-9c1d5c58f9ecc8e31d8197852da3bdb7428d7cf51382ecbbe47d2e92c97a538e WatchSource:0}: Error finding container 9c1d5c58f9ecc8e31d8197852da3bdb7428d7cf51382ecbbe47d2e92c97a538e: Status 404 returned error can't find the container with id 9c1d5c58f9ecc8e31d8197852da3bdb7428d7cf51382ecbbe47d2e92c97a538e Jun 10 13:08:37.848866 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.848819 2561 generic.go:356] "Generic (PLEG): container finished" podID="afcaad19-2c73-465f-afc3-0bfedf66dcea" containerID="35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f" exitCode=0 Jun 10 13:08:37.848962 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.848882 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.848962 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.848922 2561 scope.go:117] "RemoveContainer" containerID="35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f" Jun 10 13:08:37.850782 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.850750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" event={"ID":"7dbb0cee-356b-4ec3-b4cb-99e0633d4acd","Type":"ContainerStarted","Data":"1c1126726d59fc1a329a70603e5e54c4f2d076364afccae8ff6aa598307a5beb"} Jun 10 13:08:37.850905 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.850795 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" event={"ID":"7dbb0cee-356b-4ec3-b4cb-99e0633d4acd","Type":"ContainerStarted","Data":"9c1d5c58f9ecc8e31d8197852da3bdb7428d7cf51382ecbbe47d2e92c97a538e"} Jun 10 13:08:37.850968 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.850910 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:08:37.851628 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.851605 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pctzk\" is forbidden: User \"system:node:ip-10-0-128-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-233.ec2.internal' and this object" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.857887 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.857864 2561 scope.go:117] "RemoveContainer" containerID="35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f" Jun 10 13:08:37.858126 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.858110 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f\": container with ID starting with 35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f not found: ID does not exist" containerID="35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f" Jun 10 13:08:37.858174 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.858133 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f"} err="failed to get container status \"35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f\": rpc error: code = NotFound desc = could not find container \"35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f\": container with ID starting with 35f4d30313b2b302dd27cfcc615806913657216f9fb21223785d07e13f2b4b3f not found: ID does not exist" Jun 10 13:08:37.872235 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.872208 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pctzk\" is forbidden: User \"system:node:ip-10-0-128-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-233.ec2.internal' and this object" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:37.873507 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:37.873473 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" podStartSLOduration=0.873460569 podStartE2EDuration="873.460569ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:37.870156624 +0000 UTC m=+467.812169835" watchObservedRunningTime="2026-06-10 13:08:37.873460569 +0000 UTC m=+467.815473778" Jun 10 13:08:37.874294 ip-10-0-128-233 kubenswrapper[2561]: E0610 13:08:37.874265 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pctzk\" is forbidden: User \"system:node:ip-10-0-128-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-233.ec2.internal' and this object" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pctzk" Jun 10 13:08:38.562589 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:38.562559 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afcaad19-2c73-465f-afc3-0bfedf66dcea" path="/var/lib/kubelet/pods/afcaad19-2c73-465f-afc3-0bfedf66dcea/volumes" Jun 10 13:08:48.860273 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:08:48.860242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zb26b" Jun 10 13:09:29.915530 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.915485 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:09:29.919054 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.919034 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:29.921373 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.921353 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t24dc\"" Jun 10 13:09:29.921488 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.921355 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 13:09:29.929642 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.929618 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:09:29.958663 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.958633 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:09:29.993464 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.993430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jng9r\" (UniqueName: \"kubernetes.io/projected/4253650f-bbff-46b4-a5a9-d3da00f6a20c-kube-api-access-jng9r\") pod \"limitador-limitador-54d6d988d5-tfbnv\" (UID: \"4253650f-bbff-46b4-a5a9-d3da00f6a20c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:29.993614 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:29.993481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4253650f-bbff-46b4-a5a9-d3da00f6a20c-config-file\") pod \"limitador-limitador-54d6d988d5-tfbnv\" (UID: \"4253650f-bbff-46b4-a5a9-d3da00f6a20c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:30.094709 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:30.094677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jng9r\" (UniqueName: \"kubernetes.io/projected/4253650f-bbff-46b4-a5a9-d3da00f6a20c-kube-api-access-jng9r\") pod \"limitador-limitador-54d6d988d5-tfbnv\" (UID: \"4253650f-bbff-46b4-a5a9-d3da00f6a20c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:30.094881 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:30.094726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4253650f-bbff-46b4-a5a9-d3da00f6a20c-config-file\") pod \"limitador-limitador-54d6d988d5-tfbnv\" (UID: \"4253650f-bbff-46b4-a5a9-d3da00f6a20c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:30.095356 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:30.095338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4253650f-bbff-46b4-a5a9-d3da00f6a20c-config-file\") pod \"limitador-limitador-54d6d988d5-tfbnv\" (UID: \"4253650f-bbff-46b4-a5a9-d3da00f6a20c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:30.103355 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:30.103333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jng9r\" (UniqueName: \"kubernetes.io/projected/4253650f-bbff-46b4-a5a9-d3da00f6a20c-kube-api-access-jng9r\") pod \"limitador-limitador-54d6d988d5-tfbnv\" (UID: \"4253650f-bbff-46b4-a5a9-d3da00f6a20c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:30.229495 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:30.229460 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:30.370271 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:30.370247 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:09:30.371924 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:09:30.371894 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4253650f_bbff_46b4_a5a9_d3da00f6a20c.slice/crio-4037ec2a481c192a6c287823645491164c10335e95a01ea972a4229d7990980f WatchSource:0}: Error finding container 4037ec2a481c192a6c287823645491164c10335e95a01ea972a4229d7990980f: Status 404 returned error can't find the container with id 4037ec2a481c192a6c287823645491164c10335e95a01ea972a4229d7990980f Jun 10 13:09:31.159731 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:31.159685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" event={"ID":"4253650f-bbff-46b4-a5a9-d3da00f6a20c","Type":"ContainerStarted","Data":"4037ec2a481c192a6c287823645491164c10335e95a01ea972a4229d7990980f"} Jun 10 13:09:33.175695 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:33.175603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" event={"ID":"4253650f-bbff-46b4-a5a9-d3da00f6a20c","Type":"ContainerStarted","Data":"b6cddedcb9be0bdfdd2d3137051d20aafd4146666349ae3d7cfa9517836a550d"} Jun 10 13:09:33.176089 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:33.175729 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:33.196466 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:33.196420 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" podStartSLOduration=1.74904845 podStartE2EDuration="4.196404559s" totalImagesPullingTime="2.447356109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:33.194043329 +0000 UTC m=+523.136056548" watchObservedRunningTime="2026-06-10 13:09:33.196404559 +0000 UTC m=+523.138417769" Jun 10 13:09:44.182692 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:44.182610 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tfbnv" Jun 10 13:09:59.343452 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.343415 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn"] Jun 10 13:09:59.347213 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.347195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.350607 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.350585 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:09:59.350695 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.350634 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:09:59.351774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.351756 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4z9vr\"" Jun 10 13:09:59.361456 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.361436 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn"] Jun 10 13:09:59.447101 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.447065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.447269 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.447117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.447269 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.447137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqlj8\" (UniqueName: \"kubernetes.io/projected/833998bc-6290-4002-becd-7423b387535b-kube-api-access-tqlj8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.547528 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.547494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.547676 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.547550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.547676 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.547581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqlj8\" (UniqueName: \"kubernetes.io/projected/833998bc-6290-4002-becd-7423b387535b-kube-api-access-tqlj8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.547903 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.547885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.547983 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.547964 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.557124 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.557099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqlj8\" (UniqueName: \"kubernetes.io/projected/833998bc-6290-4002-becd-7423b387535b-kube-api-access-tqlj8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.656347 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.656256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:09:59.796568 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:09:59.796535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn"] Jun 10 13:09:59.797887 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:09:59.797855 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833998bc_6290_4002_becd_7423b387535b.slice/crio-122b5ac2cb014521f3b6fa8fcda6d609190561f35b1761468fee6873c3e4ec05 WatchSource:0}: Error finding container 122b5ac2cb014521f3b6fa8fcda6d609190561f35b1761468fee6873c3e4ec05: Status 404 returned error can't find the container with id 122b5ac2cb014521f3b6fa8fcda6d609190561f35b1761468fee6873c3e4ec05 Jun 10 13:10:00.322604 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:00.322571 2561 generic.go:356] "Generic (PLEG): container finished" podID="833998bc-6290-4002-becd-7423b387535b" containerID="7661f2ca1e773d2f2812dfe0bc8ca5263938e48dc9f50f789203456f934f6500" exitCode=0 Jun 10 13:10:00.322786 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:00.322624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" event={"ID":"833998bc-6290-4002-becd-7423b387535b","Type":"ContainerDied","Data":"7661f2ca1e773d2f2812dfe0bc8ca5263938e48dc9f50f789203456f934f6500"} Jun 10 13:10:00.322786 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:00.322670 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" event={"ID":"833998bc-6290-4002-becd-7423b387535b","Type":"ContainerStarted","Data":"122b5ac2cb014521f3b6fa8fcda6d609190561f35b1761468fee6873c3e4ec05"} Jun 10 13:10:01.330375 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:01.330340 2561 generic.go:356] "Generic (PLEG): container finished" podID="833998bc-6290-4002-becd-7423b387535b" containerID="aa4da9d40fd3492064feaea7373accc1039846b103d5896a2a61fbb902c18145" exitCode=0 Jun 10 13:10:01.330733 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:01.330423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" event={"ID":"833998bc-6290-4002-becd-7423b387535b","Type":"ContainerDied","Data":"aa4da9d40fd3492064feaea7373accc1039846b103d5896a2a61fbb902c18145"} Jun 10 13:10:02.341549 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:02.341512 2561 generic.go:356] "Generic (PLEG): container finished" podID="833998bc-6290-4002-becd-7423b387535b" containerID="9e48fb936877f9a71ac696930ce5ab6fe6dd86b5f059f685f5ac28e5d612f7a5" exitCode=0 Jun 10 13:10:02.341934 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:02.341576 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" event={"ID":"833998bc-6290-4002-becd-7423b387535b","Type":"ContainerDied","Data":"9e48fb936877f9a71ac696930ce5ab6fe6dd86b5f059f685f5ac28e5d612f7a5"} Jun 10 13:10:03.492953 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.492931 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:10:03.582647 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.582608 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-util\") pod \"833998bc-6290-4002-becd-7423b387535b\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " Jun 10 13:10:03.582866 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.582697 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-bundle\") pod \"833998bc-6290-4002-becd-7423b387535b\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " Jun 10 13:10:03.582866 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.582755 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqlj8\" (UniqueName: \"kubernetes.io/projected/833998bc-6290-4002-becd-7423b387535b-kube-api-access-tqlj8\") pod \"833998bc-6290-4002-becd-7423b387535b\" (UID: \"833998bc-6290-4002-becd-7423b387535b\") " Jun 10 13:10:03.583250 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.583219 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-bundle" (OuterVolumeSpecName: "bundle") pod "833998bc-6290-4002-becd-7423b387535b" (UID: "833998bc-6290-4002-becd-7423b387535b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:10:03.585032 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.585010 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833998bc-6290-4002-becd-7423b387535b-kube-api-access-tqlj8" (OuterVolumeSpecName: "kube-api-access-tqlj8") pod "833998bc-6290-4002-becd-7423b387535b" (UID: "833998bc-6290-4002-becd-7423b387535b"). InnerVolumeSpecName "kube-api-access-tqlj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:10:03.588663 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.588629 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-util" (OuterVolumeSpecName: "util") pod "833998bc-6290-4002-becd-7423b387535b" (UID: "833998bc-6290-4002-becd-7423b387535b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:10:03.684287 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.684199 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-bundle\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:10:03.684287 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.684229 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqlj8\" (UniqueName: \"kubernetes.io/projected/833998bc-6290-4002-becd-7423b387535b-kube-api-access-tqlj8\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:10:03.684287 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:03.684238 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833998bc-6290-4002-becd-7423b387535b-util\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:10:04.355627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:04.355594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" event={"ID":"833998bc-6290-4002-becd-7423b387535b","Type":"ContainerDied","Data":"122b5ac2cb014521f3b6fa8fcda6d609190561f35b1761468fee6873c3e4ec05"} Jun 10 13:10:04.355627 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:04.355623 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qpxwn" Jun 10 13:10:04.355980 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:04.355642 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="122b5ac2cb014521f3b6fa8fcda6d609190561f35b1761468fee6873c3e4ec05" Jun 10 13:10:50.527594 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:50.527563 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:10:50.528119 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:50.527950 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:10:50.534369 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:50.534348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:10:50.534581 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:10:50.534566 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:11:35.815381 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:11:35.815339 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:12:32.597177 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:32.597143 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:12:36.847353 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847318 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh"] Jun 10 13:12:36.847774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847698 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="pull" Jun 10 13:12:36.847774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847710 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="pull" Jun 10 13:12:36.847774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847727 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="extract" Jun 10 13:12:36.847774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847732 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="extract" Jun 10 13:12:36.847774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847745 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="util" Jun 10 13:12:36.847774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847750 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="util" Jun 10 13:12:36.848032 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.847806 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="833998bc-6290-4002-becd-7423b387535b" containerName="extract" Jun 10 13:12:36.851542 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.851520 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:36.867351 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.867321 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:12:36.867486 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.867442 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mp6t6\"" Jun 10 13:12:36.867691 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.867663 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:12:36.876905 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.876883 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh"] Jun 10 13:12:36.878275 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.878256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 13:12:36.952743 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.952715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjpz\" (UniqueName: \"kubernetes.io/projected/7d7439d1-86eb-413b-a934-1a40289ddf36-kube-api-access-2xjpz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:36.952895 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.952750 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7439d1-86eb-413b-a934-1a40289ddf36-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:36.952895 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.952826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:36.952895 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.952878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:36.953025 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.952901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:36.953025 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:36.952973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.053941 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.053909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054082 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.053956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjpz\" (UniqueName: \"kubernetes.io/projected/7d7439d1-86eb-413b-a934-1a40289ddf36-kube-api-access-2xjpz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054082 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.053984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7439d1-86eb-413b-a934-1a40289ddf36-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054082 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.054062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054252 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.054090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054252 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.054122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054462 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.054443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054548 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.054481 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.054548 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.054536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.056443 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.056412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7439d1-86eb-413b-a934-1a40289ddf36-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.056784 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.056765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7439d1-86eb-413b-a934-1a40289ddf36-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.071471 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.071443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjpz\" (UniqueName: \"kubernetes.io/projected/7d7439d1-86eb-413b-a934-1a40289ddf36-kube-api-access-2xjpz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-b89fh\" (UID: \"7d7439d1-86eb-413b-a934-1a40289ddf36\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.161500 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.161429 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:37.306757 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.306733 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh"] Jun 10 13:12:37.307380 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:12:37.307354 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7439d1_86eb_413b_a934_1a40289ddf36.slice/crio-396779c1d53f04b945aad17cf30e939f89c1e09a065e43770370f405715fa8fc WatchSource:0}: Error finding container 396779c1d53f04b945aad17cf30e939f89c1e09a065e43770370f405715fa8fc: Status 404 returned error can't find the container with id 396779c1d53f04b945aad17cf30e939f89c1e09a065e43770370f405715fa8fc Jun 10 13:12:37.309177 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.309159 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:12:37.538165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:37.538129 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:12:38.228886 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:38.228807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" event={"ID":"7d7439d1-86eb-413b-a934-1a40289ddf36","Type":"ContainerStarted","Data":"396779c1d53f04b945aad17cf30e939f89c1e09a065e43770370f405715fa8fc"} Jun 10 13:12:41.162749 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.162648 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk"] Jun 10 13:12:41.167078 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.167055 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.170205 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.170174 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 13:12:41.178436 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.178408 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk"] Jun 10 13:12:41.250739 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.250700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" event={"ID":"7d7439d1-86eb-413b-a934-1a40289ddf36","Type":"ContainerStarted","Data":"36a20f37c34e69cd2f56d69f3a051dcf41a528dad2320d6091b62eb8e9eb83aa"} Jun 10 13:12:41.295175 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.295139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d15ec0a-43ea-4b27-a4f5-f2941a017175-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.295372 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.295202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.295372 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.295231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.295372 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.295260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.295554 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.295364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.295554 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.295401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kd9g\" (UniqueName: \"kubernetes.io/projected/7d15ec0a-43ea-4b27-a4f5-f2941a017175-kube-api-access-8kd9g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396204 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396394 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396394 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396394 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396394 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kd9g\" (UniqueName: \"kubernetes.io/projected/7d15ec0a-43ea-4b27-a4f5-f2941a017175-kube-api-access-8kd9g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396638 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d15ec0a-43ea-4b27-a4f5-f2941a017175-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.396686 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.396627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.397035 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.397007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.397150 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.397056 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.398722 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.398697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d15ec0a-43ea-4b27-a4f5-f2941a017175-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.399258 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.399238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d15ec0a-43ea-4b27-a4f5-f2941a017175-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.408436 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.408408 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kd9g\" (UniqueName: \"kubernetes.io/projected/7d15ec0a-43ea-4b27-a4f5-f2941a017175-kube-api-access-8kd9g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk\" (UID: \"7d15ec0a-43ea-4b27-a4f5-f2941a017175\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.481529 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.481502 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:12:41.645175 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.645149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk"] Jun 10 13:12:41.647869 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:12:41.647825 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d15ec0a_43ea_4b27_a4f5_f2941a017175.slice/crio-2356dc7b5794604ab79fe32b927787b32f111fe24839471d047a067dbf0b517f WatchSource:0}: Error finding container 2356dc7b5794604ab79fe32b927787b32f111fe24839471d047a067dbf0b517f: Status 404 returned error can't find the container with id 2356dc7b5794604ab79fe32b927787b32f111fe24839471d047a067dbf0b517f Jun 10 13:12:41.819731 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:41.819644 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:12:42.257719 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:42.257687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" event={"ID":"7d15ec0a-43ea-4b27-a4f5-f2941a017175","Type":"ContainerStarted","Data":"50693d9266dc92276d93fac8e6766b14363a38e978b9068654f3db6ad4af10dc"} Jun 10 13:12:42.258090 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:42.257747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" event={"ID":"7d15ec0a-43ea-4b27-a4f5-f2941a017175","Type":"ContainerStarted","Data":"2356dc7b5794604ab79fe32b927787b32f111fe24839471d047a067dbf0b517f"} Jun 10 13:12:42.259268 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:42.259237 2561 generic.go:356] "Generic (PLEG): container finished" podID="7d7439d1-86eb-413b-a934-1a40289ddf36" containerID="36a20f37c34e69cd2f56d69f3a051dcf41a528dad2320d6091b62eb8e9eb83aa" exitCode=0 Jun 10 13:12:42.259372 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:42.259282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" event={"ID":"7d7439d1-86eb-413b-a934-1a40289ddf36","Type":"ContainerDied","Data":"36a20f37c34e69cd2f56d69f3a051dcf41a528dad2320d6091b62eb8e9eb83aa"} Jun 10 13:12:44.282556 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:44.282515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" event={"ID":"7d7439d1-86eb-413b-a934-1a40289ddf36","Type":"ContainerStarted","Data":"9932ed4bd3e2927829c75d3de6c0156c531773b7b1a445a83827c0723459d4d5"} Jun 10 13:12:44.307421 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:44.307369 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" podStartSLOduration=2.236774374 podStartE2EDuration="8.307354037s" totalImagesPullingTime="4.721054896s" totalInitContainerRuntime="1.349524767s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:44.304318643 +0000 UTC m=+714.246331846" watchObservedRunningTime="2026-06-10 13:12:44.307354037 +0000 UTC m=+714.249367247" Jun 10 13:12:47.161967 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:47.161933 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:47.162377 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:47.162002 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:47.174482 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:47.174460 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:47.310679 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:47.310654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-b89fh" Jun 10 13:12:58.333575 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:12:58.333545 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:13:02.924689 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:02.924654 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:13:25.618346 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:25.618317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:13:40.601990 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:40.601958 2561 generic.go:356] "Generic (PLEG): container finished" podID="7d15ec0a-43ea-4b27-a4f5-f2941a017175" containerID="50693d9266dc92276d93fac8e6766b14363a38e978b9068654f3db6ad4af10dc" exitCode=0 Jun 10 13:13:40.601990 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:40.602005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" event={"ID":"7d15ec0a-43ea-4b27-a4f5-f2941a017175","Type":"ContainerDied","Data":"50693d9266dc92276d93fac8e6766b14363a38e978b9068654f3db6ad4af10dc"} Jun 10 13:13:41.609404 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:41.609362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" event={"ID":"7d15ec0a-43ea-4b27-a4f5-f2941a017175","Type":"ContainerStarted","Data":"2f20921e2462c3dcefba0849a0ee38d8261384f2312af746ef5fb6232f20e4a7"} Jun 10 13:13:41.638230 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:41.638183 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" podStartSLOduration=2.323787833 podStartE2EDuration="1m0.638168667s" totalImagesPullingTime="277.409297ms" totalInitContainerRuntime="58.036971537s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:41.635520291 +0000 UTC m=+771.577533506" watchObservedRunningTime="2026-06-10 13:13:41.638168667 +0000 UTC m=+771.580181877" Jun 10 13:13:51.481713 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:51.481681 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:13:51.482104 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:51.481763 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:13:51.494300 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:51.494273 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:13:51.682517 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:13:51.682490 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk" Jun 10 13:14:57.921574 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:14:57.921533 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:15:00.150639 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.150605 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684955-ldvnf"] Jun 10 13:15:00.154126 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.154110 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:00.157271 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.157255 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-248v2\"" Jun 10 13:15:00.165177 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.165155 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684955-ldvnf"] Jun 10 13:15:00.294278 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.294237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86d9s\" (UniqueName: \"kubernetes.io/projected/61f0b23a-a1ee-4e46-8dc0-95b47533dd8f-kube-api-access-86d9s\") pod \"maas-api-key-cleanup-29684955-ldvnf\" (UID: \"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f\") " pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:00.395059 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.395005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86d9s\" (UniqueName: \"kubernetes.io/projected/61f0b23a-a1ee-4e46-8dc0-95b47533dd8f-kube-api-access-86d9s\") pod \"maas-api-key-cleanup-29684955-ldvnf\" (UID: \"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f\") " pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:00.405116 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.405052 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86d9s\" (UniqueName: \"kubernetes.io/projected/61f0b23a-a1ee-4e46-8dc0-95b47533dd8f-kube-api-access-86d9s\") pod \"maas-api-key-cleanup-29684955-ldvnf\" (UID: \"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f\") " pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:00.465435 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.465394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:00.608171 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:00.607885 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684955-ldvnf"] Jun 10 13:15:01.070788 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:01.070751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" event={"ID":"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f","Type":"ContainerStarted","Data":"72de864d5d62742169b9370c4a51f554d66debd239bc4a20ef7c0a87f3796a61"} Jun 10 13:15:04.091616 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:04.091529 2561 generic.go:356] "Generic (PLEG): container finished" podID="61f0b23a-a1ee-4e46-8dc0-95b47533dd8f" containerID="c25932fb997c34c69da3e79e5bf2a53308cd041603ffdcc07cbce5b82d2ce484" exitCode=0 Jun 10 13:15:04.091978 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:04.091660 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" event={"ID":"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f","Type":"ContainerDied","Data":"c25932fb997c34c69da3e79e5bf2a53308cd041603ffdcc07cbce5b82d2ce484"} Jun 10 13:15:05.235970 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:05.235946 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:05.342928 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:05.342885 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86d9s\" (UniqueName: \"kubernetes.io/projected/61f0b23a-a1ee-4e46-8dc0-95b47533dd8f-kube-api-access-86d9s\") pod \"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f\" (UID: \"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f\") " Jun 10 13:15:05.345514 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:05.345478 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f0b23a-a1ee-4e46-8dc0-95b47533dd8f-kube-api-access-86d9s" (OuterVolumeSpecName: "kube-api-access-86d9s") pod "61f0b23a-a1ee-4e46-8dc0-95b47533dd8f" (UID: "61f0b23a-a1ee-4e46-8dc0-95b47533dd8f"). InnerVolumeSpecName "kube-api-access-86d9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:15:05.444486 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:05.444446 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86d9s\" (UniqueName: \"kubernetes.io/projected/61f0b23a-a1ee-4e46-8dc0-95b47533dd8f-kube-api-access-86d9s\") on node \"ip-10-0-128-233.ec2.internal\" DevicePath \"\"" Jun 10 13:15:06.105657 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:06.105623 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" Jun 10 13:15:06.105857 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:06.105627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-ldvnf" event={"ID":"61f0b23a-a1ee-4e46-8dc0-95b47533dd8f","Type":"ContainerDied","Data":"72de864d5d62742169b9370c4a51f554d66debd239bc4a20ef7c0a87f3796a61"} Jun 10 13:15:06.105857 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:06.105750 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72de864d5d62742169b9370c4a51f554d66debd239bc4a20ef7c0a87f3796a61" Jun 10 13:15:08.338958 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:08.338916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:15:17.026883 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:17.026848 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:15:27.371101 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:27.371065 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:15:37.223673 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:37.223638 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:15:47.167790 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:47.167704 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:15:50.576619 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:50.576594 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:15:50.583475 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:50.583453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:15:50.583608 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:50.583492 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:15:50.590511 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:15:50.590493 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:16:18.522892 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:16:18.522859 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:16:22.545027 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:16:22.544986 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:16:28.024739 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:16:28.024696 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:16:29.211677 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:16:29.211638 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:16:59.123030 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:16:59.122992 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:17:15.225186 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:17:15.225112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:17:53.523287 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:17:53.523247 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:18:10.626947 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:18:10.626906 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:18:25.022132 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:18:25.022094 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:18:41.119106 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:18:41.119031 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:19:22.718816 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:19:22.718779 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:19:25.619175 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:19:25.619129 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:19:48.119255 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:19:48.119216 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:19:57.118066 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:19:57.118027 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:20:13.519765 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:13.519673 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:20:21.928440 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:21.928400 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:20:30.621382 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:30.621347 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:20:50.615291 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:50.615261 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:20:50.621343 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:50.621321 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:20:50.629350 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:50.629328 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:20:50.635777 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:20:50.635756 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b6k2t_5c59700d-d06a-4359-85e3-9184a55014af/ovn-acl-logging/0.log" Jun 10 13:21:19.433440 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:21:19.433405 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:21:29.020701 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:21:29.020663 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:21:36.320947 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:21:36.320904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:09.019359 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:09.019280 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:17.141292 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:17.141256 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:20.121904 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:20.121864 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:26.323553 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:26.323516 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:34.315176 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:34.315138 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:42.630735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:42.630698 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:51.550382 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:51.550346 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:22:54.628850 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:22:54.628803 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:23:00.148448 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:00.148415 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:23:09.024353 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:09.024279 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tfbnv"] Jun 10 13:23:21.587959 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:21.587925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f476bfb57-txcc5_34a77f14-c380-4fb8-a6fb-286b2e02dc26/nginx/0.log" Jun 10 13:23:21.698727 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:21.698703 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bs5t2_7d65e7bc-78d0-4b52-ac18-c0dd29040d8f/manager/0.log" Jun 10 13:23:21.836244 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:21.836219 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lrmnf_97d3adb7-8d65-4a1c-8570-50c5f82b171e/manager/0.log" Jun 10 13:23:22.101359 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:22.101338 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684955-ldvnf_61f0b23a-a1ee-4e46-8dc0-95b47533dd8f/cleanup/0.log" Jun 10 13:23:22.339182 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:22.339154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-b44b2_76ebe1de-7523-4f25-859d-91ccbb1bd98b/server/0.log" Jun 10 13:23:22.458825 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:22.458748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-rqhm9_4fcc392a-1239-416a-84ad-cb8bd9d4e843/manager/0.log" Jun 10 13:23:22.577543 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:22.577517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt_ade955df-24a1-4388-be7e-2924a9251afa/copy-manifests/0.log" Jun 10 13:23:22.596538 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:22.596518 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt_ade955df-24a1-4388-be7e-2924a9251afa/manager/0.log" Jun 10 13:23:23.819165 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:23.819125 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn_39a9bee6-63ba-48a3-b029-2aa487d89618/util/0.log" Jun 10 13:23:23.826308 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:23.826286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn_39a9bee6-63ba-48a3-b029-2aa487d89618/pull/0.log" Jun 10 13:23:23.833229 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:23.833208 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn_39a9bee6-63ba-48a3-b029-2aa487d89618/extract/0.log" Jun 10 13:23:23.953386 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:23.953362 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8_addd6f37-4f31-44e9-a0ac-9fccc0f6a858/util/0.log" Jun 10 13:23:23.966766 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:23.966748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8_addd6f37-4f31-44e9-a0ac-9fccc0f6a858/pull/0.log" Jun 10 13:23:23.977419 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:23.977402 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8_addd6f37-4f31-44e9-a0ac-9fccc0f6a858/extract/0.log" Jun 10 13:23:24.093058 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:24.092988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv_195d0b75-f402-422e-8c3a-c14d07440f98/util/0.log" Jun 10 13:23:24.100615 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:24.100596 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv_195d0b75-f402-422e-8c3a-c14d07440f98/pull/0.log" Jun 10 13:23:24.108432 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:24.108415 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv_195d0b75-f402-422e-8c3a-c14d07440f98/extract/0.log" Jun 10 13:23:24.220557 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:24.220527 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4_5f4a50d4-636e-43d6-9980-f1f0b1b0672c/util/0.log" Jun 10 13:23:24.227578 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:24.227558 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4_5f4a50d4-636e-43d6-9980-f1f0b1b0672c/pull/0.log" Jun 10 13:23:24.234230 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:24.234213 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4_5f4a50d4-636e-43d6-9980-f1f0b1b0672c/extract/0.log" Jun 10 13:23:25.128566 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:25.128540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tfbnv_4253650f-bbff-46b4-a5a9-d3da00f6a20c/limitador/0.log" Jun 10 13:23:25.238561 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:25.238530 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zb26b_7dbb0cee-356b-4ec3-b4cb-99e0633d4acd/manager/0.log" Jun 10 13:23:25.727922 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:25.727892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7pzh6_0667a56d-b0fe-437f-83f6-360b8143e719/discovery/0.log" Jun 10 13:23:25.964023 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:25.963999 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-768f854844-p7ntm_e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc/kube-auth-proxy/0.log" Jun 10 13:23:26.463648 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:26.463620 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b685c9fc-qrkrx_0c0b04d6-e894-41b6-995c-ff572033d287/router/0.log" Jun 10 13:23:26.929230 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:26.929199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-b89fh_7d7439d1-86eb-413b-a934-1a40289ddf36/storage-initializer/0.log" Jun 10 13:23:26.939302 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:26.939274 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-b89fh_7d7439d1-86eb-413b-a934-1a40289ddf36/main/0.log" Jun 10 13:23:27.055812 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:27.055790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk_7d15ec0a-43ea-4b27-a4f5-f2941a017175/storage-initializer/0.log" Jun 10 13:23:27.063597 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:27.063575 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-zsrtk_7d15ec0a-43ea-4b27-a4f5-f2941a017175/main/0.log" Jun 10 13:23:34.564570 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:34.564538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fk5k7_e360f1a8-c94e-4367-a134-f31a74dfc75e/global-pull-secret-syncer/0.log" Jun 10 13:23:34.781892 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:34.781864 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x7g6s_272e5243-db29-4751-abba-597ed272b81f/konnectivity-agent/0.log" Jun 10 13:23:34.820693 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:34.820603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-233.ec2.internal_b34c1dd48d0ad7bd636471024083f38f/haproxy/0.log" Jun 10 13:23:38.118545 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:38.118517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-2gpnp_8d98ea33-b51b-49ea-a643-640c8cd1e4d8/sail-operator/0.log" Jun 10 13:23:39.017237 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.017207 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn_39a9bee6-63ba-48a3-b029-2aa487d89618/extract/0.log" Jun 10 13:23:39.092328 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.092304 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn_39a9bee6-63ba-48a3-b029-2aa487d89618/util/0.log" Jun 10 13:23:39.179127 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.179106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bb2rn_39a9bee6-63ba-48a3-b029-2aa487d89618/pull/0.log" Jun 10 13:23:39.233314 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.233286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8_addd6f37-4f31-44e9-a0ac-9fccc0f6a858/extract/0.log" Jun 10 13:23:39.304469 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.304385 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8_addd6f37-4f31-44e9-a0ac-9fccc0f6a858/util/0.log" Jun 10 13:23:39.407747 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.407718 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jn6d8_addd6f37-4f31-44e9-a0ac-9fccc0f6a858/pull/0.log" Jun 10 13:23:39.484278 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.484249 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv_195d0b75-f402-422e-8c3a-c14d07440f98/extract/0.log" Jun 10 13:23:39.543097 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.543073 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv_195d0b75-f402-422e-8c3a-c14d07440f98/util/0.log" Jun 10 13:23:39.591451 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.591383 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qgjnv_195d0b75-f402-422e-8c3a-c14d07440f98/pull/0.log" Jun 10 13:23:39.637951 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.637925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4_5f4a50d4-636e-43d6-9980-f1f0b1b0672c/extract/0.log" Jun 10 13:23:39.695960 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.695934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4_5f4a50d4-636e-43d6-9980-f1f0b1b0672c/util/0.log" Jun 10 13:23:39.751766 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:39.751743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ql4c4_5f4a50d4-636e-43d6-9980-f1f0b1b0672c/pull/0.log" Jun 10 13:23:40.267745 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:40.267712 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tfbnv_4253650f-bbff-46b4-a5a9-d3da00f6a20c/limitador/0.log" Jun 10 13:23:40.335536 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:40.335513 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zb26b_7dbb0cee-356b-4ec3-b4cb-99e0633d4acd/manager/0.log" Jun 10 13:23:42.482605 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:42.482579 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-fj6wl_7a2d1596-b447-415b-b42f-be5108d40038/monitoring-plugin/0.log" Jun 10 13:23:42.828069 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:42.827995 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txqjq_37f2968a-1a85-4ade-9e9e-400821a36083/node-exporter/0.log" Jun 10 13:23:42.857621 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:42.857600 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txqjq_37f2968a-1a85-4ade-9e9e-400821a36083/kube-rbac-proxy/0.log" Jun 10 13:23:42.898030 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:42.898007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txqjq_37f2968a-1a85-4ade-9e9e-400821a36083/init-textfile/0.log" Jun 10 13:23:42.941373 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:42.941348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zb6z9_c5ef35d2-7acc-4634-a11d-8c2354e91e40/kube-rbac-proxy-main/0.log" Jun 10 13:23:42.972581 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:42.972562 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zb6z9_c5ef35d2-7acc-4634-a11d-8c2354e91e40/kube-rbac-proxy-self/0.log" Jun 10 13:23:43.017192 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:43.017168 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zb6z9_c5ef35d2-7acc-4634-a11d-8c2354e91e40/openshift-state-metrics/0.log" Jun 10 13:23:43.336422 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:43.336397 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-b66x2_dcd4944b-e7b7-4ac3-9a34-fa2b6462643d/prometheus-operator/0.log" Jun 10 13:23:43.361702 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:43.361677 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-b66x2_dcd4944b-e7b7-4ac3-9a34-fa2b6462643d/kube-rbac-proxy/0.log" Jun 10 13:23:43.391305 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:43.391279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-f6gv4_ed4b8356-57d5-4253-8e51-64f75dc8f6a2/prometheus-operator-admission-webhook/0.log" Jun 10 13:23:44.948885 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:44.948857 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-kr2sf_06e3fb06-22ad-4a36-81d6-7e813018a906/networking-console-plugin/0.log" Jun 10 13:23:45.008387 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.008355 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc"] Jun 10 13:23:45.008956 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.008929 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f0b23a-a1ee-4e46-8dc0-95b47533dd8f" containerName="cleanup" Jun 10 13:23:45.008956 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.008952 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f0b23a-a1ee-4e46-8dc0-95b47533dd8f" containerName="cleanup" Jun 10 13:23:45.009142 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.009033 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f0b23a-a1ee-4e46-8dc0-95b47533dd8f" containerName="cleanup" Jun 10 13:23:45.012064 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.012048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.015037 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.015016 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh2q6\"/\"kube-root-ca.crt\"" Jun 10 13:23:45.015995 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.015978 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh2q6\"/\"default-dockercfg-bn54t\"" Jun 10 13:23:45.016045 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.015981 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh2q6\"/\"openshift-service-ca.crt\"" Jun 10 13:23:45.025987 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.025964 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc"] Jun 10 13:23:45.111361 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.111332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4tzz\" (UniqueName: \"kubernetes.io/projected/637e701f-4f95-4549-b09f-e977d3f7e39e-kube-api-access-h4tzz\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.111495 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.111373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-lib-modules\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.111495 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.111398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-podres\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.111588 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.111494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-proc\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.111588 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.111540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-sys\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212565 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4tzz\" (UniqueName: \"kubernetes.io/projected/637e701f-4f95-4549-b09f-e977d3f7e39e-kube-api-access-h4tzz\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212565 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-lib-modules\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212565 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-podres\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-podres\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212735 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-lib-modules\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-proc\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212813 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-sys\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212918 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212807 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-proc\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.212918 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.212901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/637e701f-4f95-4549-b09f-e977d3f7e39e-sys\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.223960 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.223939 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4tzz\" (UniqueName: \"kubernetes.io/projected/637e701f-4f95-4549-b09f-e977d3f7e39e-kube-api-access-h4tzz\") pod \"perf-node-gather-daemonset-b8cjc\" (UID: \"637e701f-4f95-4549-b09f-e977d3f7e39e\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.322174 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.322148 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:45.460400 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.460375 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc"] Jun 10 13:23:45.461744 ip-10-0-128-233 kubenswrapper[2561]: W0610 13:23:45.461719 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod637e701f_4f95_4549_b09f_e977d3f7e39e.slice/crio-6e8414ab963597cf641ead0215c729a1f978e98e0129a350d813f0d10a637297 WatchSource:0}: Error finding container 6e8414ab963597cf641ead0215c729a1f978e98e0129a350d813f0d10a637297: Status 404 returned error can't find the container with id 6e8414ab963597cf641ead0215c729a1f978e98e0129a350d813f0d10a637297 Jun 10 13:23:45.716388 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.716317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/1.log" Jun 10 13:23:45.721089 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:45.721070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5x5xx_e0d942a6-c8db-4c8e-b405-3a1a7e0a4379/console-operator/2.log" Jun 10 13:23:46.080508 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:46.080471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" event={"ID":"637e701f-4f95-4549-b09f-e977d3f7e39e","Type":"ContainerStarted","Data":"67ccf632a0ebb9bcf4364dba425b3e18b265bf466c4ffa6ee208192e62d375e7"} Jun 10 13:23:46.080885 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:46.080661 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:46.080885 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:46.080707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" event={"ID":"637e701f-4f95-4549-b09f-e977d3f7e39e","Type":"ContainerStarted","Data":"6e8414ab963597cf641ead0215c729a1f978e98e0129a350d813f0d10a637297"} Jun 10 13:23:46.102473 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:46.102429 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" podStartSLOduration=2.102417047 podStartE2EDuration="2.102417047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:23:46.09850198 +0000 UTC m=+1376.040515190" watchObservedRunningTime="2026-06-10 13:23:46.102417047 +0000 UTC m=+1376.044430296" Jun 10 13:23:46.274461 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:46.274427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-845bb65c6f-mgjxz_ee3ae7c0-a8b0-4c03-95c0-84db59d634e0/console/0.log" Jun 10 13:23:46.307525 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:46.307498 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-5qblf_a065cfcd-7862-474c-9f98-07c050d8542b/download-server/0.log" Jun 10 13:23:48.181888 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:48.181851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rrr2b_7f66a153-b726-44e3-bdd2-c2cedaea9151/dns/0.log" Jun 10 13:23:48.210203 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:48.210180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rrr2b_7f66a153-b726-44e3-bdd2-c2cedaea9151/kube-rbac-proxy/0.log" Jun 10 13:23:48.268943 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:48.268915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcnp9_c9e4f1e4-ad30-4373-94df-80c9fe81a36f/dns-node-resolver/0.log" Jun 10 13:23:48.892280 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:48.892254 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df4744d49-7fpnj_e62268f7-5d33-419f-b9a1-832ddaebcd15/registry/0.log" Jun 10 13:23:48.961455 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:48.961427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cbs6f_095e9e21-d6d2-4d98-a61d-2722143b78ef/node-ca/0.log" Jun 10 13:23:50.192086 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:50.192055 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7pzh6_0667a56d-b0fe-437f-83f6-360b8143e719/discovery/0.log" Jun 10 13:23:50.294232 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:50.294204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-768f854844-p7ntm_e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc/kube-auth-proxy/0.log" Jun 10 13:23:50.596455 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:50.596420 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b685c9fc-qrkrx_0c0b04d6-e894-41b6-995c-ff572033d287/router/0.log" Jun 10 13:23:51.336376 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:51.336345 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4z7vv_2183d0bd-df11-46bb-993f-1930c57a9be8/serve-healthcheck-canary/0.log" Jun 10 13:23:52.096489 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:52.096460 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-b8cjc" Jun 10 13:23:52.145658 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:52.145598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4qw9d_baa26f6d-3ab4-498f-86b4-9ad68af49da2/insights-operator/0.log" Jun 10 13:23:52.145877 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:52.145821 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4qw9d_baa26f6d-3ab4-498f-86b4-9ad68af49da2/insights-operator/1.log" Jun 10 13:23:52.361377 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:52.361304 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st45b_23ae59c2-fb0f-49a1-9a87-6a640bb3acfe/kube-rbac-proxy/0.log" Jun 10 13:23:52.390209 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:52.390182 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st45b_23ae59c2-fb0f-49a1-9a87-6a640bb3acfe/exporter/0.log" Jun 10 13:23:52.425751 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:52.425728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st45b_23ae59c2-fb0f-49a1-9a87-6a640bb3acfe/extractor/0.log" Jun 10 13:23:55.427557 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.427533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f476bfb57-txcc5_34a77f14-c380-4fb8-a6fb-286b2e02dc26/nginx/0.log" Jun 10 13:23:55.471639 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.471615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bs5t2_7d65e7bc-78d0-4b52-ac18-c0dd29040d8f/manager/0.log" Jun 10 13:23:55.548818 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.548795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lrmnf_97d3adb7-8d65-4a1c-8570-50c5f82b171e/manager/0.log" Jun 10 13:23:55.616774 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.616704 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684955-ldvnf_61f0b23a-a1ee-4e46-8dc0-95b47533dd8f/cleanup/0.log" Jun 10 13:23:55.703630 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.703609 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-b44b2_76ebe1de-7523-4f25-859d-91ccbb1bd98b/server/0.log" Jun 10 13:23:55.769214 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.769190 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-rqhm9_4fcc392a-1239-416a-84ad-cb8bd9d4e843/manager/0.log" Jun 10 13:23:55.804322 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.804298 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt_ade955df-24a1-4388-be7e-2924a9251afa/manager/0.log" Jun 10 13:23:55.831204 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:55.831184 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-jnlnt_ade955df-24a1-4388-be7e-2924a9251afa/copy-manifests/0.log" Jun 10 13:23:59.282140 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:59.282104 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7pzh6_0667a56d-b0fe-437f-83f6-360b8143e719/discovery/0.log" Jun 10 13:23:59.324594 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:59.324564 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-768f854844-p7ntm_e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc/kube-auth-proxy/0.log" Jun 10 13:23:59.438411 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:23:59.438383 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b685c9fc-qrkrx_0c0b04d6-e894-41b6-995c-ff572033d287/router/0.log" Jun 10 13:24:00.566161 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:24:00.566137 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7pzh6_0667a56d-b0fe-437f-83f6-360b8143e719/discovery/0.log" Jun 10 13:24:00.620613 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:24:00.620588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-768f854844-p7ntm_e8ff0b9d-f3a5-4890-9ac7-c5efc1142dcc/kube-auth-proxy/0.log" Jun 10 13:24:00.781258 ip-10-0-128-233 kubenswrapper[2561]: I0610 13:24:00.781233 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b685c9fc-qrkrx_0c0b04d6-e894-41b6-995c-ff572033d287/router/0.log"