Jun 05 13:06:38.903396 ip-10-0-141-220 systemd[1]: Starting Kubernetes Kubelet... Jun 05 13:06:39.261925 ip-10-0-141-220 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:06:39.261925 ip-10-0-141-220 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 13:06:39.261925 ip-10-0-141-220 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:06:39.261925 ip-10-0-141-220 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 13:06:39.261925 ip-10-0-141-220 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:06:39.263948 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.263797 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 13:06:39.271595 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271561 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:06:39.271595 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271595 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:06:39.271595 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271599 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271602 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271606 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271609 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271613 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271616 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271619 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271623 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271626 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271629 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271634 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271637 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271640 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271642 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271645 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271647 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271650 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271653 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271656 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271659 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:06:39.271717 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271661 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271664 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271667 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271670 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271673 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271675 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271679 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271681 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271684 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271687 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271689 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271692 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271695 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271697 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271702 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271705 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271708 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271711 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271715 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:06:39.272239 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271718 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271723 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271728 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271731 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271736 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271739 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271742 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271745 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271751 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271754 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271757 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271760 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271763 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271765 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271769 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271772 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271775 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271778 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271781 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:06:39.272736 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271783 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271786 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271789 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271792 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271794 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271797 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271800 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271804 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271809 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271812 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271815 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271818 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271821 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271824 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271827 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271831 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271835 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271838 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271841 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:06:39.273297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271844 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271848 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271851 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271854 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271856 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271859 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271862 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271865 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271868 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271870 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271873 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271876 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271878 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271882 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271885 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271887 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271890 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271893 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.271912 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272744 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:06:39.273774 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272754 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272758 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272761 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272764 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272767 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272770 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272773 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272776 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272780 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272783 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272786 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272788 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272791 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272795 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272797 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272802 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272806 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272809 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272812 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:06:39.274344 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272815 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272817 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272820 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272823 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272826 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272830 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272834 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272837 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272840 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272844 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272848 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272852 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272855 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272859 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272863 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272866 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272868 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272871 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272874 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:06:39.274824 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272877 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272880 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272882 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272886 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272889 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272892 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272915 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272919 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272923 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272927 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272930 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272935 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272939 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272945 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272949 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272952 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272955 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272958 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272960 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272963 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:06:39.275335 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272966 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272969 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272971 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272974 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272977 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272980 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272984 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272987 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272990 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272993 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272996 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.272999 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273003 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273005 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273008 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273010 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273014 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273017 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273019 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:06:39.275861 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273022 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273024 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273027 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273030 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273033 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273035 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273037 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273041 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273043 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273046 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273049 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273051 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273054 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273057 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273060 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273062 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273065 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273068 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273070 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273073 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:06:39.276391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273077 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273534 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273540 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273543 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273546 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273549 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273552 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273554 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273557 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273561 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273565 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273567 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273570 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273573 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273576 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273578 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273581 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273584 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273586 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:06:39.276924 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273589 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273594 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273598 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273601 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273604 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273607 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273611 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273614 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273617 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273619 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273629 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273632 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273636 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273638 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273641 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273644 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273646 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273649 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273652 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:06:39.277417 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273654 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273657 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273660 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273662 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273666 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273669 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273671 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273675 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273677 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273680 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273683 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273687 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273690 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273693 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273696 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273699 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273702 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273705 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273707 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273710 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:06:39.277916 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273713 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273715 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273718 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273722 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273725 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273729 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273733 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273736 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273739 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273742 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273746 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273752 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273755 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273757 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273760 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273763 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273766 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273769 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273771 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:06:39.278445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273774 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273776 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273779 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273782 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273785 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273788 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273791 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273794 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273796 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273799 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273802 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273804 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273807 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273810 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273812 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273817 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273820 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273828 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273831 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273834 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:06:39.278956 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273837 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.273840 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273954 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273966 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273973 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273978 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273984 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273987 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273992 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.273997 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274002 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274006 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274010 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274014 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274018 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274021 2572 flags.go:64] FLAG: --cgroup-root="" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274024 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274027 2572 flags.go:64] FLAG: --client-ca-file="" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274030 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274034 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274039 2572 flags.go:64] FLAG: --cluster-domain="" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274042 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274046 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274049 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 13:06:39.279500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274052 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274056 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274059 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274065 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274068 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274074 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274077 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274080 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274084 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274087 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274092 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274095 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274098 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274102 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274105 2572 flags.go:64] FLAG: --enable-server="true" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274108 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274113 2572 flags.go:64] FLAG: --event-burst="100" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274116 2572 flags.go:64] FLAG: --event-qps="50" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274119 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274123 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274127 2572 flags.go:64] FLAG: --eviction-hard="" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274131 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274134 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274137 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274141 2572 flags.go:64] FLAG: --eviction-soft="" Jun 05 13:06:39.280113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274143 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274146 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274150 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274152 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274156 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274159 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274162 2572 flags.go:64] FLAG: --feature-gates="" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274166 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274169 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274173 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274178 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274181 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274186 2572 flags.go:64] FLAG: --help="false" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274190 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274193 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274197 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274200 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274203 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274207 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274210 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274214 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274217 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274220 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 13:06:39.280719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274223 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274226 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274229 2572 flags.go:64] FLAG: --kube-reserved="" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274232 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274243 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274247 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274251 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274254 2572 flags.go:64] FLAG: --lock-file="" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274257 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274260 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274264 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274269 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274273 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274276 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274279 2572 flags.go:64] FLAG: --logging-format="text" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274282 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274286 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274289 2572 flags.go:64] FLAG: --manifest-url="" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274292 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274299 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274303 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274309 2572 flags.go:64] FLAG: --max-pods="110" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274312 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274315 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274318 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 13:06:39.281381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274322 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274325 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274328 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274331 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274340 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274344 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274347 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274350 2572 flags.go:64] FLAG: --pod-cidr="" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274354 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274360 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274363 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274367 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274371 2572 flags.go:64] FLAG: --port="10250" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274374 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274377 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f9daa07c49bb5dc0" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274381 2572 flags.go:64] FLAG: --qos-reserved="" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274384 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274387 2572 flags.go:64] FLAG: --register-node="true" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274390 2572 flags.go:64] FLAG: --register-with-taints="" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274394 2572 flags.go:64] FLAG: --registry-burst="10" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274396 2572 flags.go:64] FLAG: --registry-qps="5" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274399 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274403 2572 flags.go:64] FLAG: --reserved-memory="" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274406 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274410 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 13:06:39.282058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274412 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274415 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274420 2572 flags.go:64] FLAG: --runonce="false" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274425 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274428 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274432 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274435 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274438 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274441 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274444 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274447 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274450 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274453 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274456 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274459 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274463 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274465 2572 flags.go:64] FLAG: --system-cgroups="" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274469 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274474 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274477 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274482 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274487 2572 flags.go:64] FLAG: --tls-min-version="" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274489 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274493 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274495 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 13:06:39.282731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274498 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274501 2572 flags.go:64] FLAG: --v="2" Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274506 2572 flags.go:64] FLAG: --version="false" Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274510 2572 flags.go:64] FLAG: --vmodule="" Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274514 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274517 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274653 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274657 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274661 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274666 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274671 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274674 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274676 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274679 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274682 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274685 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274688 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274691 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274694 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274697 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274700 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:06:39.283374 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274703 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274705 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274708 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274711 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274714 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274717 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274719 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274723 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274726 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274729 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274732 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274735 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274738 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274741 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274745 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274749 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274752 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274756 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274759 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274762 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:06:39.283891 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274767 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274772 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274774 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274778 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274781 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274784 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274786 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274789 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274792 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274795 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274798 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274801 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274803 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274806 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274809 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274811 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274814 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274817 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274820 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274822 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:06:39.284504 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274826 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274830 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274834 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274837 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274841 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274844 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274847 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274849 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274852 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274855 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274857 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274860 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274864 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274868 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274871 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274873 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274876 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274879 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274882 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:06:39.285028 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274884 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274887 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274890 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274892 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274912 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274915 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274918 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274921 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274924 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274927 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274930 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274932 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274935 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274938 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274942 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274945 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274947 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274951 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274955 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:06:39.285520 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274958 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274961 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274964 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274966 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274969 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.274971 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.274982 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.282863 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.282888 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.283564 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.283578 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283647 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283652 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283657 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283660 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:06:39.286020 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283664 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283668 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283673 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283676 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283679 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283682 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283685 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283688 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283691 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283694 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283697 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283700 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283703 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283705 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283708 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283711 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283713 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283716 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283719 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:06:39.286403 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283721 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283724 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283727 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283729 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283732 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283734 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283739 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283743 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283745 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283748 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283751 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283754 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283757 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283760 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283762 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283765 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283768 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283770 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283773 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283775 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:06:39.286874 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283778 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283781 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283783 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283786 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283788 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283791 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283793 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283796 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283798 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283801 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283803 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283806 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283809 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283811 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283815 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283818 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283821 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283824 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283827 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283831 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:06:39.287424 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283834 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283836 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283839 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283841 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283844 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283846 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283849 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283851 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283854 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283856 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283860 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283865 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283868 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283871 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283874 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283876 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283880 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283883 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283886 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:06:39.288022 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283889 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283892 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283915 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283919 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283923 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283926 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283929 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283932 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283935 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283937 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283941 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283944 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283947 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283952 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283956 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283959 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:06:39.288535 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.283962 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.283967 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284093 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284100 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284103 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284106 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284109 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284112 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284115 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284118 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284121 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284123 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284126 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284129 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284133 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:06:39.288961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284137 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284141 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284143 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284147 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284149 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284153 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284156 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284159 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284162 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284165 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284169 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284174 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284177 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284181 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284183 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284187 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284190 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284193 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284196 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:06:39.289366 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284198 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284201 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284204 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284206 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284209 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284212 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284214 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284217 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284220 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284223 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284225 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284228 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284230 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284233 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284235 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284238 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284240 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284243 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284245 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284248 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:06:39.289842 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284251 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284253 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284256 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284259 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284262 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284265 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284267 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284270 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284273 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284276 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284278 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284281 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284283 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284286 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284288 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284291 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284293 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284296 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284298 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:06:39.290342 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284301 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284304 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284307 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284310 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284312 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284315 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284317 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284320 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284322 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284325 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284327 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284330 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284333 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284335 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284338 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284340 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284343 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284345 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284348 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284351 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:06:39.290845 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284353 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284356 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284359 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284361 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284364 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284366 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284369 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:39.284371 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.284376 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.284531 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.286703 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.287946 2572 server.go:1019] "Starting client certificate rotation" Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.288459 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:06:39.291575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.288503 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:06:39.292259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.290484 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:06:39.296189 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.296158 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:06:39.305000 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.304971 2572 log.go:25] "Validated CRI v1 runtime API" Jun 05 13:06:39.307749 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.307727 2572 log.go:25] "Validated CRI v1 image API" Jun 05 13:06:39.310607 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.310587 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 13:06:39.312796 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.312769 2572 fs.go:135] Filesystem UUIDs: map[330d123b-1314-4d6c-881b-5abc3223867c:/dev/nvme0n1p4 5afbcc96-943d-434a-8b72-ed7bc40b7cae:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 05 13:06:39.312922 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.312795 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 13:06:39.318064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.317911 2572 manager.go:216] Machine: {Timestamp:2026-06-05 13:06:39.316749387 +0000 UTC m=+0.300606164 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101573 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24d69b8895adec408fe154a6c1b9cd SystemUUID:ec24d69b-8895-adec-408f-e154a6c1b9cd BootID:fcebf350-aaa3-4e8e-a055-621fd9a5f003 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:f0:b9:cb:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:f0:b9:cb:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:06:a8:75:85:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 13:06:39.318064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.318056 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 13:06:39.318207 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.318160 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 13:06:39.320763 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.320728 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 13:06:39.320846 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.320747 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:06:39.321008 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.320771 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 13:06:39.321548 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.321535 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 13:06:39.321587 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.321551 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 13:06:39.321587 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.321560 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:06:39.322238 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.322226 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:06:39.323161 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.323149 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 13:06:39.325983 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.325968 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:06:39.326119 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326110 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 13:06:39.326160 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326143 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 05 13:06:39.326209 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326179 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 13:06:39.326209 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326194 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 13:06:39.326209 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326205 2572 kubelet.go:398] "Adding apiserver pod source" Jun 05 13:06:39.326323 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326224 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 13:06:39.326610 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326599 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:06:39.326648 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.326619 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:06:39.328559 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.328527 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 13:06:39.330573 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.330558 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 13:06:39.330617 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.330591 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 13:06:39.331704 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331687 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331706 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331716 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331725 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331735 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331741 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331749 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331754 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331762 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331768 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 13:06:39.331772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331777 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 13:06:39.332190 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.331782 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 13:06:39.332442 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.332432 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 13:06:39.332442 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.332442 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 13:06:39.336094 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.336075 2572 server.go:1268] "Started kubelet" Jun 05 13:06:39.339245 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.336192 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 13:06:39.339647 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.336182 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 13:06:39.339751 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.339678 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 13:06:39.340185 ip-10-0-141-220 systemd[1]: Started Kubernetes Kubelet. Jun 05 13:06:39.342057 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.342040 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 13:06:39.342810 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.342792 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 05 13:06:39.343366 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.343336 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:06:39.343478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.343459 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:06:39.343738 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.343685 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:06:39.345810 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.344976 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-220.ec2.internal.18b631335c778710 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-220.ec2.internal,UID:ip-10-0-141-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-220.ec2.internal,},FirstTimestamp:2026-06-05 13:06:39.336040208 +0000 UTC m=+0.319896983,LastTimestamp:2026-06-05 13:06:39.336040208 +0000 UTC m=+0.319896983,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-220.ec2.internal,}" Jun 05 13:06:39.347554 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.347534 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 13:06:39.348130 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.348112 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5r9f" Jun 05 13:06:39.348452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.348439 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 13:06:39.348513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.348455 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 13:06:39.348561 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.348510 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.349043 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349012 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 13:06:39.349043 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349043 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 13:06:39.349165 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349013 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 13:06:39.349229 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349205 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 05 13:06:39.349229 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349214 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 05 13:06:39.349359 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349341 2572 factory.go:55] Registering systemd factory Jun 05 13:06:39.349436 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349363 2572 factory.go:223] Registration of the systemd container factory successfully Jun 05 13:06:39.349607 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349591 2572 factory.go:153] Registering CRI-O factory Jun 05 13:06:39.349607 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349605 2572 factory.go:223] Registration of the crio container factory successfully Jun 05 13:06:39.349748 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349663 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 13:06:39.349748 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349688 2572 factory.go:103] Registering Raw factory Jun 05 13:06:39.349748 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.349702 2572 manager.go:1196] Started watching for new ooms in manager Jun 05 13:06:39.350063 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.350039 2572 manager.go:349] Starting recovery of all containers Jun 05 13:06:39.356651 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.356621 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:06:39.356753 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.356652 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 13:06:39.357040 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.357020 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5r9f" Jun 05 13:06:39.360355 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.360337 2572 manager.go:354] Recovery completed Jun 05 13:06:39.364488 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.364474 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.367242 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.366577 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.367242 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.366612 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.367242 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.366625 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.368009 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.367991 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 13:06:39.368087 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.368018 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 13:06:39.368087 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.368036 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:06:39.368278 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.368021 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.368833 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.368819 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.368914 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.368845 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.368914 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.368859 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.369097 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.369086 2572 policy_none.go:49] "None policy: Start" Jun 05 13:06:39.369126 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.369106 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 13:06:39.369126 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.369118 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 13:06:39.370025 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.370005 2572 policy_none.go:47] "Start" Jun 05 13:06:39.370925 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.370157 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-220.ec2.internal.18b631335e49c265 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-220.ec2.internal,UID:ip-10-0-141-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-220.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-220.ec2.internal,},FirstTimestamp:2026-06-05 13:06:39.366595173 +0000 UTC m=+0.350451954,LastTimestamp:2026-06-05 13:06:39.366595173 +0000 UTC m=+0.350451954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-220.ec2.internal,}" Jun 05 13:06:39.403563 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.403547 2572 manager.go:337] "Starting Device Plugin manager" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.403583 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.403592 2572 server.go:87] "Starting device plugin registration server" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.403864 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.403876 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.403957 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.404059 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.404068 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.404655 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 13:06:39.414157 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.404715 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.415563 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.415536 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 13:06:39.416757 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.416735 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 13:06:39.416870 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.416773 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 13:06:39.416870 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.416796 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 13:06:39.416998 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.416951 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 13:06:39.419398 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.419380 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:06:39.504482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.504450 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.505489 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.505469 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.505606 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.505505 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.505606 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.505520 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.505606 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.505548 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.514576 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.514517 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.514576 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.514545 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-220.ec2.internal\": node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.517379 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.517359 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"] Jun 05 13:06:39.517451 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.517429 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.518806 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.518787 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.518923 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.518823 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.518923 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.518840 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.519998 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.519983 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.520102 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520084 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.520148 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520118 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.520829 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520806 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.520934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520833 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.520934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520843 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.520934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520862 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.520934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520882 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.520934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.520891 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.521927 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.521913 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.521975 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.521940 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:06:39.522641 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.522623 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:06:39.522717 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.522657 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:06:39.522717 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.522673 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:06:39.533922 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.533892 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.544823 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.544790 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.549344 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.549325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6892776a89a7df1dd50690bde7a62ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"e6892776a89a7df1dd50690bde7a62ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.549439 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.549351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6892776a89a7df1dd50690bde7a62ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"e6892776a89a7df1dd50690bde7a62ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.549439 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.549362 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.549439 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.549368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf824754e7c0786db2cfcf0384e43bd7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"bf824754e7c0786db2cfcf0384e43bd7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.634575 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.634539 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.649496 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.649467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6892776a89a7df1dd50690bde7a62ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"e6892776a89a7df1dd50690bde7a62ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.649496 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.649498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6892776a89a7df1dd50690bde7a62ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"e6892776a89a7df1dd50690bde7a62ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.649667 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.649520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf824754e7c0786db2cfcf0384e43bd7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"bf824754e7c0786db2cfcf0384e43bd7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.649667 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.649567 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6892776a89a7df1dd50690bde7a62ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"e6892776a89a7df1dd50690bde7a62ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.649667 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.649617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf824754e7c0786db2cfcf0384e43bd7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"bf824754e7c0786db2cfcf0384e43bd7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.649667 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.649567 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6892776a89a7df1dd50690bde7a62ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"e6892776a89a7df1dd50690bde7a62ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.735169 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.735119 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.836004 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.835883 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:39.849090 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.849044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.854150 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:39.854001 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" Jun 05 13:06:39.936434 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:39.936203 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:40.036831 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.036795 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:40.137523 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.137434 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:40.226118 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.226088 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:06:40.237555 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.237524 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found" Jun 05 13:06:40.286065 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.286033 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:06:40.288039 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.288016 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 13:06:40.288203 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.288138 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:06:40.288203 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.288181 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:06:40.327366 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.327334 2572 apiserver.go:52] "Watching apiserver" Jun 05 13:06:40.349431 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.349383 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" Jun 05 13:06:40.349431 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.349417 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 13:06:40.350444 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.350419 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 13:06:40.352522 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.352494 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jksxg","kube-system/konnectivity-agent-lfrq2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f","openshift-multus/network-metrics-daemon-dvkfr","openshift-ovn-kubernetes/ovnkube-node-66cs7","openshift-cluster-node-tuning-operator/tuned-mr9vp","openshift-dns/node-resolver-cjbt9","openshift-image-registry/node-ca-mm8w9","openshift-multus/multus-additional-cni-plugins-v2xqv","openshift-multus/multus-gxqx2","openshift-network-diagnostics/network-check-target-x978v","openshift-network-operator/iptables-alerter-w8g8k"] Jun 05 13:06:40.355345 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.355319 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.355457 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.355422 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:40.356885 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.356867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.358908 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.358869 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.359026 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.359005 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:06:40.359026 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.359019 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 13:06:40.359105 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.359029 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 13:06:40.359140 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.359030 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kzs24\"" Jun 05 13:06:40.359307 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.359273 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 13:01:39 +0000 UTC" deadline="2028-02-21 15:56:51.129168432 +0000 UTC" Jun 05 13:06:40.359345 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.359307 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15026h50m10.769863924s" Jun 05 13:06:40.360664 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.360650 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:40.360782 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.360705 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:40.360842 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.360833 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.361417 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.361398 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:06:40.361487 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.361472 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" Jun 05 13:06:40.361685 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.361671 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.361757 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.361736 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fzmm7\"" Jun 05 13:06:40.362054 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.362038 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 13:06:40.362746 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.362730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.364684 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.364636 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 13:06:40.364790 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.364697 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.364790 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.364741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.365008 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.364806 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 13:06:40.365008 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.364812 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.365165 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.365150 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 13:06:40.365276 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.365259 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 13:06:40.365374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.365345 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zxj8g\"" Jun 05 13:06:40.366731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.366715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.367423 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.367404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6wvgk\"" Jun 05 13:06:40.368280 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.368265 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.368623 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.368606 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:06:40.368824 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.368806 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.368988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.368961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5mcn\"" Jun 05 13:06:40.369093 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.369076 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.369180 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.369166 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.369320 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.369304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.371293 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.371276 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.371511 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.371498 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.371655 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.371643 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 13:06:40.371800 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.371785 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t77w7\"" Jun 05 13:06:40.372146 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.372133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.374560 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.374161 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.374560 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.374379 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 13:06:40.374560 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.374464 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.374735 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.374578 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 13:06:40.376122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.374950 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.376122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.375044 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 13:06:40.376122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.375332 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qm9mx\"" Jun 05 13:06:40.377037 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.377022 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t7gsw\"" Jun 05 13:06:40.377118 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.377023 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 13:06:40.377302 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.377290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:40.377364 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.377348 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:40.379529 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.379512 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"] Jun 05 13:06:40.379604 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.379547 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"] Jun 05 13:06:40.379659 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.379617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.381525 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.381510 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tjh25\"" Jun 05 13:06:40.381612 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.381542 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:06:40.381713 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.381698 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 13:06:40.382094 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.382074 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 13:06:40.388720 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.388632 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjbfp" Jun 05 13:06:40.397552 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.397530 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjbfp" Jun 05 13:06:40.450369 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.450338 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 13:06:40.451362 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.451332 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf824754e7c0786db2cfcf0384e43bd7.slice/crio-e6ed5e87fdf39bba98d2bd594f346fa04facdbb69b5b83cdd3562dca47bebf9e WatchSource:0}: Error finding container e6ed5e87fdf39bba98d2bd594f346fa04facdbb69b5b83cdd3562dca47bebf9e: Status 404 returned error can't find the container with id e6ed5e87fdf39bba98d2bd594f346fa04facdbb69b5b83cdd3562dca47bebf9e Jun 05 13:06:40.451634 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.451611 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6892776a89a7df1dd50690bde7a62ce.slice/crio-a57abb1412eed645aec661bbae03823c91a7d490d5fc7993f30eb2ed5a5f7c49 WatchSource:0}: Error finding container a57abb1412eed645aec661bbae03823c91a7d490d5fc7993f30eb2ed5a5f7c49: Status 404 returned error can't find the container with id a57abb1412eed645aec661bbae03823c91a7d490d5fc7993f30eb2ed5a5f7c49 Jun 05 13:06:40.454020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.453995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-hostroot\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.454101 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-cni-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.454101 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454051 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-node-log\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-system-cni-dir\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-k8s-cni-cncf-io\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-run\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-hosts-file\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2p7m\" (UniqueName: \"kubernetes.io/projected/b6770372-7615-4e55-ba8e-ddb1c8975233-kube-api-access-j2p7m\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.454259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11a43761-8917-4579-a7b0-fbb50e25c616-agent-certs\") pod \"konnectivity-agent-lfrq2\" (UID: \"11a43761-8917-4579-a7b0-fbb50e25c616\") " pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-socket-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-device-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-serviceca\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-sys-fs\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysctl-conf\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mjqk\" (UniqueName: \"kubernetes.io/projected/b38b9222-0c0a-47a3-95ee-b988e8004af2-kube-api-access-6mjqk\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-socket-dir-parent\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-log-socket\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.454584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-systemd\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-lib-modules\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-os-release\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-os-release\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-netns\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-ovnkube-script-lib\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysconfig\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysctl-d\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d0f661f-33c1-4b02-8972-379dff5652d4-dbus\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-host\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bv7l\" (UniqueName: \"kubernetes.io/projected/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-kube-api-access-7bv7l\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.454978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cnibin\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-daemon-config\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-slash\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.455047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455047 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-etc-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-ovn\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-env-overrides\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjc7\" (UniqueName: \"kubernetes.io/projected/647a70be-d842-462d-b7f6-f80b7c147f1f-kube-api-access-wpjc7\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455186 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-728rb\" (UniqueName: \"kubernetes.io/projected/b31ac62d-8004-4921-90f5-b172299b0402-kube-api-access-728rb\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-multus-certs\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-cni-multus\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-tmp-dir\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swk8g\" (UniqueName: \"kubernetes.io/projected/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-kube-api-access-swk8g\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6770372-7615-4e55-ba8e-ddb1c8975233-iptables-alerter-script\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11a43761-8917-4579-a7b0-fbb50e25c616-konnectivity-ca\") pod \"konnectivity-agent-lfrq2\" (UID: \"11a43761-8917-4579-a7b0-fbb50e25c616\") " pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455463 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-etc-selinux\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6770372-7615-4e55-ba8e-ddb1c8975233-host-slash\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-registration-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.455758 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-kubelet\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-systemd-units\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-run-netns\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-var-lib-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-ovnkube-config\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/647a70be-d842-462d-b7f6-f80b7c147f1f-ovn-node-metrics-cert\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.455968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/955b2493-914b-4b5a-ab32-e0e79ef4fef2-cni-binary-copy\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-cni-bin\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbw9c\" (UniqueName: \"kubernetes.io/projected/955b2493-914b-4b5a-ab32-e0e79ef4fef2-kube-api-access-bbw9c\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-systemd\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-cni-bin\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-kubelet\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-cnibin\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456678 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.456765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-host\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b31ac62d-8004-4921-90f5-b172299b0402-etc-tuned\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456818 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngp5\" (UniqueName: \"kubernetes.io/projected/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-kube-api-access-pngp5\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-conf-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-modprobe-d\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-sys\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-var-lib-kubelet\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b31ac62d-8004-4921-90f5-b172299b0402-tmp\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456957 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d0f661f-33c1-4b02-8972-379dff5652d4-kubelet-config\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-system-cni-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-etc-kubernetes\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.456956 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.457009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-cni-netd\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.457028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-kubernetes\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.457052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.457581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.457084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf6jf\" (UniqueName: \"kubernetes.io/projected/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-kube-api-access-zf6jf\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.542609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.542577 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:06:40.558098 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-cnibin\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558098 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558182 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-cnibin\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-host\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b31ac62d-8004-4921-90f5-b172299b0402-etc-tuned\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngp5\" (UniqueName: \"kubernetes.io/projected/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-kube-api-access-pngp5\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.558275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-conf-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-modprobe-d\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-sys\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558305 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-var-lib-kubelet\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558350 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-host\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558377 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-sys\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558376 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-conf-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b31ac62d-8004-4921-90f5-b172299b0402-tmp\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558380 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-var-lib-kubelet\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d0f661f-33c1-4b02-8972-379dff5652d4-kubelet-config\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558464 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-modprobe-d\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-system-cni-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d0f661f-33c1-4b02-8972-379dff5652d4-kubelet-config\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-system-cni-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558523 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-etc-kubernetes\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-cni-netd\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.558569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-kubernetes\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-etc-kubernetes\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-cni-netd\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf6jf\" (UniqueName: \"kubernetes.io/projected/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-kube-api-access-zf6jf\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-kubernetes\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558653 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-hostroot\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-cni-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-hostroot\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-node-log\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558725 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-cni-dir\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-system-cni-dir\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-k8s-cni-cncf-io\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-node-log\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-run\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.559365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558821 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-system-cni-dir\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558834 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-hosts-file\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-k8s-cni-cncf-io\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2p7m\" (UniqueName: \"kubernetes.io/projected/b6770372-7615-4e55-ba8e-ddb1c8975233-kube-api-access-j2p7m\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11a43761-8917-4579-a7b0-fbb50e25c616-agent-certs\") pod \"konnectivity-agent-lfrq2\" (UID: \"11a43761-8917-4579-a7b0-fbb50e25c616\") " pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-run\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558883 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-hosts-file\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-socket-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-device-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.558998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-serviceca\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-sys-fs\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-socket-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559087 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-device-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysctl-conf\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mjqk\" (UniqueName: \"kubernetes.io/projected/b38b9222-0c0a-47a3-95ee-b988e8004af2-kube-api-access-6mjqk\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.560212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-socket-dir-parent\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-log-socket\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-systemd\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-lib-modules\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-os-release\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-os-release\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559326 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-netns\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-ovnkube-script-lib\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559363 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559395 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-systemd\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559456 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-serviceca\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysconfig\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysctl-d\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559499 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-os-release\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.559599 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:40.561017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-sys-fs\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.559659 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:41.059640161 +0000 UTC m=+2.043496945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559644 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d0f661f-33c1-4b02-8972-379dff5652d4-dbus\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559599 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d0f661f-33c1-4b02-8972-379dff5652d4-dbus\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-host\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559707 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-os-release\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bv7l\" (UniqueName: \"kubernetes.io/projected/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-kube-api-access-7bv7l\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559750 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-log-socket\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cnibin\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-daemon-config\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559602 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-lib-modules\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559838 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-ovnkube-script-lib\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysctl-conf\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559876 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-slash\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysconfig\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559915 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-netns\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559830 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-slash\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.562615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-etc-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-ovn\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-host\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559951 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-socket-dir-parent\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.559999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-env-overrides\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b31ac62d-8004-4921-90f5-b172299b0402-etc-sysctl-d\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjc7\" (UniqueName: \"kubernetes.io/projected/647a70be-d842-462d-b7f6-f80b7c147f1f-kube-api-access-wpjc7\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-728rb\" (UniqueName: \"kubernetes.io/projected/b31ac62d-8004-4921-90f5-b172299b0402-kube-api-access-728rb\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cnibin\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-multus-certs\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560149 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-cni-multus\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-tmp-dir\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560195 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swk8g\" (UniqueName: \"kubernetes.io/projected/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-kube-api-access-swk8g\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6770372-7615-4e55-ba8e-ddb1c8975233-iptables-alerter-script\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11a43761-8917-4579-a7b0-fbb50e25c616-konnectivity-ca\") pod \"konnectivity-agent-lfrq2\" (UID: \"11a43761-8917-4579-a7b0-fbb50e25c616\") " pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-etc-selinux\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.563395 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6770372-7615-4e55-ba8e-ddb1c8975233-host-slash\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-registration-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-kubelet\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-systemd-units\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560445 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-run-netns\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-env-overrides\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-var-lib-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-etc-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-ovn\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560562 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-run-netns\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-run-multus-certs\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560612 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-kubelet\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-registration-dir\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6770372-7615-4e55-ba8e-ddb1c8975233-host-slash\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.563991 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560657 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-systemd-units\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-ovnkube-config\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-var-lib-openvswitch\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/647a70be-d842-462d-b7f6-f80b7c147f1f-ovn-node-metrics-cert\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/955b2493-914b-4b5a-ab32-e0e79ef4fef2-cni-binary-copy\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-cni-bin\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbw9c\" (UniqueName: \"kubernetes.io/projected/955b2493-914b-4b5a-ab32-e0e79ef4fef2-kube-api-access-bbw9c\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560834 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-systemd\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-cni-bin\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6770372-7615-4e55-ba8e-ddb1c8975233-iptables-alerter-script\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-kubelet\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/955b2493-914b-4b5a-ab32-e0e79ef4fef2-multus-daemon-config\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.560946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-cni-bin\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561002 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-cni-bin\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561038 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-run-systemd\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11a43761-8917-4579-a7b0-fbb50e25c616-konnectivity-ca\") pod \"konnectivity-agent-lfrq2\" (UID: \"11a43761-8917-4579-a7b0-fbb50e25c616\") " pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.564478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561126 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647a70be-d842-462d-b7f6-f80b7c147f1f-host-run-ovn-kubernetes\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561143 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b38b9222-0c0a-47a3-95ee-b988e8004af2-etc-selinux\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.561154 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561156 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561184 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-kubelet\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/647a70be-d842-462d-b7f6-f80b7c147f1f-ovnkube-config\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.561216 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:41.061197476 +0000 UTC m=+2.045054250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/955b2493-914b-4b5a-ab32-e0e79ef4fef2-host-var-lib-cni-multus\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.561313 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-tmp-dir\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.562170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/955b2493-914b-4b5a-ab32-e0e79ef4fef2-cni-binary-copy\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.562747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11a43761-8917-4579-a7b0-fbb50e25c616-agent-certs\") pod \"konnectivity-agent-lfrq2\" (UID: \"11a43761-8917-4579-a7b0-fbb50e25c616\") " pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.562933 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b31ac62d-8004-4921-90f5-b172299b0402-tmp\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.563356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b31ac62d-8004-4921-90f5-b172299b0402-etc-tuned\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.565199 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.563621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/647a70be-d842-462d-b7f6-f80b7c147f1f-ovn-node-metrics-cert\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.566708 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.566684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngp5\" (UniqueName: \"kubernetes.io/projected/40a7be71-9efb-4e62-a1fe-157ac9b83cbf-kube-api-access-pngp5\") pod \"multus-additional-cni-plugins-v2xqv\" (UID: \"40a7be71-9efb-4e62-a1fe-157ac9b83cbf\") " pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.566708 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.566698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf6jf\" (UniqueName: \"kubernetes.io/projected/0729fc09-a1b6-4791-bcc3-ab3b8f8666bf-kube-api-access-zf6jf\") pod \"node-resolver-cjbt9\" (UID: \"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf\") " pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.569354 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.569043 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:06:40.569354 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.569071 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:06:40.569354 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.569089 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:40.569354 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:40.569149 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:41.069130479 +0000 UTC m=+2.052987262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:40.569354 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.569157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bv7l\" (UniqueName: \"kubernetes.io/projected/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-kube-api-access-7bv7l\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:40.570989 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.570964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjc7\" (UniqueName: \"kubernetes.io/projected/647a70be-d842-462d-b7f6-f80b7c147f1f-kube-api-access-wpjc7\") pod \"ovnkube-node-66cs7\" (UID: \"647a70be-d842-462d-b7f6-f80b7c147f1f\") " pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.571296 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.571273 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-728rb\" (UniqueName: \"kubernetes.io/projected/b31ac62d-8004-4921-90f5-b172299b0402-kube-api-access-728rb\") pod \"tuned-mr9vp\" (UID: \"b31ac62d-8004-4921-90f5-b172299b0402\") " pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.571494 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.571476 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swk8g\" (UniqueName: \"kubernetes.io/projected/6f22c6a9-c23d-47ae-8341-b43c65f5e50d-kube-api-access-swk8g\") pod \"node-ca-mm8w9\" (UID: \"6f22c6a9-c23d-47ae-8341-b43c65f5e50d\") " pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.571547 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.571479 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2p7m\" (UniqueName: \"kubernetes.io/projected/b6770372-7615-4e55-ba8e-ddb1c8975233-kube-api-access-j2p7m\") pod \"iptables-alerter-w8g8k\" (UID: \"b6770372-7615-4e55-ba8e-ddb1c8975233\") " pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.571852 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.571835 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbw9c\" (UniqueName: \"kubernetes.io/projected/955b2493-914b-4b5a-ab32-e0e79ef4fef2-kube-api-access-bbw9c\") pod \"multus-gxqx2\" (UID: \"955b2493-914b-4b5a-ab32-e0e79ef4fef2\") " pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.571946 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.571889 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mjqk\" (UniqueName: \"kubernetes.io/projected/b38b9222-0c0a-47a3-95ee-b988e8004af2-kube-api-access-6mjqk\") pod \"aws-ebs-csi-driver-node-84p6f\" (UID: \"b38b9222-0c0a-47a3-95ee-b988e8004af2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.680154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.680059 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:06:40.691219 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.691191 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a43761_8917_4579_a7b0_fbb50e25c616.slice/crio-7aa2ee48ab55f215c91f856bfddbbcda5ec9d290a1f12c8fa19360b5e687dabd WatchSource:0}: Error finding container 7aa2ee48ab55f215c91f856bfddbbcda5ec9d290a1f12c8fa19360b5e687dabd: Status 404 returned error can't find the container with id 7aa2ee48ab55f215c91f856bfddbbcda5ec9d290a1f12c8fa19360b5e687dabd Jun 05 13:06:40.696960 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.696938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" Jun 05 13:06:40.705291 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.705263 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38b9222_0c0a_47a3_95ee_b988e8004af2.slice/crio-099542e0e23e16423432d41738e20f8460d59a79f6d5415139cf234c5894f8db WatchSource:0}: Error finding container 099542e0e23e16423432d41738e20f8460d59a79f6d5415139cf234c5894f8db: Status 404 returned error can't find the container with id 099542e0e23e16423432d41738e20f8460d59a79f6d5415139cf234c5894f8db Jun 05 13:06:40.720624 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.720596 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:06:40.723451 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.723425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" Jun 05 13:06:40.731354 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.731329 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647a70be_d842_462d_b7f6_f80b7c147f1f.slice/crio-9e815ba794baa8ba54ab039b036a983219ec918a4fedff24010a2d9597ec4345 WatchSource:0}: Error finding container 9e815ba794baa8ba54ab039b036a983219ec918a4fedff24010a2d9597ec4345: Status 404 returned error can't find the container with id 9e815ba794baa8ba54ab039b036a983219ec918a4fedff24010a2d9597ec4345 Jun 05 13:06:40.733320 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.733294 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31ac62d_8004_4921_90f5_b172299b0402.slice/crio-858444ca25c96a5fabd39b319fea79b4cb16256bfab9e0c7e4c489920c200139 WatchSource:0}: Error finding container 858444ca25c96a5fabd39b319fea79b4cb16256bfab9e0c7e4c489920c200139: Status 404 returned error can't find the container with id 858444ca25c96a5fabd39b319fea79b4cb16256bfab9e0c7e4c489920c200139 Jun 05 13:06:40.752997 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.752966 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjbt9" Jun 05 13:06:40.758707 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.758678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mm8w9" Jun 05 13:06:40.762553 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.762528 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0729fc09_a1b6_4791_bcc3_ab3b8f8666bf.slice/crio-ff336b9f8b00ca80474ee4a1eb8b14f12ee88440a524d9d98420113f02c4fc3d WatchSource:0}: Error finding container ff336b9f8b00ca80474ee4a1eb8b14f12ee88440a524d9d98420113f02c4fc3d: Status 404 returned error can't find the container with id ff336b9f8b00ca80474ee4a1eb8b14f12ee88440a524d9d98420113f02c4fc3d Jun 05 13:06:40.764064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.764046 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" Jun 05 13:06:40.767572 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.767549 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f22c6a9_c23d_47ae_8341_b43c65f5e50d.slice/crio-7bebca3d8de22624812af7c6cbc5486bab0b688aaa570ae3fa943f4d70b9426a WatchSource:0}: Error finding container 7bebca3d8de22624812af7c6cbc5486bab0b688aaa570ae3fa943f4d70b9426a: Status 404 returned error can't find the container with id 7bebca3d8de22624812af7c6cbc5486bab0b688aaa570ae3fa943f4d70b9426a Jun 05 13:06:40.772161 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.772140 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxqx2" Jun 05 13:06:40.774034 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.774005 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a7be71_9efb_4e62_a1fe_157ac9b83cbf.slice/crio-800628d26a7c9cde04fcab8353d20d0a99a885524ffec8b81d319fbba3beb3d7 WatchSource:0}: Error finding container 800628d26a7c9cde04fcab8353d20d0a99a885524ffec8b81d319fbba3beb3d7: Status 404 returned error can't find the container with id 800628d26a7c9cde04fcab8353d20d0a99a885524ffec8b81d319fbba3beb3d7 Jun 05 13:06:40.778350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:40.778327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w8g8k" Jun 05 13:06:40.781391 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.781364 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955b2493_914b_4b5a_ab32_e0e79ef4fef2.slice/crio-aeb5c12d225d1dc56b3e9a04301d3df5f378f82f05386f1c8e618e8bb79d754f WatchSource:0}: Error finding container aeb5c12d225d1dc56b3e9a04301d3df5f378f82f05386f1c8e618e8bb79d754f: Status 404 returned error can't find the container with id aeb5c12d225d1dc56b3e9a04301d3df5f378f82f05386f1c8e618e8bb79d754f Jun 05 13:06:40.788244 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:06:40.788221 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6770372_7615_4e55_ba8e_ddb1c8975233.slice/crio-339e0362659d22629b58c9c30435fc9437d3918f0576abc0273cdbb36285fa71 WatchSource:0}: Error finding container 339e0362659d22629b58c9c30435fc9437d3918f0576abc0273cdbb36285fa71: Status 404 returned error can't find the container with id 339e0362659d22629b58c9c30435fc9437d3918f0576abc0273cdbb36285fa71 Jun 05 13:06:41.064732 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.064570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:41.064732 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.064655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:41.064970 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.064741 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:41.064970 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.064802 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:42.064783953 +0000 UTC m=+3.048640733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:41.064970 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.064739 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:41.065136 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.064982 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:42.064964865 +0000 UTC m=+3.048821631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:41.165514 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.165474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:41.165704 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.165687 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:06:41.165767 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.165716 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:06:41.165767 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.165730 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:41.165871 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:41.165791 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:42.165770857 +0000 UTC m=+3.149627626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:41.394549 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.394269 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:06:41.401371 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.401249 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 13:01:40 +0000 UTC" deadline="2027-12-05 05:34:32.592354434 +0000 UTC" Jun 05 13:06:41.401371 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.401310 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13144h27m51.191048869s" Jun 05 13:06:41.448810 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.448741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lfrq2" event={"ID":"11a43761-8917-4579-a7b0-fbb50e25c616","Type":"ContainerStarted","Data":"7aa2ee48ab55f215c91f856bfddbbcda5ec9d290a1f12c8fa19360b5e687dabd"} Jun 05 13:06:41.463802 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.463765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"bf824754e7c0786db2cfcf0384e43bd7","Type":"ContainerStarted","Data":"e6ed5e87fdf39bba98d2bd594f346fa04facdbb69b5b83cdd3562dca47bebf9e"} Jun 05 13:06:41.488487 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.488430 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxqx2" event={"ID":"955b2493-914b-4b5a-ab32-e0e79ef4fef2","Type":"ContainerStarted","Data":"aeb5c12d225d1dc56b3e9a04301d3df5f378f82f05386f1c8e618e8bb79d754f"} Jun 05 13:06:41.511465 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.511412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerStarted","Data":"800628d26a7c9cde04fcab8353d20d0a99a885524ffec8b81d319fbba3beb3d7"} Jun 05 13:06:41.529044 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.528947 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mm8w9" event={"ID":"6f22c6a9-c23d-47ae-8341-b43c65f5e50d","Type":"ContainerStarted","Data":"7bebca3d8de22624812af7c6cbc5486bab0b688aaa570ae3fa943f4d70b9426a"} Jun 05 13:06:41.542969 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.542917 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"9e815ba794baa8ba54ab039b036a983219ec918a4fedff24010a2d9597ec4345"} Jun 05 13:06:41.553183 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.553052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" event={"ID":"b38b9222-0c0a-47a3-95ee-b988e8004af2","Type":"ContainerStarted","Data":"099542e0e23e16423432d41738e20f8460d59a79f6d5415139cf234c5894f8db"} Jun 05 13:06:41.569560 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.569511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"e6892776a89a7df1dd50690bde7a62ce","Type":"ContainerStarted","Data":"a57abb1412eed645aec661bbae03823c91a7d490d5fc7993f30eb2ed5a5f7c49"} Jun 05 13:06:41.577348 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.577303 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w8g8k" event={"ID":"b6770372-7615-4e55-ba8e-ddb1c8975233","Type":"ContainerStarted","Data":"339e0362659d22629b58c9c30435fc9437d3918f0576abc0273cdbb36285fa71"} Jun 05 13:06:41.587858 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.587804 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjbt9" event={"ID":"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf","Type":"ContainerStarted","Data":"ff336b9f8b00ca80474ee4a1eb8b14f12ee88440a524d9d98420113f02c4fc3d"} Jun 05 13:06:41.605923 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.605754 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" event={"ID":"b31ac62d-8004-4921-90f5-b172299b0402","Type":"ContainerStarted","Data":"858444ca25c96a5fabd39b319fea79b4cb16256bfab9e0c7e4c489920c200139"} Jun 05 13:06:41.924231 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:41.924193 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:06:42.072774 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.072735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:42.073061 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.072810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:42.073061 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.072970 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:42.073061 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.073036 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:44.073017755 +0000 UTC m=+5.056874536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:42.073484 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.073462 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:42.073574 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.073521 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:44.073506647 +0000 UTC m=+5.057363413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:42.173439 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.173369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:42.173724 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.173665 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:06:42.173724 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.173693 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:06:42.173724 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.173712 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:42.173927 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.173799 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:44.173772309 +0000 UTC m=+5.157629075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:42.401889 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.401774 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 13:01:40 +0000 UTC" deadline="2027-11-24 10:38:57.703837442 +0000 UTC" Jun 05 13:06:42.401889 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.401828 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12885h32m15.302015822s" Jun 05 13:06:42.417445 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.417404 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:42.417445 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.417434 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:42.417723 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:42.417392 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:42.417723 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.417576 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:42.417723 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.417610 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:42.417723 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:42.417672 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:44.088449 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:44.088402 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:44.089022 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:44.088486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:44.089022 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.088621 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:44.089022 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.088685 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:48.088664744 +0000 UTC m=+9.072521530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:44.089242 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.089190 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:44.089292 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.089258 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:48.089240015 +0000 UTC m=+9.073096802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:44.189251 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:44.189186 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:44.189532 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.189434 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:06:44.189606 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.189463 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:06:44.189606 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.189587 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:44.189759 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.189740 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:48.189697601 +0000 UTC m=+9.173554420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:44.417615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:44.417510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:44.417816 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.417666 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:44.418200 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:44.418174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:44.418329 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.418305 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:44.418417 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:44.418402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:44.418514 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:44.418496 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:46.417112 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:46.417072 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:46.417112 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:46.417102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:46.417653 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:46.417076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:46.417653 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:46.417254 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:46.417653 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:46.417431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:46.417653 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:46.417543 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:48.120634 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:48.120580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:48.121247 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:48.120694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:48.121247 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.120826 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:48.121247 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.120879 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:48.121247 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.120927 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:56.120889354 +0000 UTC m=+17.104746120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:48.121247 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.120959 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:56.120948375 +0000 UTC m=+17.104805138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:48.222109 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:48.222067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:48.222324 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.222251 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:06:48.222324 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.222275 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:06:48.222324 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.222285 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:48.222447 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.222350 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:06:56.222333066 +0000 UTC m=+17.206189838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:48.417780 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:48.417702 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:48.417780 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:48.417757 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:48.418008 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:48.417829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:48.418008 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.417848 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:48.418008 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.417942 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:48.418162 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:48.418046 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:50.417743 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:50.417657 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:50.417743 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:50.417688 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:50.418249 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:50.417801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:50.418249 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:50.417800 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:50.418249 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:50.417918 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:50.418249 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:50.418005 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:52.417215 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:52.417133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:52.417668 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:52.417277 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:52.417668 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:52.417134 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:52.417668 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:52.417133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:52.417668 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:52.417386 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:52.417668 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:52.417496 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:54.417934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:54.417888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:54.418381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:54.417888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:54.418381 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:54.418020 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:54.418381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:54.417889 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:54.418381 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:54.418139 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:54.418381 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:54.418181 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:56.187762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:56.187725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:56.188362 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:56.187811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:56.188362 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.187879 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:56.188362 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.187969 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:56.188362 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.187984 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:12.187958784 +0000 UTC m=+33.171815549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:06:56.188362 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.188026 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:12.188007756 +0000 UTC m=+33.171864535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:06:56.288922 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:56.288804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:56.289090 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.288990 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:06:56.289090 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.289011 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:06:56.289090 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.289023 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:56.289275 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.289094 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:12.289075547 +0000 UTC m=+33.272932324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:06:56.417350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:56.417314 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:56.417350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:56.417342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:56.417612 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:56.417444 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:56.417612 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.417454 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:56.417612 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.417572 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:06:56.417761 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:56.417656 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:58.417623 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:58.417576 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:06:58.417623 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:58.417614 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:06:58.418271 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:06:58.417618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:06:58.418271 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:58.417726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:06:58.418271 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:58.417807 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:06:58.418271 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:06:58.417876 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:00.417709 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:00.417659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:00.417709 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:00.417701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:00.417709 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:00.417716 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:00.418192 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:00.417797 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:00.418192 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:00.417876 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:00.418192 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:00.417977 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:01.654482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.654265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxqx2" event={"ID":"955b2493-914b-4b5a-ab32-e0e79ef4fef2","Type":"ContainerStarted","Data":"c1f01f844f13f59ce530b6526936e9f7ddb59c5db27cc624f8bce1d017c901c6"} Jun 05 13:07:01.660656 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.658111 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:07:01.661058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.660928 2572 generic.go:356] "Generic (PLEG): container finished" podID="647a70be-d842-462d-b7f6-f80b7c147f1f" containerID="8d7d7c02c6da3007bba046bfe64fa048570ac85651d990e197e766ed472cec0b" exitCode=1 Jun 05 13:07:01.661058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.660931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"aae8d33412994c5e980beb9485522a51ac631bb55fa9086e493256ab830e68aa"} Jun 05 13:07:01.661227 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.661090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"bfca00a296f75ba9d7289364713dded49f941b2f179f90b58bf0bf450c80f77e"} Jun 05 13:07:01.661227 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.661194 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"2b2e6625388e2111ea8629aa49cafec37a03b967ef8cdb37ad8fd352c5c37d55"} Jun 05 13:07:01.661331 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.661275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerDied","Data":"8d7d7c02c6da3007bba046bfe64fa048570ac85651d990e197e766ed472cec0b"} Jun 05 13:07:01.661703 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.661681 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"08e3769ea5f10fcaeb57c33945e189440b01611ff74b64c451fa5a252eab33e6"} Jun 05 13:07:01.663110 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.663083 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" event={"ID":"b31ac62d-8004-4921-90f5-b172299b0402","Type":"ContainerStarted","Data":"cf3c5474ca4942ca0eb96d5cc2f669136d4ee2aea5d8871f893d093a6eb45b67"} Jun 05 13:07:01.664711 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.664656 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"bf824754e7c0786db2cfcf0384e43bd7","Type":"ContainerStarted","Data":"a4c1481d3fd5970972bc8e012e9f5632407407b393dfa4517177b90e58d51833"} Jun 05 13:07:01.692982 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.692934 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gxqx2" podStartSLOduration=2.751004229 podStartE2EDuration="22.692917862s" totalImagesPullingTime="19.941913633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:01.678424749 +0000 UTC m=+22.662281533" watchObservedRunningTime="2026-06-05 13:07:01.692917862 +0000 UTC m=+22.676774647" Jun 05 13:07:01.693164 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.693114 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" podStartSLOduration=21.69310906 podStartE2EDuration="21.69310906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:01.691937362 +0000 UTC m=+22.675794147" watchObservedRunningTime="2026-06-05 13:07:01.69310906 +0000 UTC m=+22.676965844" Jun 05 13:07:01.715409 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:01.715357 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mr9vp" podStartSLOduration=2.763131294 podStartE2EDuration="22.715338514s" totalImagesPullingTime="19.95220722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:01.714798401 +0000 UTC m=+22.698655185" watchObservedRunningTime="2026-06-05 13:07:01.715338514 +0000 UTC m=+22.699195298" Jun 05 13:07:02.417539 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.417412 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:02.417700 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:02.417569 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:02.417700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.417637 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:02.417819 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:02.417715 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:02.417819 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.417764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:02.417950 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:02.417835 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:02.668220 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.668130 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lfrq2" event={"ID":"11a43761-8917-4579-a7b0-fbb50e25c616","Type":"ContainerStarted","Data":"bf303390e5e152a04bed52e1558f85ad0bf29181537d2aa470f0f095988fd5c2"} Jun 05 13:07:02.669850 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.669823 2572 generic.go:356] "Generic (PLEG): container finished" podID="40a7be71-9efb-4e62-a1fe-157ac9b83cbf" containerID="d680875c294140cd8c923d4d3d1e9c0d64098539a66f213d45a74d9bc0856ca9" exitCode=0 Jun 05 13:07:02.669976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.669930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerDied","Data":"d680875c294140cd8c923d4d3d1e9c0d64098539a66f213d45a74d9bc0856ca9"} Jun 05 13:07:02.671407 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.671379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mm8w9" event={"ID":"6f22c6a9-c23d-47ae-8341-b43c65f5e50d","Type":"ContainerStarted","Data":"01c6f9f441c67902040d9e0b13fdb6e5e944f2c9190aae83444e98258ee1c850"} Jun 05 13:07:02.674384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.674366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:07:02.674793 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.674765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"a2c8e81d7228183ea84a13789f3bd701985aab4f9b6a80465563d538ecc35cb2"} Jun 05 13:07:02.676166 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.676145 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" event={"ID":"b38b9222-0c0a-47a3-95ee-b988e8004af2","Type":"ContainerStarted","Data":"fc2c32fa5abcc78e737b2544347f505f9e6b67bb22b508dfeeb9d8e30ffe83ef"} Jun 05 13:07:02.677555 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.677525 2572 generic.go:356] "Generic (PLEG): container finished" podID="e6892776a89a7df1dd50690bde7a62ce" containerID="52530455bf0b7275c226b7acceb9aac66e01bf339b8d3b2dcf8a64a691005e77" exitCode=0 Jun 05 13:07:02.677653 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.677597 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"e6892776a89a7df1dd50690bde7a62ce","Type":"ContainerDied","Data":"52530455bf0b7275c226b7acceb9aac66e01bf339b8d3b2dcf8a64a691005e77"} Jun 05 13:07:02.679011 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.678987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w8g8k" event={"ID":"b6770372-7615-4e55-ba8e-ddb1c8975233","Type":"ContainerStarted","Data":"b018f6199b2e7cad77223dcfd9a7a3bcad2561ce4e4aff2280a6eeb0103cf7f4"} Jun 05 13:07:02.680273 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.680251 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjbt9" event={"ID":"0729fc09-a1b6-4791-bcc3-ab3b8f8666bf","Type":"ContainerStarted","Data":"8239c523ccd8daa404155e7b39e81fd1fa4ebf4613b5fafc97726f7673fbad4f"} Jun 05 13:07:02.682807 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.682767 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lfrq2" podStartSLOduration=3.688345456 podStartE2EDuration="23.682754967s" totalImagesPullingTime="19.994409511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:02.682504022 +0000 UTC m=+23.666360808" watchObservedRunningTime="2026-06-05 13:07:02.682754967 +0000 UTC m=+23.666611751" Jun 05 13:07:02.718362 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.718309 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mm8w9" podStartSLOduration=3.800963791 podStartE2EDuration="23.718291313s" totalImagesPullingTime="19.917327522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:02.697248501 +0000 UTC m=+23.681105287" watchObservedRunningTime="2026-06-05 13:07:02.718291313 +0000 UTC m=+23.702148155" Jun 05 13:07:02.749720 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.749456 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w8g8k" podStartSLOduration=3.884774537 podStartE2EDuration="23.749432771s" totalImagesPullingTime="19.864658234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:02.73339646 +0000 UTC m=+23.717253247" watchObservedRunningTime="2026-06-05 13:07:02.749432771 +0000 UTC m=+23.733289558" Jun 05 13:07:02.763988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:02.763927 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cjbt9" podStartSLOduration=3.873127262 podStartE2EDuration="23.763885541s" totalImagesPullingTime="19.890758279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:02.763456786 +0000 UTC m=+23.747313573" watchObservedRunningTime="2026-06-05 13:07:02.763885541 +0000 UTC m=+23.747742327" Jun 05 13:07:03.329857 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.329820 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 13:07:03.417851 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.417746 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T13:07:03.329840042Z","UUID":"876f55b8-b13c-408f-b630-ee877156a441","Handler":null,"Name":"","Endpoint":""} Jun 05 13:07:03.419455 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.419431 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 13:07:03.419591 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.419477 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 13:07:03.685190 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.685140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" event={"ID":"b38b9222-0c0a-47a3-95ee-b988e8004af2","Type":"ContainerStarted","Data":"85dbcae45a09066ea8c22dbb05512434c0c732746d8270989614f15bba0b89f7"} Jun 05 13:07:03.688096 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.688064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"e6892776a89a7df1dd50690bde7a62ce","Type":"ContainerStarted","Data":"67d05d77504e10a42f6a98017c73c4a3d87951476f857d08805636b12c76def8"} Jun 05 13:07:03.703597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:03.703534 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" podStartSLOduration=23.703513705 podStartE2EDuration="23.703513705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:03.703250466 +0000 UTC m=+24.687107253" watchObservedRunningTime="2026-06-05 13:07:03.703513705 +0000 UTC m=+24.687370489" Jun 05 13:07:04.417281 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.417181 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:04.417422 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.417298 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:04.417422 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.417315 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:04.417422 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:04.417309 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:04.417422 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:04.417372 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:04.417582 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:04.417453 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:04.693596 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.693527 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:07:04.694193 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.693941 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"cd32b093b7c39bdf778c3c900dccbdc7ae789ffbd1082457f8d25f5bf8d36aaa"} Jun 05 13:07:04.695815 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.695787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" event={"ID":"b38b9222-0c0a-47a3-95ee-b988e8004af2","Type":"ContainerStarted","Data":"fef5122dc6083cbb758978e0d31feca59b9ac2e5cea34f0ce0381bca5bac1dcd"} Jun 05 13:07:04.713399 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:04.713341 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84p6f" podStartSLOduration=4.148044224 podStartE2EDuration="25.713320887s" totalImagesPullingTime="21.565276663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:04.712894362 +0000 UTC m=+25.696751147" watchObservedRunningTime="2026-06-05 13:07:04.713320887 +0000 UTC m=+25.697177674" Jun 05 13:07:06.417304 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:06.417259 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:06.417964 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:06.417304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:06.417964 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:06.417309 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:06.417964 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:06.417391 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:06.417964 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:06.417478 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:06.417964 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:06.417566 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:07.001329 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.001281 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:07:07.006349 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.006309 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:07:07.705363 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.705125 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:07:07.705772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.705713 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"0a52b3d4e042371e56359d7f1f18abf9a39146f8dec22681b58cef62f4ec7e14"} Jun 05 13:07:07.705952 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.705928 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:07:07.706083 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.705995 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:07:07.706321 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.706303 2572 scope.go:117] "RemoveContainer" containerID="8d7d7c02c6da3007bba046bfe64fa048570ac85651d990e197e766ed472cec0b" Jun 05 13:07:07.707845 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.707819 2572 generic.go:356] "Generic (PLEG): container finished" podID="40a7be71-9efb-4e62-a1fe-157ac9b83cbf" containerID="f4dc822ce552fcabaff8d3c958a47ebbb5d897b98c7c5707adf4b92cc51ae7d6" exitCode=0 Jun 05 13:07:07.707981 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.707920 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerDied","Data":"f4dc822ce552fcabaff8d3c958a47ebbb5d897b98c7c5707adf4b92cc51ae7d6"} Jun 05 13:07:07.708040 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.707986 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:07:07.708590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.708572 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lfrq2" Jun 05 13:07:07.724217 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:07.724134 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:07:08.417829 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.417603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:08.418034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.417654 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:08.418034 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:08.417964 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:08.418034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.417688 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:08.418034 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:08.418022 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:08.418283 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:08.418116 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:08.713513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.713397 2572 generic.go:356] "Generic (PLEG): container finished" podID="40a7be71-9efb-4e62-a1fe-157ac9b83cbf" containerID="e2a67f07b705c4eb61d79bf4d0497dfd89f706e39ecdd6ac3adf27ec636accd8" exitCode=0 Jun 05 13:07:08.713513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.713478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerDied","Data":"e2a67f07b705c4eb61d79bf4d0497dfd89f706e39ecdd6ac3adf27ec636accd8"} Jun 05 13:07:08.718304 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.718277 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:07:08.718731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.718703 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" event={"ID":"647a70be-d842-462d-b7f6-f80b7c147f1f","Type":"ContainerStarted","Data":"27a51ca0c87d804110d5a8c836278e3a49f413dfa39186b6814eafeb0f4fb534"} Jun 05 13:07:08.719052 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.719036 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:07:08.735530 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.735499 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:07:08.764430 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:08.764366 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" podStartSLOduration=9.733641732 podStartE2EDuration="29.76434757s" totalImagesPullingTime="20.030705838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:08.763776054 +0000 UTC m=+29.747632842" watchObservedRunningTime="2026-06-05 13:07:08.76434757 +0000 UTC m=+29.748204354" Jun 05 13:07:09.238432 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.238386 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x978v"] Jun 05 13:07:09.238663 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.238562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:09.238726 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:09.238688 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:09.244652 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.244604 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jksxg"] Jun 05 13:07:09.244842 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.244758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:09.244925 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:09.244875 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:09.245529 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.245493 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dvkfr"] Jun 05 13:07:09.245721 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.245607 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:09.245795 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:09.245730 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:09.724000 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.723871 2572 generic.go:356] "Generic (PLEG): container finished" podID="40a7be71-9efb-4e62-a1fe-157ac9b83cbf" containerID="46ebb485223c22ec11114c60ca32127ffb37cc2181c138f6691de82f02ab25dc" exitCode=0 Jun 05 13:07:09.724000 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:09.723970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerDied","Data":"46ebb485223c22ec11114c60ca32127ffb37cc2181c138f6691de82f02ab25dc"} Jun 05 13:07:10.417784 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:10.417308 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:10.417784 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:10.417327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:10.417784 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:10.417448 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:10.417784 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:10.417565 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:11.417520 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:11.417254 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:11.417984 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:11.417659 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:12.215076 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:12.215041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:12.215247 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:12.215113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:12.215247 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.215207 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:07:12.215247 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.215219 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:07:12.215383 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.215275 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:44.215257277 +0000 UTC m=+65.199114057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:07:12.215383 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.215293 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret podName:3d0f661f-33c1-4b02-8972-379dff5652d4 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:44.215283779 +0000 UTC m=+65.199140548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret") pod "global-pull-secret-syncer-jksxg" (UID: "3d0f661f-33c1-4b02-8972-379dff5652d4") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:07:12.315538 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:12.315479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:12.315781 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.315754 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:07:12.315865 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.315790 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:07:12.315865 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.315807 2572 projected.go:196] Error preparing data for projected volume kube-api-access-8vqc8 for pod openshift-network-diagnostics/network-check-target-x978v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:07:12.315969 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.315880 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8 podName:761a2ca4-efba-43bb-94c5-477241af0239 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:44.315857079 +0000 UTC m=+65.299713861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8vqc8" (UniqueName: "kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8") pod "network-check-target-x978v" (UID: "761a2ca4-efba-43bb-94c5-477241af0239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:07:12.417681 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:12.417645 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:12.418164 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:12.417651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:12.418164 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.417800 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x978v" podUID="761a2ca4-efba-43bb-94c5-477241af0239" Jun 05 13:07:12.418164 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:12.417864 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:07:13.417277 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.417238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:13.417485 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:13.417375 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jksxg" podUID="3d0f661f-33c1-4b02-8972-379dff5652d4" Jun 05 13:07:13.872512 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.872481 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeReady" Jun 05 13:07:13.872953 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.872613 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 13:07:13.919474 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.919440 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wxvpw"] Jun 05 13:07:13.922349 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.922270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:13.922487 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.922347 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rwh7x"] Jun 05 13:07:13.924303 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.924270 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 13:07:13.924417 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.924397 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 13:07:13.924706 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.924692 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d25hl\"" Jun 05 13:07:13.925259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.925237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:13.927230 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.927211 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 13:07:13.927551 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.927526 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 13:07:13.927649 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.927612 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ztm5p\"" Jun 05 13:07:13.927711 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.927696 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 13:07:13.935765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.935743 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wxvpw"] Jun 05 13:07:13.936425 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:13.936379 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rwh7x"] Jun 05 13:07:14.029711 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.029670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d722289-5264-41e2-bd1e-57c3684d73e0-tmp-dir\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.029842 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.029718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ca1d20e-34b9-416b-b297-831a956bde72-cert\") pod \"ingress-canary-rwh7x\" (UID: \"2ca1d20e-34b9-416b-b297-831a956bde72\") " pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.029842 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.029752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48fbs\" (UniqueName: \"kubernetes.io/projected/2ca1d20e-34b9-416b-b297-831a956bde72-kube-api-access-48fbs\") pod \"ingress-canary-rwh7x\" (UID: \"2ca1d20e-34b9-416b-b297-831a956bde72\") " pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.029941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.029883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.029975 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.029944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkm2c\" (UniqueName: \"kubernetes.io/projected/3d722289-5264-41e2-bd1e-57c3684d73e0-kube-api-access-vkm2c\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.030011 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.029975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d722289-5264-41e2-bd1e-57c3684d73e0-config-volume\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.131085 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.131206 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkm2c\" (UniqueName: \"kubernetes.io/projected/3d722289-5264-41e2-bd1e-57c3684d73e0-kube-api-access-vkm2c\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.131206 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:14.131183 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:14.131336 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d722289-5264-41e2-bd1e-57c3684d73e0-config-volume\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.131336 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:14.131250 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:14.631234667 +0000 UTC m=+35.615091430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:14.131336 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d722289-5264-41e2-bd1e-57c3684d73e0-tmp-dir\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.131336 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ca1d20e-34b9-416b-b297-831a956bde72-cert\") pod \"ingress-canary-rwh7x\" (UID: \"2ca1d20e-34b9-416b-b297-831a956bde72\") " pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.131471 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48fbs\" (UniqueName: \"kubernetes.io/projected/2ca1d20e-34b9-416b-b297-831a956bde72-kube-api-access-48fbs\") pod \"ingress-canary-rwh7x\" (UID: \"2ca1d20e-34b9-416b-b297-831a956bde72\") " pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.131678 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131657 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d722289-5264-41e2-bd1e-57c3684d73e0-tmp-dir\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.131831 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.131814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d722289-5264-41e2-bd1e-57c3684d73e0-config-volume\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.135344 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.135319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ca1d20e-34b9-416b-b297-831a956bde72-cert\") pod \"ingress-canary-rwh7x\" (UID: \"2ca1d20e-34b9-416b-b297-831a956bde72\") " pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.139838 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.139814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkm2c\" (UniqueName: \"kubernetes.io/projected/3d722289-5264-41e2-bd1e-57c3684d73e0-kube-api-access-vkm2c\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.140391 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.140372 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48fbs\" (UniqueName: \"kubernetes.io/projected/2ca1d20e-34b9-416b-b297-831a956bde72-kube-api-access-48fbs\") pod \"ingress-canary-rwh7x\" (UID: \"2ca1d20e-34b9-416b-b297-831a956bde72\") " pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.242797 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.242764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rwh7x" Jun 05 13:07:14.381431 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.381398 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rwh7x"] Jun 05 13:07:14.387075 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:07:14.387046 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca1d20e_34b9_416b_b297_831a956bde72.slice/crio-123cb7a31a48b142d9113cc4da102d43a1847ccf2a33c65e7616a47810e6a98d WatchSource:0}: Error finding container 123cb7a31a48b142d9113cc4da102d43a1847ccf2a33c65e7616a47810e6a98d: Status 404 returned error can't find the container with id 123cb7a31a48b142d9113cc4da102d43a1847ccf2a33c65e7616a47810e6a98d Jun 05 13:07:14.418076 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.417853 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:14.418226 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.417885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:14.420617 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.420587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:07:14.420730 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.420683 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhxzk\"" Jun 05 13:07:14.420730 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.420692 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:07:14.420730 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.420699 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cph74\"" Jun 05 13:07:14.420877 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.420752 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:07:14.635646 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.635536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:14.635832 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:14.635712 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:14.635832 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:14.635785 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:15.635762916 +0000 UTC m=+36.619619680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:14.740635 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.740600 2572 generic.go:356] "Generic (PLEG): container finished" podID="40a7be71-9efb-4e62-a1fe-157ac9b83cbf" containerID="e70a2271a5c1aa13d73488fafae0f20c3b1c2210aaa102191330b1e36610acb9" exitCode=0 Jun 05 13:07:14.740811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.740683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerDied","Data":"e70a2271a5c1aa13d73488fafae0f20c3b1c2210aaa102191330b1e36610acb9"} Jun 05 13:07:14.742220 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:14.741887 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rwh7x" event={"ID":"2ca1d20e-34b9-416b-b297-831a956bde72","Type":"ContainerStarted","Data":"123cb7a31a48b142d9113cc4da102d43a1847ccf2a33c65e7616a47810e6a98d"} Jun 05 13:07:15.417432 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:15.417394 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:15.419819 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:15.419792 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:07:15.642687 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:15.642637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:15.642848 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:15.642795 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:15.642887 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:15.642861 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:17.642845988 +0000 UTC m=+38.626702751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:15.747709 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:15.747670 2572 generic.go:356] "Generic (PLEG): container finished" podID="40a7be71-9efb-4e62-a1fe-157ac9b83cbf" containerID="314e8fda135a2e4bdc2579a8eaf1c3cc034b7281d933a794e62529b094ccdbe3" exitCode=0 Jun 05 13:07:15.747914 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:15.747754 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerDied","Data":"314e8fda135a2e4bdc2579a8eaf1c3cc034b7281d933a794e62529b094ccdbe3"} Jun 05 13:07:16.360889 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.360850 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp"] Jun 05 13:07:16.376342 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.376306 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp"] Jun 05 13:07:16.376496 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.376427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.378934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.378708 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 13:07:16.378934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.378720 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2kkgz\"" Jun 05 13:07:16.378934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.378792 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 05 13:07:16.379554 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.379517 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 13:07:16.379648 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.379572 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 13:07:16.448827 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.448790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2056b042-0594-418a-94c2-154f96ddfea4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-677795b454-6pxmp\" (UID: \"2056b042-0594-418a-94c2-154f96ddfea4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.449538 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.448943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gp7m\" (UniqueName: \"kubernetes.io/projected/2056b042-0594-418a-94c2-154f96ddfea4-kube-api-access-8gp7m\") pod \"managed-serviceaccount-addon-agent-677795b454-6pxmp\" (UID: \"2056b042-0594-418a-94c2-154f96ddfea4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.549315 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.549272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2056b042-0594-418a-94c2-154f96ddfea4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-677795b454-6pxmp\" (UID: \"2056b042-0594-418a-94c2-154f96ddfea4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.549490 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.549453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gp7m\" (UniqueName: \"kubernetes.io/projected/2056b042-0594-418a-94c2-154f96ddfea4-kube-api-access-8gp7m\") pod \"managed-serviceaccount-addon-agent-677795b454-6pxmp\" (UID: \"2056b042-0594-418a-94c2-154f96ddfea4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.552731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.552702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2056b042-0594-418a-94c2-154f96ddfea4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-677795b454-6pxmp\" (UID: \"2056b042-0594-418a-94c2-154f96ddfea4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.561447 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.561420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gp7m\" (UniqueName: \"kubernetes.io/projected/2056b042-0594-418a-94c2-154f96ddfea4-kube-api-access-8gp7m\") pod \"managed-serviceaccount-addon-agent-677795b454-6pxmp\" (UID: \"2056b042-0594-418a-94c2-154f96ddfea4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.698595 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.698555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:07:16.753965 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.753929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" event={"ID":"40a7be71-9efb-4e62-a1fe-157ac9b83cbf","Type":"ContainerStarted","Data":"30b7842f7197a956e2eccbe326c796c86b19654c72932682654cf7c016947798"} Jun 05 13:07:16.755384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.755354 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rwh7x" event={"ID":"2ca1d20e-34b9-416b-b297-831a956bde72","Type":"ContainerStarted","Data":"f50d1890ac73dc65ebd4a8717c395050a948ca6188e768e2f026e2ae9b8f18c3"} Jun 05 13:07:16.776612 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.776294 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v2xqv" podStartSLOduration=7.961534129 podStartE2EDuration="37.776271112s" totalImagesPullingTime="29.814736983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:16.775621428 +0000 UTC m=+37.759478214" watchObservedRunningTime="2026-06-05 13:07:16.776271112 +0000 UTC m=+37.760127899" Jun 05 13:07:16.790642 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.790501 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rwh7x" podStartSLOduration=1.618316338 podStartE2EDuration="3.790480451s" totalImagesPullingTime="2.172164113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:16.790046295 +0000 UTC m=+37.773903081" watchObservedRunningTime="2026-06-05 13:07:16.790480451 +0000 UTC m=+37.774337236" Jun 05 13:07:16.846671 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:16.846599 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp"] Jun 05 13:07:16.850193 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:07:16.850162 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2056b042_0594_418a_94c2_154f96ddfea4.slice/crio-cebac5243341a662049deed789b4b2ddf275918f744699d59f3bcc699a1fdb02 WatchSource:0}: Error finding container cebac5243341a662049deed789b4b2ddf275918f744699d59f3bcc699a1fdb02: Status 404 returned error can't find the container with id cebac5243341a662049deed789b4b2ddf275918f744699d59f3bcc699a1fdb02 Jun 05 13:07:17.658361 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:17.658322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:17.659035 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:17.658495 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:17.659035 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:17.658577 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:21.658552153 +0000 UTC m=+42.642408933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:17.760262 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:17.760225 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" event={"ID":"2056b042-0594-418a-94c2-154f96ddfea4","Type":"ContainerStarted","Data":"cebac5243341a662049deed789b4b2ddf275918f744699d59f3bcc699a1fdb02"} Jun 05 13:07:20.768829 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:20.768792 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" event={"ID":"2056b042-0594-418a-94c2-154f96ddfea4","Type":"ContainerStarted","Data":"51399b197353d63baa0b03c66a9e052bf1f1f53c9f28b1d5afe58c63a7a849e7"} Jun 05 13:07:20.784778 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:20.784709 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" podStartSLOduration=1.61269187 podStartE2EDuration="4.784688149s" totalImagesPullingTime="3.171996279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:20.784675929 +0000 UTC m=+41.768532714" watchObservedRunningTime="2026-06-05 13:07:20.784688149 +0000 UTC m=+41.768544933" Jun 05 13:07:21.687962 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:21.687920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:21.688142 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:21.688024 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:21.688142 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:21.688084 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:29.688067411 +0000 UTC m=+50.671924182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:29.746740 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:29.746697 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:29.747166 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:29.746817 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:29.747166 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:29.746877 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:07:45.746859605 +0000 UTC m=+66.730716372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:40.737540 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:40.737513 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-66cs7" Jun 05 13:07:44.254942 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.254875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:07:44.255330 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.254973 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:44.257386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.257365 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:07:44.257446 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.257366 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:07:44.265849 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:44.265827 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:07:44.265935 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:44.265923 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:08:48.265887161 +0000 UTC m=+129.249743938 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : secret "metrics-daemon-secret" not found Jun 05 13:07:44.269020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.268989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d0f661f-33c1-4b02-8972-379dff5652d4-original-pull-secret\") pod \"global-pull-secret-syncer-jksxg\" (UID: \"3d0f661f-33c1-4b02-8972-379dff5652d4\") " pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:44.355699 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.355659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:44.358356 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.358334 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:07:44.368692 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.368673 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:07:44.379062 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.379035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vqc8\" (UniqueName: \"kubernetes.io/projected/761a2ca4-efba-43bb-94c5-477241af0239-kube-api-access-8vqc8\") pod \"network-check-target-x978v\" (UID: \"761a2ca4-efba-43bb-94c5-477241af0239\") " pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:44.430975 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.430939 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhxzk\"" Jun 05 13:07:44.439134 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.439107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:44.527676 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.527565 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jksxg" Jun 05 13:07:44.587332 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.587268 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x978v"] Jun 05 13:07:44.593000 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:07:44.592912 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761a2ca4_efba_43bb_94c5_477241af0239.slice/crio-146158dee8c58dcf5c13b6ca0782d1efe08fe945b8cc423dd1b034eeeba80217 WatchSource:0}: Error finding container 146158dee8c58dcf5c13b6ca0782d1efe08fe945b8cc423dd1b034eeeba80217: Status 404 returned error can't find the container with id 146158dee8c58dcf5c13b6ca0782d1efe08fe945b8cc423dd1b034eeeba80217 Jun 05 13:07:44.691302 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.691264 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jksxg"] Jun 05 13:07:44.694917 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:07:44.694872 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0f661f_33c1_4b02_8972_379dff5652d4.slice/crio-7548408b5381ae7d71ecae2642f156e2518e307890a2d1452b0c5f2d4dd591e4 WatchSource:0}: Error finding container 7548408b5381ae7d71ecae2642f156e2518e307890a2d1452b0c5f2d4dd591e4: Status 404 returned error can't find the container with id 7548408b5381ae7d71ecae2642f156e2518e307890a2d1452b0c5f2d4dd591e4 Jun 05 13:07:44.829893 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.829785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jksxg" event={"ID":"3d0f661f-33c1-4b02-8972-379dff5652d4","Type":"ContainerStarted","Data":"7548408b5381ae7d71ecae2642f156e2518e307890a2d1452b0c5f2d4dd591e4"} Jun 05 13:07:44.831101 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:44.831063 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x978v" event={"ID":"761a2ca4-efba-43bb-94c5-477241af0239","Type":"ContainerStarted","Data":"146158dee8c58dcf5c13b6ca0782d1efe08fe945b8cc423dd1b034eeeba80217"} Jun 05 13:07:45.766409 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:45.766342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:07:45.767005 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:45.766576 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:07:45.767005 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:07:45.766677 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:08:17.766652629 +0000 UTC m=+98.750509401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:07:49.845552 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:49.845504 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jksxg" event={"ID":"3d0f661f-33c1-4b02-8972-379dff5652d4","Type":"ContainerStarted","Data":"69dac808067b2b7eb0d59f28e66235a6ce5f61251c90a12325f14ba42aa05d7c"} Jun 05 13:07:49.847002 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:49.846938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x978v" event={"ID":"761a2ca4-efba-43bb-94c5-477241af0239","Type":"ContainerStarted","Data":"cf4669ca81b6ceeb8f89222941e0b1fbab4708f423d4743dd0d9f34fab68a4b5"} Jun 05 13:07:49.847131 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:49.847021 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:07:49.876025 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:49.875973 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jksxg" podStartSLOduration=66.412864231 podStartE2EDuration="1m10.875957959s" totalImagesPullingTime="4.463093728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:49.875161322 +0000 UTC m=+70.859018106" watchObservedRunningTime="2026-06-05 13:07:49.875957959 +0000 UTC m=+70.859814744" Jun 05 13:07:49.896936 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:07:49.896862 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x978v" podStartSLOduration=66.337855779 podStartE2EDuration="1m10.896847037s" totalImagesPullingTime="4.558991258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:07:49.895778023 +0000 UTC m=+70.879634831" watchObservedRunningTime="2026-06-05 13:07:49.896847037 +0000 UTC m=+70.880703821" Jun 05 13:08:17.791094 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:08:17.791053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:08:17.791614 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:08:17.791201 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:08:17.791614 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:08:17.791272 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:21.7912517 +0000 UTC m=+162.775108476 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:08:20.852376 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:08:20.852337 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x978v" Jun 05 13:08:48.309298 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:08:48.309223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:08:48.310035 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:08:48.309433 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:08:48.310035 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:08:48.309518 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs podName:9d2b0510-1fc8-4c93-b85f-2eb9a4453287 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:50.309490639 +0000 UTC m=+251.293347405 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs") pod "network-metrics-daemon-dvkfr" (UID: "9d2b0510-1fc8-4c93-b85f-2eb9a4453287") : secret "metrics-daemon-secret" not found Jun 05 13:09:16.936146 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:16.936099 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wxvpw" podUID="3d722289-5264-41e2-bd1e-57c3684d73e0" Jun 05 13:09:17.070879 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:17.070847 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wxvpw" Jun 05 13:09:17.433674 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:17.433623 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dvkfr" podUID="9d2b0510-1fc8-4c93-b85f-2eb9a4453287" Jun 05 13:09:21.087069 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:21.084127 2572 generic.go:356] "Generic (PLEG): container finished" podID="2056b042-0594-418a-94c2-154f96ddfea4" containerID="51399b197353d63baa0b03c66a9e052bf1f1f53c9f28b1d5afe58c63a7a849e7" exitCode=255 Jun 05 13:09:21.087069 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:21.084246 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" event={"ID":"2056b042-0594-418a-94c2-154f96ddfea4","Type":"ContainerDied","Data":"51399b197353d63baa0b03c66a9e052bf1f1f53c9f28b1d5afe58c63a7a849e7"} Jun 05 13:09:21.094175 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:21.094150 2572 scope.go:117] "RemoveContainer" containerID="51399b197353d63baa0b03c66a9e052bf1f1f53c9f28b1d5afe58c63a7a849e7" Jun 05 13:09:21.844573 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:21.844533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:09:21.844749 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:21.844675 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:09:21.844749 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:21.844731 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls podName:3d722289-5264-41e2-bd1e-57c3684d73e0 nodeName:}" failed. No retries permitted until 2026-06-05 13:11:23.844717234 +0000 UTC m=+284.828574001 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls") pod "dns-default-wxvpw" (UID: "3d722289-5264-41e2-bd1e-57c3684d73e0") : secret "dns-default-metrics-tls" not found Jun 05 13:09:22.089639 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:22.089599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" event={"ID":"2056b042-0594-418a-94c2-154f96ddfea4","Type":"ContainerStarted","Data":"eaaf6f9dd38b128e7589b3910d3a460382766eba8e8e2c36b27588f50c180954"} Jun 05 13:09:32.417144 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:32.417086 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:09:47.830534 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.830503 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f7b8db57c-qvq67"] Jun 05 13:09:47.832454 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.832437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:47.835999 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.835970 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 13:09:47.836593 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.836561 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 13:09:47.836760 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.836739 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 13:09:47.837064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.837042 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 13:09:47.837064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.837059 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 13:09:47.837249 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.837044 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ncsm5\"" Jun 05 13:09:47.837249 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.837049 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 13:09:47.899717 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.899684 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f7b8db57c-qvq67"] Jun 05 13:09:47.903753 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.903727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:47.903886 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.903786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-default-certificate\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:47.903886 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.903818 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-stats-auth\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:47.903886 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.903853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:47.904026 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:47.903916 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5762l\" (UniqueName: \"kubernetes.io/projected/f291c94e-af95-494f-9acc-b33ead60d2aa-kube-api-access-5762l\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.005075 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.005031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.005252 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.005107 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-default-certificate\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.005252 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.005184 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:09:48.005326 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.005253 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:48.505235304 +0000 UTC m=+189.489092067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : secret "router-metrics-certs-default" not found Jun 05 13:09:48.005326 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.005283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-stats-auth\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.005326 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.005319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.005454 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.005340 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5762l\" (UniqueName: \"kubernetes.io/projected/f291c94e-af95-494f-9acc-b33ead60d2aa-kube-api-access-5762l\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.005577 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.005559 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:48.50554197 +0000 UTC m=+189.489398760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : configmap references non-existent config key: service-ca.crt Jun 05 13:09:48.007780 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.007757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-stats-auth\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.007893 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.007813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-default-certificate\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.027781 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.027464 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk"] Jun 05 13:09:48.029438 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.029418 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6"] Jun 05 13:09:48.029574 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.029554 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:48.031284 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.031265 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.032150 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.032125 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"cluster-samples-operator-854f8b96b6-c6bgk\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="c18483c2-1967-4c90-8194-c5fbba4f06b5" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:48.032249 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.032128 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-samples-operator-dockercfg-xnxp2\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xnxp2\"" type="*v1.Secret" Jun 05 13:09:48.034386 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.034355 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" Jun 05 13:09:48.034467 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.034445 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"samples-operator-tls\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" Jun 05 13:09:48.034658 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.034634 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-7rwrl\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7rwrl\"" type="*v1.Secret" Jun 05 13:09:48.040160 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.040130 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:09:48.041746 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.041722 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" Jun 05 13:09:48.042129 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.042106 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:09:48.042460 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.042433 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:09:48.042544 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.042506 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:09:48.062475 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.062446 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5762l\" (UniqueName: \"kubernetes.io/projected/f291c94e-af95-494f-9acc-b33ead60d2aa-kube-api-access-5762l\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.064880 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.064856 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk"] Jun 05 13:09:48.078272 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.078241 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74468489cf-vqsd6"] Jun 05 13:09:48.080360 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.080337 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6"] Jun 05 13:09:48.080477 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.080425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.085557 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.085487 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m678x\"" Jun 05 13:09:48.098396 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.098371 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 13:09:48.098575 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.098499 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 13:09:48.098658 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.098577 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 13:09:48.104421 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.104401 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 13:09:48.105973 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.105953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-image-registry-private-configuration\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106045 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.105980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-installation-pull-secrets\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106045 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbv7l\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-kube-api-access-fbv7l\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106143 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106086 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-bound-sa-token\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106183 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:48.106183 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106270 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/696751f7-e782-47cc-823d-06993fed7b13-ca-trust-extracted\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106270 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-registry-certificates\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106270 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvs9d\" (UniqueName: \"kubernetes.io/projected/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-kube-api-access-xvs9d\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.106366 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.106366 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.106366 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-trusted-ca\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.106366 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.106357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzkb\" (UniqueName: \"kubernetes.io/projected/c18483c2-1967-4c90-8194-c5fbba4f06b5-kube-api-access-6qzkb\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:48.121693 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.121662 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74468489cf-vqsd6"] Jun 05 13:09:48.207263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-bound-sa-token\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207300 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/696751f7-e782-47cc-823d-06993fed7b13-ca-trust-extracted\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207340 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-registry-certificates\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvs9d\" (UniqueName: \"kubernetes.io/projected/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-kube-api-access-xvs9d\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:48.207457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-trusted-ca\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzkb\" (UniqueName: \"kubernetes.io/projected/c18483c2-1967-4c90-8194-c5fbba4f06b5-kube-api-access-6qzkb\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.207479 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.207507 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74468489cf-vqsd6: secret "image-registry-tls" not found Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-image-registry-private-configuration\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-installation-pull-secrets\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.207589 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls podName:696751f7-e782-47cc-823d-06993fed7b13 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:48.707569035 +0000 UTC m=+189.691425818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls") pod "image-registry-74468489cf-vqsd6" (UID: "696751f7-e782-47cc-823d-06993fed7b13") : secret "image-registry-tls" not found Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbv7l\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-kube-api-access-fbv7l\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.207848 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.207765 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/696751f7-e782-47cc-823d-06993fed7b13-ca-trust-extracted\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.208158 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.208137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-registry-certificates\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.208511 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.208491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-trusted-ca\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.210055 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.210034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-image-registry-private-configuration\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.210055 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.210052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-installation-pull-secrets\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.228584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.228558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-bound-sa-token\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.228726 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.228678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbv7l\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-kube-api-access-fbv7l\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.509562 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.509520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.509739 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.509590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:48.509739 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.509681 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:09:48.509739 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.509701 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:49.509682245 +0000 UTC m=+190.493539007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : configmap references non-existent config key: service-ca.crt Jun 05 13:09:48.509739 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.509739 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:49.509725102 +0000 UTC m=+190.493581865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : secret "router-metrics-certs-default" not found Jun 05 13:09:48.711210 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:48.711160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:48.711436 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.711305 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:09:48.711436 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.711323 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74468489cf-vqsd6: secret "image-registry-tls" not found Jun 05 13:09:48.711436 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:48.711379 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls podName:696751f7-e782-47cc-823d-06993fed7b13 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:49.711362358 +0000 UTC m=+190.695219121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls") pod "image-registry-74468489cf-vqsd6" (UID: "696751f7-e782-47cc-823d-06993fed7b13") : secret "image-registry-tls" not found Jun 05 13:09:49.051195 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.051162 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 13:09:49.059756 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.059726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:49.084423 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.084384 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 13:09:49.087663 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.087645 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:09:49.087743 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.087712 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls podName:c18483c2-1967-4c90-8194-c5fbba4f06b5 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:49.5876933 +0000 UTC m=+190.571550064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c6bgk" (UID: "c18483c2-1967-4c90-8194-c5fbba4f06b5") : secret "samples-operator-tls" not found Jun 05 13:09:49.153247 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.153213 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:09:49.165215 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.165182 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 13:09:49.168720 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.168699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:49.172632 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.172613 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 13:09:49.207080 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.207044 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xnxp2\"" Jun 05 13:09:49.220047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.220020 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:09:49.227126 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.227100 2572 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:09:49.227237 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.227138 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6qzkb for pod openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:09:49.227237 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.227193 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c18483c2-1967-4c90-8194-c5fbba4f06b5-kube-api-access-6qzkb podName:c18483c2-1967-4c90-8194-c5fbba4f06b5 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:49.727178385 +0000 UTC m=+190.711035148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6qzkb" (UniqueName: "kubernetes.io/projected/c18483c2-1967-4c90-8194-c5fbba4f06b5-kube-api-access-6qzkb") pod "cluster-samples-operator-854f8b96b6-c6bgk" (UID: "c18483c2-1967-4c90-8194-c5fbba4f06b5") : failed to sync configmap cache: timed out waiting for the condition Jun 05 13:09:49.230827 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.230801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvs9d\" (UniqueName: \"kubernetes.io/projected/4ef624bd-702f-4c4d-95dc-2fffa6fe09ee-kube-api-access-xvs9d\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9jrp6\" (UID: \"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:49.276064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.276025 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7rwrl\"" Jun 05 13:09:49.285985 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.285949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" Jun 05 13:09:49.355576 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.355545 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 13:09:49.429169 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.429130 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6"] Jun 05 13:09:49.434544 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:09:49.434505 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef624bd_702f_4c4d_95dc_2fffa6fe09ee.slice/crio-00f0b400014601d12525965ef676488828a2cbb880f3f52a6362815a94e6c5d2 WatchSource:0}: Error finding container 00f0b400014601d12525965ef676488828a2cbb880f3f52a6362815a94e6c5d2: Status 404 returned error can't find the container with id 00f0b400014601d12525965ef676488828a2cbb880f3f52a6362815a94e6c5d2 Jun 05 13:09:49.517699 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.517654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:49.517863 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.517771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:49.517956 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.517921 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:09:49.517998 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.517962 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:51.517947245 +0000 UTC m=+192.501804007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : configmap references non-existent config key: service-ca.crt Jun 05 13:09:49.517998 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.517981 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:51.517972469 +0000 UTC m=+192.501829231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : secret "router-metrics-certs-default" not found Jun 05 13:09:49.618516 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.618400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:49.618699 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.618566 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:09:49.618699 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.618652 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls podName:c18483c2-1967-4c90-8194-c5fbba4f06b5 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:50.618632405 +0000 UTC m=+191.602489184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c6bgk" (UID: "c18483c2-1967-4c90-8194-c5fbba4f06b5") : secret "samples-operator-tls" not found Jun 05 13:09:49.718922 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.718868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:49.719155 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.719055 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:09:49.719155 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.719079 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74468489cf-vqsd6: secret "image-registry-tls" not found Jun 05 13:09:49.719155 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:49.719146 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls podName:696751f7-e782-47cc-823d-06993fed7b13 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:51.719127643 +0000 UTC m=+192.702984405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls") pod "image-registry-74468489cf-vqsd6" (UID: "696751f7-e782-47cc-823d-06993fed7b13") : secret "image-registry-tls" not found Jun 05 13:09:49.820053 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.819999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzkb\" (UniqueName: \"kubernetes.io/projected/c18483c2-1967-4c90-8194-c5fbba4f06b5-kube-api-access-6qzkb\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:49.823080 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:49.823045 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzkb\" (UniqueName: \"kubernetes.io/projected/c18483c2-1967-4c90-8194-c5fbba4f06b5-kube-api-access-6qzkb\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:50.175743 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:50.175691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" event={"ID":"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee","Type":"ContainerStarted","Data":"00f0b400014601d12525965ef676488828a2cbb880f3f52a6362815a94e6c5d2"} Jun 05 13:09:50.627054 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:50.627003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:50.627270 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:50.627175 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:09:50.627270 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:50.627257 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls podName:c18483c2-1967-4c90-8194-c5fbba4f06b5 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:52.627239576 +0000 UTC m=+193.611096339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c6bgk" (UID: "c18483c2-1967-4c90-8194-c5fbba4f06b5") : secret "samples-operator-tls" not found Jun 05 13:09:51.536189 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:51.536147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:51.536670 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:51.536331 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:55.536308828 +0000 UTC m=+196.520165594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : configmap references non-existent config key: service-ca.crt Jun 05 13:09:51.536670 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:51.536387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:51.536670 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:51.536539 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:09:51.536670 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:51.536605 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:09:55.536590312 +0000 UTC m=+196.520447097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : secret "router-metrics-certs-default" not found Jun 05 13:09:51.738121 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:51.738098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:51.738248 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:51.738236 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:09:51.738285 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:51.738251 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74468489cf-vqsd6: secret "image-registry-tls" not found Jun 05 13:09:51.738317 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:51.738299 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls podName:696751f7-e782-47cc-823d-06993fed7b13 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:55.738283188 +0000 UTC m=+196.722139953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls") pod "image-registry-74468489cf-vqsd6" (UID: "696751f7-e782-47cc-823d-06993fed7b13") : secret "image-registry-tls" not found Jun 05 13:09:52.182974 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:52.182938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" event={"ID":"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee","Type":"ContainerStarted","Data":"3c3afafd34ad0f2d3c47993b2b2faea6d4dbc01c2f2a837cd13712ac61a9011b"} Jun 05 13:09:52.209172 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:52.209117 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" podStartSLOduration=2.95647974 podStartE2EDuration="5.209098425s" totalImagesPullingTime="2.252618685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:09:52.20811248 +0000 UTC m=+193.191969265" watchObservedRunningTime="2026-06-05 13:09:52.209098425 +0000 UTC m=+193.192955211" Jun 05 13:09:52.644515 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:52.644475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:52.644963 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:52.644625 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:09:52.644963 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:52.644684 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls podName:c18483c2-1967-4c90-8194-c5fbba4f06b5 nodeName:}" failed. No retries permitted until 2026-06-05 13:09:56.64467056 +0000 UTC m=+197.628527323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c6bgk" (UID: "c18483c2-1967-4c90-8194-c5fbba4f06b5") : secret "samples-operator-tls" not found Jun 05 13:09:53.530198 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.530160 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g"] Jun 05 13:09:53.532170 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.532153 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" Jun 05 13:09:53.536444 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.536405 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 13:09:53.536444 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.536425 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 13:09:53.536649 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.536506 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-prb5c\"" Jun 05 13:09:53.552142 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.552113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6x9n\" (UniqueName: \"kubernetes.io/projected/95be12bd-9d82-47e5-baf4-9e73f29271a1-kube-api-access-k6x9n\") pod \"migrator-955ffdf5f-5zm5g\" (UID: \"95be12bd-9d82-47e5-baf4-9e73f29271a1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" Jun 05 13:09:53.651892 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.651851 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g"] Jun 05 13:09:53.652984 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.652959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6x9n\" (UniqueName: \"kubernetes.io/projected/95be12bd-9d82-47e5-baf4-9e73f29271a1-kube-api-access-k6x9n\") pod \"migrator-955ffdf5f-5zm5g\" (UID: \"95be12bd-9d82-47e5-baf4-9e73f29271a1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" Jun 05 13:09:53.667988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.667948 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6x9n\" (UniqueName: \"kubernetes.io/projected/95be12bd-9d82-47e5-baf4-9e73f29271a1-kube-api-access-k6x9n\") pod \"migrator-955ffdf5f-5zm5g\" (UID: \"95be12bd-9d82-47e5-baf4-9e73f29271a1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" Jun 05 13:09:53.841508 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.841414 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" Jun 05 13:09:53.997997 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:53.997963 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g"] Jun 05 13:09:54.001237 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:09:54.001201 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95be12bd_9d82_47e5_baf4_9e73f29271a1.slice/crio-4beb47d4495951a5b873c9a870e0753f1e42779212c7191d518b24377c26587e WatchSource:0}: Error finding container 4beb47d4495951a5b873c9a870e0753f1e42779212c7191d518b24377c26587e: Status 404 returned error can't find the container with id 4beb47d4495951a5b873c9a870e0753f1e42779212c7191d518b24377c26587e Jun 05 13:09:54.189929 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:54.189825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" event={"ID":"95be12bd-9d82-47e5-baf4-9e73f29271a1","Type":"ContainerStarted","Data":"4beb47d4495951a5b873c9a870e0753f1e42779212c7191d518b24377c26587e"} Jun 05 13:09:55.569678 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:55.569573 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:55.569678 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:55.569645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:09:55.570110 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:55.569747 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 13:09:55.570110 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:55.569778 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:10:03.569755895 +0000 UTC m=+204.553612678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : configmap references non-existent config key: service-ca.crt Jun 05 13:09:55.570110 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:55.569802 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs podName:f291c94e-af95-494f-9acc-b33ead60d2aa nodeName:}" failed. No retries permitted until 2026-06-05 13:10:03.569789666 +0000 UTC m=+204.553646429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs") pod "router-default-6f7b8db57c-qvq67" (UID: "f291c94e-af95-494f-9acc-b33ead60d2aa") : secret "router-metrics-certs-default" not found Jun 05 13:09:55.770998 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:55.770958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:09:55.771197 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:55.771129 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:09:55.771197 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:55.771155 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74468489cf-vqsd6: secret "image-registry-tls" not found Jun 05 13:09:55.771312 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:55.771217 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls podName:696751f7-e782-47cc-823d-06993fed7b13 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:03.77119974 +0000 UTC m=+204.755056502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls") pod "image-registry-74468489cf-vqsd6" (UID: "696751f7-e782-47cc-823d-06993fed7b13") : secret "image-registry-tls" not found Jun 05 13:09:56.197549 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:56.197513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" event={"ID":"95be12bd-9d82-47e5-baf4-9e73f29271a1","Type":"ContainerStarted","Data":"7fdb4f15569e7f33760817468d95f3a26ad93ad647377464560a7de03deed781"} Jun 05 13:09:56.197753 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:56.197570 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" event={"ID":"95be12bd-9d82-47e5-baf4-9e73f29271a1","Type":"ContainerStarted","Data":"f5e8fa22366b8635f5e53bd086d3ba6bf35f3f7fb07efdfdcbee63b9d79567bd"} Jun 05 13:09:56.233045 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:56.232982 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-5zm5g" podStartSLOduration=1.930178677 podStartE2EDuration="3.232963367s" totalImagesPullingTime="1.30278469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:09:56.232313544 +0000 UTC m=+197.216170329" watchObservedRunningTime="2026-06-05 13:09:56.232963367 +0000 UTC m=+197.216820151" Jun 05 13:09:56.678022 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:56.677977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:09:56.678506 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:56.678138 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 13:09:56.678506 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:09:56.678230 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls podName:c18483c2-1967-4c90-8194-c5fbba4f06b5 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:04.678208358 +0000 UTC m=+205.662065141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c6bgk" (UID: "c18483c2-1967-4c90-8194-c5fbba4f06b5") : secret "samples-operator-tls" not found Jun 05 13:09:56.797333 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:56.797305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjbt9_0729fc09-a1b6-4791-bcc3-ab3b8f8666bf/dns-node-resolver/0.log" Jun 05 13:09:57.395362 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:57.395333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mm8w9_6f22c6a9-c23d-47ae-8341-b43c65f5e50d/node-ca/0.log" Jun 05 13:09:58.558343 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:58.558317 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwh7x_2ca1d20e-34b9-416b-b297-831a956bde72/serve-healthcheck-canary/0.log" Jun 05 13:09:58.754592 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:58.754561 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-5zm5g_95be12bd-9d82-47e5-baf4-9e73f29271a1/migrator/0.log" Jun 05 13:09:58.954451 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:58.954360 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-5zm5g_95be12bd-9d82-47e5-baf4-9e73f29271a1/graceful-termination/0.log" Jun 05 13:09:59.155411 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:09:59.155376 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-9jrp6_4ef624bd-702f-4c4d-95dc-2fffa6fe09ee/kube-storage-version-migrator-operator/0.log" Jun 05 13:10:03.637845 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.637806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:03.638359 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.637871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:03.638479 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.638457 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f291c94e-af95-494f-9acc-b33ead60d2aa-service-ca-bundle\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:03.640385 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.640356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f291c94e-af95-494f-9acc-b33ead60d2aa-metrics-certs\") pod \"router-default-6f7b8db57c-qvq67\" (UID: \"f291c94e-af95-494f-9acc-b33ead60d2aa\") " pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:03.742893 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.742857 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:03.839636 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.839600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:10:03.842258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.842234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"image-registry-74468489cf-vqsd6\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:10:03.895092 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.895003 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f7b8db57c-qvq67"] Jun 05 13:10:03.898544 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:03.898516 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf291c94e_af95_494f_9acc_b33ead60d2aa.slice/crio-a624311b01d2411556d258195b949ec418930307a383b669ff78384b5b2192ef WatchSource:0}: Error finding container a624311b01d2411556d258195b949ec418930307a383b669ff78384b5b2192ef: Status 404 returned error can't find the container with id a624311b01d2411556d258195b949ec418930307a383b669ff78384b5b2192ef Jun 05 13:10:03.989623 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:03.989591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:10:04.146558 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.146478 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74468489cf-vqsd6"] Jun 05 13:10:04.149546 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:04.149514 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696751f7_e782_47cc_823d_06993fed7b13.slice/crio-79acf670cf900edec83854265e00926c29dd4ff14dc2d173cfaca47d54038946 WatchSource:0}: Error finding container 79acf670cf900edec83854265e00926c29dd4ff14dc2d173cfaca47d54038946: Status 404 returned error can't find the container with id 79acf670cf900edec83854265e00926c29dd4ff14dc2d173cfaca47d54038946 Jun 05 13:10:04.223861 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.223819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" event={"ID":"696751f7-e782-47cc-823d-06993fed7b13","Type":"ContainerStarted","Data":"00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b"} Jun 05 13:10:04.224048 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.223888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" event={"ID":"696751f7-e782-47cc-823d-06993fed7b13","Type":"ContainerStarted","Data":"79acf670cf900edec83854265e00926c29dd4ff14dc2d173cfaca47d54038946"} Jun 05 13:10:04.224048 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.223942 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:10:04.225258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.225233 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" event={"ID":"f291c94e-af95-494f-9acc-b33ead60d2aa","Type":"ContainerStarted","Data":"03a3439882f6dd7547b1d0ff6b4976543cf8b19c0d7c2dd97bf5ec83ae708efc"} Jun 05 13:10:04.225371 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.225271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" event={"ID":"f291c94e-af95-494f-9acc-b33ead60d2aa","Type":"ContainerStarted","Data":"a624311b01d2411556d258195b949ec418930307a383b669ff78384b5b2192ef"} Jun 05 13:10:04.294094 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.294037 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podStartSLOduration=17.294021901 podStartE2EDuration="17.294021901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:04.293458528 +0000 UTC m=+205.277315313" watchObservedRunningTime="2026-06-05 13:10:04.294021901 +0000 UTC m=+205.277878685" Jun 05 13:10:04.335008 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.334951 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" podStartSLOduration=17.334936247999998 podStartE2EDuration="17.334936248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:04.333637815 +0000 UTC m=+205.317494600" watchObservedRunningTime="2026-06-05 13:10:04.334936248 +0000 UTC m=+205.318793032" Jun 05 13:10:04.743867 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.743827 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:04.746678 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.746651 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:04.749936 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.749914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:10:04.752343 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.752315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c18483c2-1967-4c90-8194-c5fbba4f06b5-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c6bgk\" (UID: \"c18483c2-1967-4c90-8194-c5fbba4f06b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:10:04.840102 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.840054 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" Jun 05 13:10:04.994225 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:04.994104 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk"] Jun 05 13:10:05.229170 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:05.229137 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" event={"ID":"c18483c2-1967-4c90-8194-c5fbba4f06b5","Type":"ContainerStarted","Data":"3ef353bc94319e76c770cb1d443611f7fee028a3f14a1f0770e13fa61ce395fa"} Jun 05 13:10:05.229516 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:05.229502 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:05.230764 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:05.230743 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f7b8db57c-qvq67" Jun 05 13:10:08.240163 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:08.240129 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" event={"ID":"c18483c2-1967-4c90-8194-c5fbba4f06b5","Type":"ContainerStarted","Data":"e4caccfc863ba8a621e21fd32d3cd3250e0a53ec445bc5208e753d3d40731d59"} Jun 05 13:10:08.240539 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:08.240181 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" event={"ID":"c18483c2-1967-4c90-8194-c5fbba4f06b5","Type":"ContainerStarted","Data":"a6150423a1827a24002299450f89e01eeaa9c767b7a4650a1eafa1e974a84f21"} Jun 05 13:10:08.275673 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:08.275617 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c6bgk" podStartSLOduration=19.101784896 podStartE2EDuration="21.275600434s" totalImagesPullingTime="2.173815538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:08.275294899 +0000 UTC m=+209.259151684" watchObservedRunningTime="2026-06-05 13:10:08.275600434 +0000 UTC m=+209.259457220" Jun 05 13:10:23.993976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:23.993938 2572 patch_prober.go:28] interesting pod/image-registry-74468489cf-vqsd6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:10:23.994456 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:23.993995 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:10:25.233954 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:25.233894 2572 patch_prober.go:28] interesting pod/image-registry-74468489cf-vqsd6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:10:25.234380 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:25.234011 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:10:26.517913 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.517862 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74468489cf-vqsd6"] Jun 05 13:10:26.522534 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.522486 2572 patch_prober.go:28] interesting pod/image-registry-74468489cf-vqsd6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:10:26.522729 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.522578 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:10:26.599291 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.599177 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6mhl5"] Jun 05 13:10:26.605920 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.605859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.612511 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.612474 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 13:10:26.612740 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.612482 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 13:10:26.625235 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.625184 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 13:10:26.625444 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.625240 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 13:10:26.625444 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.625315 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f2d46\"" Jun 05 13:10:26.650963 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.650918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mhl5"] Jun 05 13:10:26.726563 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.726509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac235ed-8c05-4158-abc9-afd30d128167-crio-socket\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.726563 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.726569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac235ed-8c05-4158-abc9-afd30d128167-data-volume\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.726797 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.726603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmsdz\" (UniqueName: \"kubernetes.io/projected/4ac235ed-8c05-4158-abc9-afd30d128167-kube-api-access-rmsdz\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.726797 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.726654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac235ed-8c05-4158-abc9-afd30d128167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.726797 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.726687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac235ed-8c05-4158-abc9-afd30d128167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828077 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac235ed-8c05-4158-abc9-afd30d128167-crio-socket\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828077 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac235ed-8c05-4158-abc9-afd30d128167-data-volume\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmsdz\" (UniqueName: \"kubernetes.io/projected/4ac235ed-8c05-4158-abc9-afd30d128167-kube-api-access-rmsdz\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac235ed-8c05-4158-abc9-afd30d128167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac235ed-8c05-4158-abc9-afd30d128167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828184 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac235ed-8c05-4158-abc9-afd30d128167-crio-socket\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac235ed-8c05-4158-abc9-afd30d128167-data-volume\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.828926 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.828872 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac235ed-8c05-4158-abc9-afd30d128167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.830982 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.830957 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac235ed-8c05-4158-abc9-afd30d128167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.899282 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.899192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmsdz\" (UniqueName: \"kubernetes.io/projected/4ac235ed-8c05-4158-abc9-afd30d128167-kube-api-access-rmsdz\") pod \"insights-runtime-extractor-6mhl5\" (UID: \"4ac235ed-8c05-4158-abc9-afd30d128167\") " pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:26.916007 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:26.915963 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mhl5" Jun 05 13:10:27.401053 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:27.401026 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mhl5"] Jun 05 13:10:27.402606 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:27.402582 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac235ed_8c05_4158_abc9_afd30d128167.slice/crio-f10242b15a049712959d23f4206591643e123bc48b9c320ae8a49d8f61db94aa WatchSource:0}: Error finding container f10242b15a049712959d23f4206591643e123bc48b9c320ae8a49d8f61db94aa: Status 404 returned error can't find the container with id f10242b15a049712959d23f4206591643e123bc48b9c320ae8a49d8f61db94aa Jun 05 13:10:28.306596 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:28.306508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mhl5" event={"ID":"4ac235ed-8c05-4158-abc9-afd30d128167","Type":"ContainerStarted","Data":"75f5469e42d5f9d0c11e0bc436fddbc86c4c2fcd807cafcef297501e3b073dd9"} Jun 05 13:10:28.306596 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:28.306564 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mhl5" event={"ID":"4ac235ed-8c05-4158-abc9-afd30d128167","Type":"ContainerStarted","Data":"914e73c88e93b27e456418c21553f77026c941f03dc53ba3de11f4b8cd132ff5"} Jun 05 13:10:28.306596 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:28.306585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mhl5" event={"ID":"4ac235ed-8c05-4158-abc9-afd30d128167","Type":"ContainerStarted","Data":"f10242b15a049712959d23f4206591643e123bc48b9c320ae8a49d8f61db94aa"} Jun 05 13:10:30.314915 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:30.314856 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mhl5" event={"ID":"4ac235ed-8c05-4158-abc9-afd30d128167","Type":"ContainerStarted","Data":"43042e55fc92df6ded63ab44721d1f11d285f163b129f4aa49da881171657f4b"} Jun 05 13:10:30.361485 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:30.361426 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6mhl5" podStartSLOduration=2.339614847 podStartE2EDuration="4.361406881s" totalImagesPullingTime="2.021792034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:10:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:30.359546457 +0000 UTC m=+231.343403242" watchObservedRunningTime="2026-06-05 13:10:30.361406881 +0000 UTC m=+231.345263668" Jun 05 13:10:35.064867 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.064830 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd"] Jun 05 13:10:35.068362 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.068344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.071866 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:35.071834 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:10:35.072495 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:35.072469 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"openshift-state-metrics-65f78d5c66-58fmd\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="0d7d703c-e467-4228-86bf-dd4179f3f3df" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.072627 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:35.072493 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" Jun 05 13:10:35.072627 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.072523 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 13:10:35.072627 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.072553 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9nxcj\"" Jun 05 13:10:35.072627 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.072563 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 13:10:35.072627 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.072562 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 13:10:35.143433 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.143376 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd"] Jun 05 13:10:35.144350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.144327 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bkf5q"] Jun 05 13:10:35.147821 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.147798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.154245 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.154220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 13:10:35.154862 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.154846 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 13:10:35.155323 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.155308 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 13:10:35.155452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.155434 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dsclp\"" Jun 05 13:10:35.195553 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.195513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d7d703c-e467-4228-86bf-dd4179f3f3df-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.195752 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.195586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.195752 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.195624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.195752 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.195660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw882\" (UniqueName: \"kubernetes.io/projected/0d7d703c-e467-4228-86bf-dd4179f3f3df-kube-api-access-xw882\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.296303 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296261 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.296483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296409 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-sys\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.296483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89661447-6aa6-4b61-93d4-05f1293f0ac8-metrics-client-ca\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-wtmp\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296737 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:35.296491 2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 05 13:10:35.296737 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw882\" (UniqueName: \"kubernetes.io/projected/0d7d703c-e467-4228-86bf-dd4179f3f3df-kube-api-access-xw882\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.296737 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:35.296560 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-tls podName:0d7d703c-e467-4228-86bf-dd4179f3f3df nodeName:}" failed. No retries permitted until 2026-06-05 13:10:35.796543252 +0000 UTC m=+236.780400017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-58fmd" (UID: "0d7d703c-e467-4228-86bf-dd4179f3f3df") : secret "openshift-state-metrics-tls" not found Jun 05 13:10:35.296737 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-tls\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296737 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-textfile\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.296737 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5mc\" (UniqueName: \"kubernetes.io/projected/89661447-6aa6-4b61-93d4-05f1293f0ac8-kube-api-access-vn5mc\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.297000 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296777 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-root\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.297000 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.296808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d7d703c-e467-4228-86bf-dd4179f3f3df-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.297408 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.297389 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d7d703c-e467-4228-86bf-dd4179f3f3df-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.397263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-sys\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89661447-6aa6-4b61-93d4-05f1293f0ac8-metrics-client-ca\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397440 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-sys\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397440 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397334 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-wtmp\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397440 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-tls\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397440 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-textfile\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5mc\" (UniqueName: \"kubernetes.io/projected/89661447-6aa6-4b61-93d4-05f1293f0ac8-kube-api-access-vn5mc\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-root\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-wtmp\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397597 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397573 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89661447-6aa6-4b61-93d4-05f1293f0ac8-root\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397861 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-textfile\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.397861 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.397797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89661447-6aa6-4b61-93d4-05f1293f0ac8-metrics-client-ca\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.398087 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.398066 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.399689 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.399659 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.399806 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.399743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89661447-6aa6-4b61-93d4-05f1293f0ac8-node-exporter-tls\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:35.802348 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.802304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:35.804720 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:35.804689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:36.153354 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.153269 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 13:10:36.159306 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.159273 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d7d703c-e467-4228-86bf-dd4179f3f3df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:36.324328 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:36.324285 2572 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:36.324328 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:36.324334 2572 projected.go:196] Error preparing data for projected volume kube-api-access-xw882 for pod openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:36.324579 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:36.324423 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d7d703c-e467-4228-86bf-dd4179f3f3df-kube-api-access-xw882 podName:0d7d703c-e467-4228-86bf-dd4179f3f3df nodeName:}" failed. No retries permitted until 2026-06-05 13:10:36.824402675 +0000 UTC m=+237.808259440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xw882" (UniqueName: "kubernetes.io/projected/0d7d703c-e467-4228-86bf-dd4179f3f3df-kube-api-access-xw882") pod "openshift-state-metrics-65f78d5c66-58fmd" (UID: "0d7d703c-e467-4228-86bf-dd4179f3f3df") : failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:36.420688 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:36.420601 2572 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:36.420688 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:36.420656 2572 projected.go:196] Error preparing data for projected volume kube-api-access-vn5mc for pod openshift-monitoring/node-exporter-bkf5q: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:36.420924 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:36.420775 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89661447-6aa6-4b61-93d4-05f1293f0ac8-kube-api-access-vn5mc podName:89661447-6aa6-4b61-93d4-05f1293f0ac8 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:36.92075387 +0000 UTC m=+237.904610650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vn5mc" (UniqueName: "kubernetes.io/projected/89661447-6aa6-4b61-93d4-05f1293f0ac8-kube-api-access-vn5mc") pod "node-exporter-bkf5q" (UID: "89661447-6aa6-4b61-93d4-05f1293f0ac8") : failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:36.522592 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.522552 2572 patch_prober.go:28] interesting pod/image-registry-74468489cf-vqsd6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:10:36.522749 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.522608 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:10:36.607189 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.607157 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:10:36.611894 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.611872 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.633263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633231 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 13:10:36.633263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633254 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 13:10:36.633524 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633289 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 13:10:36.633524 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633325 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 13:10:36.633524 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633254 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 13:10:36.633524 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633235 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 13:10:36.633720 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633528 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 13:10:36.633824 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.633808 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rb9zz\"" Jun 05 13:10:36.643718 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.643703 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 13:10:36.645300 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.645284 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 13:10:36.659073 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.659055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 13:10:36.686387 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.686312 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:10:36.709528 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709663 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709663 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709663 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709663 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709620 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-config-out\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709789 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709789 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709789 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709874 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709874 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-web-config\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709960 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709960 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg5xj\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-kube-api-access-qg5xj\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.709960 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.709948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810340 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810340 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5xj\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-kube-api-access-qg5xj\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-config-out\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.810976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-web-config\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.811179 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.810978 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.811433 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.811405 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.812036 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.811678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.813458 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.813432 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.813806 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.813772 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-config-out\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.813985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.814324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-web-config\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814446 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.814394 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814507 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.814489 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814563 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.814537 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814799 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.814766 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.814933 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.814916 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.832176 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.832153 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg5xj\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-kube-api-access-qg5xj\") pod \"alertmanager-main-0\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:36.912157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.912111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw882\" (UniqueName: \"kubernetes.io/projected/0d7d703c-e467-4228-86bf-dd4179f3f3df-kube-api-access-xw882\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:36.914605 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.914583 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw882\" (UniqueName: \"kubernetes.io/projected/0d7d703c-e467-4228-86bf-dd4179f3f3df-kube-api-access-xw882\") pod \"openshift-state-metrics-65f78d5c66-58fmd\" (UID: \"0d7d703c-e467-4228-86bf-dd4179f3f3df\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:36.921003 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:36.920976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:10:37.013595 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.013559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5mc\" (UniqueName: \"kubernetes.io/projected/89661447-6aa6-4b61-93d4-05f1293f0ac8-kube-api-access-vn5mc\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:37.016093 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.016064 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5mc\" (UniqueName: \"kubernetes.io/projected/89661447-6aa6-4b61-93d4-05f1293f0ac8-kube-api-access-vn5mc\") pod \"node-exporter-bkf5q\" (UID: \"89661447-6aa6-4b61-93d4-05f1293f0ac8\") " pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:37.104458 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.104416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:10:37.107936 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:37.107888 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6b4514_d938_4009_b070_1c78bedef13e.slice/crio-59cf6b66d6e416e530126330d7d215ab8ead82f8fe815a1bba0481ceb2677149 WatchSource:0}: Error finding container 59cf6b66d6e416e530126330d7d215ab8ead82f8fe815a1bba0481ceb2677149: Status 404 returned error can't find the container with id 59cf6b66d6e416e530126330d7d215ab8ead82f8fe815a1bba0481ceb2677149 Jun 05 13:10:37.177014 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.176953 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" Jun 05 13:10:37.257210 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.257165 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bkf5q" Jun 05 13:10:37.270532 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:37.270484 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89661447_6aa6_4b61_93d4_05f1293f0ac8.slice/crio-f6b031fe7dc466f6c5198d39062b7234fb181c35564fda5797e3446733e3c93d WatchSource:0}: Error finding container f6b031fe7dc466f6c5198d39062b7234fb181c35564fda5797e3446733e3c93d: Status 404 returned error can't find the container with id f6b031fe7dc466f6c5198d39062b7234fb181c35564fda5797e3446733e3c93d Jun 05 13:10:37.339638 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.339599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkf5q" event={"ID":"89661447-6aa6-4b61-93d4-05f1293f0ac8","Type":"ContainerStarted","Data":"f6b031fe7dc466f6c5198d39062b7234fb181c35564fda5797e3446733e3c93d"} Jun 05 13:10:37.340799 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.340769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"59cf6b66d6e416e530126330d7d215ab8ead82f8fe815a1bba0481ceb2677149"} Jun 05 13:10:37.394683 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:37.394653 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd"] Jun 05 13:10:37.397236 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:37.397201 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7d703c_e467_4228_86bf_dd4179f3f3df.slice/crio-ba2b056048c56a749bd535d9a3e54762b6856f248caef61b97c96e4a6306cd7e WatchSource:0}: Error finding container ba2b056048c56a749bd535d9a3e54762b6856f248caef61b97c96e4a6306cd7e: Status 404 returned error can't find the container with id ba2b056048c56a749bd535d9a3e54762b6856f248caef61b97c96e4a6306cd7e Jun 05 13:10:38.347279 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:38.347238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" event={"ID":"0d7d703c-e467-4228-86bf-dd4179f3f3df","Type":"ContainerStarted","Data":"dbbd127937c543b1880b38ec26acea45745161b2c848d994422fac907000be23"} Jun 05 13:10:38.347696 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:38.347306 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" event={"ID":"0d7d703c-e467-4228-86bf-dd4179f3f3df","Type":"ContainerStarted","Data":"222d6a596da9930ba566af2a3cfe1c133d09be1347674ad5c5e3fa6db81e13af"} Jun 05 13:10:38.347696 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:38.347327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" event={"ID":"0d7d703c-e467-4228-86bf-dd4179f3f3df","Type":"ContainerStarted","Data":"ba2b056048c56a749bd535d9a3e54762b6856f248caef61b97c96e4a6306cd7e"} Jun 05 13:10:39.353117 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.353074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" event={"ID":"0d7d703c-e467-4228-86bf-dd4179f3f3df","Type":"ContainerStarted","Data":"af3fbb05ad53887c5100ec77312bbf1ae9f8189d6460e99fb7a9a8ec224d33fb"} Jun 05 13:10:39.354421 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.354397 2572 generic.go:356] "Generic (PLEG): container finished" podID="89661447-6aa6-4b61-93d4-05f1293f0ac8" containerID="1f2f0cee8b856236e11fdf25f34a50f9a8460d813af9905cf2a25e22a8f2be78" exitCode=0 Jun 05 13:10:39.354520 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.354479 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkf5q" event={"ID":"89661447-6aa6-4b61-93d4-05f1293f0ac8","Type":"ContainerDied","Data":"1f2f0cee8b856236e11fdf25f34a50f9a8460d813af9905cf2a25e22a8f2be78"} Jun 05 13:10:39.355964 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.355930 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="bba8c065b2d29ea48b9f537a77d677907114052e61915b845176e2ac32c8fe47" exitCode=0 Jun 05 13:10:39.356066 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.355979 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"bba8c065b2d29ea48b9f537a77d677907114052e61915b845176e2ac32c8fe47"} Jun 05 13:10:39.463025 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.462979 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-58fmd" podStartSLOduration=3.107700598 podStartE2EDuration="4.462962184s" totalImagesPullingTime="1.355261586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:39.459977541 +0000 UTC m=+240.443834325" watchObservedRunningTime="2026-06-05 13:10:39.462962184 +0000 UTC m=+240.446818968" Jun 05 13:10:39.542800 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.542759 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85557b696d-cv54g"] Jun 05 13:10:39.546967 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.546921 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.566484 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.566447 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 13:10:39.566734 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.566500 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 13:10:39.566734 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.566510 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 13:10:39.566734 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.566601 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 13:10:39.566734 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.566649 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w4fzl\"" Jun 05 13:10:39.567015 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.566920 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4kui5ntektloi\"" Jun 05 13:10:39.568806 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.568780 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 13:10:39.635783 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635663 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-metrics-client-ca\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.635783 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-grpc-tls\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.636031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.636031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635819 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.636031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-tls\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.636031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6fbh\" (UniqueName: \"kubernetes.io/projected/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-kube-api-access-f6fbh\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.636031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.636031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.635961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.652681 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.652609 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85557b696d-cv54g"] Jun 05 13:10:39.736522 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-grpc-tls\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.736522 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736525 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.736820 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.736820 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-tls\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.736820 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6fbh\" (UniqueName: \"kubernetes.io/projected/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-kube-api-access-f6fbh\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.736820 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736759 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.737079 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.737079 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.736982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-metrics-client-ca\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.737829 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.737790 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-metrics-client-ca\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.739824 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.739782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.740024 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.739832 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-grpc-tls\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.740024 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.739844 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.740024 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.739923 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.740159 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.740041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-tls\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.740360 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.740337 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.771690 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.771635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6fbh\" (UniqueName: \"kubernetes.io/projected/5b9822f0-7cc2-49bc-9efa-a53eb86a45ed-kube-api-access-f6fbh\") pod \"thanos-querier-85557b696d-cv54g\" (UID: \"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed\") " pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:39.858094 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:39.858038 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:40.171096 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:40.171007 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85557b696d-cv54g"] Jun 05 13:10:40.177892 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:40.177859 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9822f0_7cc2_49bc_9efa_a53eb86a45ed.slice/crio-5a30d89887bca71298377ae24c28cda32f93a186a147ad4502eb3f13366b4110 WatchSource:0}: Error finding container 5a30d89887bca71298377ae24c28cda32f93a186a147ad4502eb3f13366b4110: Status 404 returned error can't find the container with id 5a30d89887bca71298377ae24c28cda32f93a186a147ad4502eb3f13366b4110 Jun 05 13:10:40.362023 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:40.361983 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkf5q" event={"ID":"89661447-6aa6-4b61-93d4-05f1293f0ac8","Type":"ContainerStarted","Data":"de86a8c5e309118f7b71bfece6bdcda68870ba79045fd01bbbb30db61ca98699"} Jun 05 13:10:40.362462 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:40.362046 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkf5q" event={"ID":"89661447-6aa6-4b61-93d4-05f1293f0ac8","Type":"ContainerStarted","Data":"7bcd701081091a4327ba7dc28f74aa9b4cf1694ac007a49dfd3854242945a919"} Jun 05 13:10:40.363269 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:40.363244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"5a30d89887bca71298377ae24c28cda32f93a186a147ad4502eb3f13366b4110"} Jun 05 13:10:41.370186 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:41.370151 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"1a12f14b3c3342e08119d2fd7ecde0b7ae54f7d8ed68a0e1b965e024e377d2a9"} Jun 05 13:10:42.378520 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:42.378486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"b9236cec386cf9b5eb4bcca86fc537911c7e85ef8759527b95484140d48fd2aa"} Jun 05 13:10:42.378930 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:42.378562 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"3bb5dc1acc72d83e66d4e85e6142029f557b67ea0f7b788fc31cf392e7ea8b00"} Jun 05 13:10:42.378930 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:42.378600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"8f3958b6457decb6d97c64d250e8c38829f2359cb90b31f8d3251fcd51e93d96"} Jun 05 13:10:42.378930 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:42.378637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"8d1c988d0b22ff8db79281efb6f504b6e469bdc77cfbea912f80e3343f1da01d"} Jun 05 13:10:43.384738 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.384702 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerStarted","Data":"3cec09a35fa2ba448e013819dd4abe090bdb032930053bb8fd913e7b61975c80"} Jun 05 13:10:43.387633 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"cf74d6528a9fb6bba7512f7fa24ba3987ab7e49c06c1b72eb05672f842f83adc"} Jun 05 13:10:43.387804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"3609ffff22775c31cd04b28521af2a668f9105b28763bc6b7062421b43af5c89"} Jun 05 13:10:43.387804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"43af398f1f6aea6268490cf28236b894158eca1bfad58d098f6ed196778ae281"} Jun 05 13:10:43.387804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387725 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:43.387804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387749 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"3e973a03bdbd623db12c3437cb7fa5c01b9ee60035db6c7e6789776c9d875863"} Jun 05 13:10:43.387804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"43a540773ff29ea92465ad6ad800b2f5a8fcaf35aa2595a0ed7d31ffca8e3cf2"} Jun 05 13:10:43.388098 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.387818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" event={"ID":"5b9822f0-7cc2-49bc-9efa-a53eb86a45ed","Type":"ContainerStarted","Data":"313861aea488349aefd859b0d5619ae5e287ba7a555a6ca866c8809abec00ce1"} Jun 05 13:10:43.469168 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.469053 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.910019072 podStartE2EDuration="7.469031833s" totalImagesPullingTime="4.538165205s" totalInitContainerRuntime="20.847556ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:43.466580341 +0000 UTC m=+244.450437193" watchObservedRunningTime="2026-06-05 13:10:43.469031833 +0000 UTC m=+244.452888645" Jun 05 13:10:43.469764 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.469731 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bkf5q" podStartSLOduration=7.259640285 podStartE2EDuration="8.469721041s" totalImagesPullingTime="1.115290823s" totalInitContainerRuntime="94.789933ms" isStatefulPod=true podCreationTimestamp="2026-06-05 13:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:40.401719632 +0000 UTC m=+241.385576417" watchObservedRunningTime="2026-06-05 13:10:43.469721041 +0000 UTC m=+244.453577823" Jun 05 13:10:43.534478 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.534426 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" podStartSLOduration=1.900799719 podStartE2EDuration="4.534409581s" totalImagesPullingTime="2.633609862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:43.534080862 +0000 UTC m=+244.517937648" watchObservedRunningTime="2026-06-05 13:10:43.534409581 +0000 UTC m=+244.518266366" Jun 05 13:10:43.912164 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.912128 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-6dpw9"] Jun 05 13:10:43.915485 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.915469 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:10:43.939013 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.938985 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xsbmv\"" Jun 05 13:10:43.939179 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.939057 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 13:10:43.939179 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.939117 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 13:10:43.954667 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.954634 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-6dpw9"] Jun 05 13:10:43.977378 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:43.977335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvw5d\" (UniqueName: \"kubernetes.io/projected/36753604-612f-45a9-a5a7-6ab50b20a7ea-kube-api-access-gvw5d\") pod \"downloads-6657875f97-6dpw9\" (UID: \"36753604-612f-45a9-a5a7-6ab50b20a7ea\") " pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:10:44.078329 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:44.078288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvw5d\" (UniqueName: \"kubernetes.io/projected/36753604-612f-45a9-a5a7-6ab50b20a7ea-kube-api-access-gvw5d\") pod \"downloads-6657875f97-6dpw9\" (UID: \"36753604-612f-45a9-a5a7-6ab50b20a7ea\") " pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:10:44.094590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:44.094559 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvw5d\" (UniqueName: \"kubernetes.io/projected/36753604-612f-45a9-a5a7-6ab50b20a7ea-kube-api-access-gvw5d\") pod \"downloads-6657875f97-6dpw9\" (UID: \"36753604-612f-45a9-a5a7-6ab50b20a7ea\") " pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:10:44.224884 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:44.224788 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:10:44.408810 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:44.408770 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-6dpw9"] Jun 05 13:10:44.412445 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:44.412394 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36753604_612f_45a9_a5a7_6ab50b20a7ea.slice/crio-b19b7a4fda6a371ed14243ee398f67f3bc6b81944598576c8eeb13a752d1d6ac WatchSource:0}: Error finding container b19b7a4fda6a371ed14243ee398f67f3bc6b81944598576c8eeb13a752d1d6ac: Status 404 returned error can't find the container with id b19b7a4fda6a371ed14243ee398f67f3bc6b81944598576c8eeb13a752d1d6ac Jun 05 13:10:45.398398 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:45.398356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-6dpw9" event={"ID":"36753604-612f-45a9-a5a7-6ab50b20a7ea","Type":"ContainerStarted","Data":"b19b7a4fda6a371ed14243ee398f67f3bc6b81944598576c8eeb13a752d1d6ac"} Jun 05 13:10:46.524188 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:46.524145 2572 patch_prober.go:28] interesting pod/image-registry-74468489cf-vqsd6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:10:46.524688 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:46.524212 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:10:49.399459 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.399367 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85557b696d-cv54g" Jun 05 13:10:49.793741 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.793700 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d499fccb-vc9s4"] Jun 05 13:10:49.797212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.797184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.800294 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.800255 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 13:10:49.800294 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.800276 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 13:10:49.800542 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.800292 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xcwrw\"" Jun 05 13:10:49.800617 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.800584 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 13:10:49.800693 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.800675 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 13:10:49.800943 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.800925 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 13:10:49.821298 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.821206 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d499fccb-vc9s4"] Jun 05 13:10:49.834889 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.834847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-service-ca\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.835102 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.834890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-serving-cert\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.835102 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.834938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-config\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.835102 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.835017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-oauth-serving-cert\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.835102 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.835059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-oauth-config\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.835237 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.835143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c2dd\" (UniqueName: \"kubernetes.io/projected/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-kube-api-access-4c2dd\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.935829 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.935786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-oauth-serving-cert\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936033 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.935835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-oauth-config\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936033 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.935924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c2dd\" (UniqueName: \"kubernetes.io/projected/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-kube-api-access-4c2dd\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936033 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.935996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-service-ca\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936033 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.936028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-serving-cert\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936222 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.936053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-config\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936693 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.936632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-oauth-serving-cert\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936821 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.936687 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-config\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.936883 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.936868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-service-ca\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.939032 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.939006 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-oauth-config\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.939131 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.939060 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-serving-cert\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:49.960384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:49.960346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c2dd\" (UniqueName: \"kubernetes.io/projected/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-kube-api-access-4c2dd\") pod \"console-7d499fccb-vc9s4\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:50.107526 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.107430 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:10:50.281672 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.281630 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d499fccb-vc9s4"] Jun 05 13:10:50.286834 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:50.286796 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc50ebcc_aaa5_40b6_9416_31bbfaacc4b0.slice/crio-933df0edc73fb6eb123fc515d848db94073d1c88db694c4b4263d459804ef0b9 WatchSource:0}: Error finding container 933df0edc73fb6eb123fc515d848db94073d1c88db694c4b4263d459804ef0b9: Status 404 returned error can't find the container with id 933df0edc73fb6eb123fc515d848db94073d1c88db694c4b4263d459804ef0b9 Jun 05 13:10:50.340433 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.340386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:10:50.343183 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.343148 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d2b0510-1fc8-4c93-b85f-2eb9a4453287-metrics-certs\") pod \"network-metrics-daemon-dvkfr\" (UID: \"9d2b0510-1fc8-4c93-b85f-2eb9a4453287\") " pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:10:50.423319 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.423229 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cph74\"" Jun 05 13:10:50.425360 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.425321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d499fccb-vc9s4" event={"ID":"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0","Type":"ContainerStarted","Data":"933df0edc73fb6eb123fc515d848db94073d1c88db694c4b4263d459804ef0b9"} Jun 05 13:10:50.428384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.428353 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dvkfr" Jun 05 13:10:50.620093 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:50.620050 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dvkfr"] Jun 05 13:10:50.623574 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:10:50.623540 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2b0510_1fc8_4c93_b85f_2eb9a4453287.slice/crio-47fd16071dbbaf60925177f6b9974cac0c65bc06501dd2640365e74b6553a306 WatchSource:0}: Error finding container 47fd16071dbbaf60925177f6b9974cac0c65bc06501dd2640365e74b6553a306: Status 404 returned error can't find the container with id 47fd16071dbbaf60925177f6b9974cac0c65bc06501dd2640365e74b6553a306 Jun 05 13:10:51.432184 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.432139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dvkfr" event={"ID":"9d2b0510-1fc8-4c93-b85f-2eb9a4453287","Type":"ContainerStarted","Data":"47fd16071dbbaf60925177f6b9974cac0c65bc06501dd2640365e74b6553a306"} Jun 05 13:10:51.540040 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.539938 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" containerID="cri-o://00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b" gracePeriod=30 Jun 05 13:10:51.829419 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.829370 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:10:51.957950 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.957838 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbv7l\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-kube-api-access-fbv7l\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.957953 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/696751f7-e782-47cc-823d-06993fed7b13-ca-trust-extracted\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.957988 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-registry-certificates\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.958010 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-trusted-ca\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.958062 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-bound-sa-token\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.958090 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958349 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.958131 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-installation-pull-secrets\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958349 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.958162 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-image-registry-private-configuration\") pod \"696751f7-e782-47cc-823d-06993fed7b13\" (UID: \"696751f7-e782-47cc-823d-06993fed7b13\") " Jun 05 13:10:51.958808 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.958774 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:10:51.959202 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.959172 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:10:51.961447 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.961411 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-kube-api-access-fbv7l" (OuterVolumeSpecName: "kube-api-access-fbv7l") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "kube-api-access-fbv7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:10:51.961561 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.961429 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:10:51.961711 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.961681 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:10:51.962160 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.962105 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:10:51.962447 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.962422 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:10:51.969668 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:51.969625 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696751f7-e782-47cc-823d-06993fed7b13-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "696751f7-e782-47cc-823d-06993fed7b13" (UID: "696751f7-e782-47cc-823d-06993fed7b13"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:10:52.059284 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059249 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-bound-sa-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059284 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059282 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-registry-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059284 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059291 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-installation-pull-secrets\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059301 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/696751f7-e782-47cc-823d-06993fed7b13-image-registry-private-configuration\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059312 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbv7l\" (UniqueName: \"kubernetes.io/projected/696751f7-e782-47cc-823d-06993fed7b13-kube-api-access-fbv7l\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059321 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/696751f7-e782-47cc-823d-06993fed7b13-ca-trust-extracted\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059329 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-registry-certificates\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.059545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.059337 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/696751f7-e782-47cc-823d-06993fed7b13-trusted-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:10:52.438914 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.438859 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dvkfr" event={"ID":"9d2b0510-1fc8-4c93-b85f-2eb9a4453287","Type":"ContainerStarted","Data":"dbb25daf28148343b484c3fb4ac7967b6078fdb5c155fb9d5914235825751698"} Jun 05 13:10:52.439364 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.438945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dvkfr" event={"ID":"9d2b0510-1fc8-4c93-b85f-2eb9a4453287","Type":"ContainerStarted","Data":"97059a630f01ba2e84ed9c36b08f62a6173716dde772451627fa9784661671b9"} Jun 05 13:10:52.440521 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.440486 2572 generic.go:356] "Generic (PLEG): container finished" podID="696751f7-e782-47cc-823d-06993fed7b13" containerID="00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b" exitCode=0 Jun 05 13:10:52.440654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.440528 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" Jun 05 13:10:52.440654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.440567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" event={"ID":"696751f7-e782-47cc-823d-06993fed7b13","Type":"ContainerDied","Data":"00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b"} Jun 05 13:10:52.440654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.440622 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74468489cf-vqsd6" event={"ID":"696751f7-e782-47cc-823d-06993fed7b13","Type":"ContainerDied","Data":"79acf670cf900edec83854265e00926c29dd4ff14dc2d173cfaca47d54038946"} Jun 05 13:10:52.440795 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.440662 2572 scope.go:117] "RemoveContainer" containerID="00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b" Jun 05 13:10:52.451590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.451566 2572 scope.go:117] "RemoveContainer" containerID="00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b" Jun 05 13:10:52.452007 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:10:52.451978 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b\": container with ID starting with 00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b not found: ID does not exist" containerID="00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b" Jun 05 13:10:52.452084 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.452022 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b"} err="failed to get container status \"00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b\": rpc error: code = NotFound desc = could not find container \"00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b\": container with ID starting with 00c1413aa98dd1661d1d15889c9da7ce3cf12794cda5f4a9640c90e25166fe7b not found: ID does not exist" Jun 05 13:10:52.471944 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.471874 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dvkfr" podStartSLOduration=252.486557872 podStartE2EDuration="4m13.471853362s" totalImagesPullingTime="985.29549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:52.467468406 +0000 UTC m=+253.451325190" watchObservedRunningTime="2026-06-05 13:10:52.471853362 +0000 UTC m=+253.455710146" Jun 05 13:10:52.505756 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.505716 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74468489cf-vqsd6"] Jun 05 13:10:52.509132 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:52.509099 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74468489cf-vqsd6"] Jun 05 13:10:53.426662 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:53.426622 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="696751f7-e782-47cc-823d-06993fed7b13" path="/var/lib/kubelet/pods/696751f7-e782-47cc-823d-06993fed7b13/volumes" Jun 05 13:10:54.453316 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:54.453261 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d499fccb-vc9s4" event={"ID":"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0","Type":"ContainerStarted","Data":"f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09"} Jun 05 13:10:54.495260 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:10:54.495174 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d499fccb-vc9s4" podStartSLOduration=1.490034166 podStartE2EDuration="5.495151114s" totalImagesPullingTime="4.005116948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:54.492998639 +0000 UTC m=+255.476855427" watchObservedRunningTime="2026-06-05 13:10:54.495151114 +0000 UTC m=+255.479007898" Jun 05 13:11:00.108399 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:00.108352 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:11:00.109014 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:00.108433 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:11:00.110112 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:00.110086 2572 patch_prober.go:28] interesting pod/console-7d499fccb-vc9s4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 05 13:11:00.110246 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:00.110132 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d499fccb-vc9s4" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 05 13:11:04.501134 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:04.501085 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-6dpw9" event={"ID":"36753604-612f-45a9-a5a7-6ab50b20a7ea","Type":"ContainerStarted","Data":"581e51c1126914f7ac43061aad205aa6d887b63a66c2aaa5e2411591dd3d934f"} Jun 05 13:11:04.501673 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:04.501277 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:11:04.514515 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:04.514475 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-6dpw9" Jun 05 13:11:04.527253 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:04.527179 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-6dpw9" podStartSLOduration=2.389693523 podStartE2EDuration="21.527151956s" totalImagesPullingTime="19.137458433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:11:04.524425543 +0000 UTC m=+265.508282333" watchObservedRunningTime="2026-06-05 13:11:04.527151956 +0000 UTC m=+265.511008743" Jun 05 13:11:10.108328 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:10.108282 2572 patch_prober.go:28] interesting pod/console-7d499fccb-vc9s4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 05 13:11:10.108832 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:10.108359 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d499fccb-vc9s4" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 05 13:11:12.539811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:12.539718 2572 generic.go:356] "Generic (PLEG): container finished" podID="4ef624bd-702f-4c4d-95dc-2fffa6fe09ee" containerID="3c3afafd34ad0f2d3c47993b2b2faea6d4dbc01c2f2a837cd13712ac61a9011b" exitCode=0 Jun 05 13:11:12.539811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:12.539788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" event={"ID":"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee","Type":"ContainerDied","Data":"3c3afafd34ad0f2d3c47993b2b2faea6d4dbc01c2f2a837cd13712ac61a9011b"} Jun 05 13:11:12.540375 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:12.540179 2572 scope.go:117] "RemoveContainer" containerID="3c3afafd34ad0f2d3c47993b2b2faea6d4dbc01c2f2a837cd13712ac61a9011b" Jun 05 13:11:13.551227 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:13.551176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9jrp6" event={"ID":"4ef624bd-702f-4c4d-95dc-2fffa6fe09ee","Type":"ContainerStarted","Data":"a8f1d27c280866928d77523b09c62b677f55d82ad4bc0f81c7140369a6957163"} Jun 05 13:11:20.071493 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:11:20.071432 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wxvpw" podUID="3d722289-5264-41e2-bd1e-57c3684d73e0" Jun 05 13:11:20.107954 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:20.107891 2572 patch_prober.go:28] interesting pod/console-7d499fccb-vc9s4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 05 13:11:20.108161 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:20.107975 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d499fccb-vc9s4" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 05 13:11:20.576664 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:20.576629 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wxvpw" Jun 05 13:11:21.583150 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:21.583108 2572 generic.go:356] "Generic (PLEG): container finished" podID="2056b042-0594-418a-94c2-154f96ddfea4" containerID="eaaf6f9dd38b128e7589b3910d3a460382766eba8e8e2c36b27588f50c180954" exitCode=255 Jun 05 13:11:21.583645 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:21.583166 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" event={"ID":"2056b042-0594-418a-94c2-154f96ddfea4","Type":"ContainerDied","Data":"eaaf6f9dd38b128e7589b3910d3a460382766eba8e8e2c36b27588f50c180954"} Jun 05 13:11:21.583645 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:21.583211 2572 scope.go:117] "RemoveContainer" containerID="51399b197353d63baa0b03c66a9e052bf1f1f53c9f28b1d5afe58c63a7a849e7" Jun 05 13:11:21.590619 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:21.590589 2572 scope.go:117] "RemoveContainer" containerID="eaaf6f9dd38b128e7589b3910d3a460382766eba8e8e2c36b27588f50c180954" Jun 05 13:11:21.590877 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:11:21.590852 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-677795b454-6pxmp_open-cluster-management-agent-addon(2056b042-0594-418a-94c2-154f96ddfea4)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" podUID="2056b042-0594-418a-94c2-154f96ddfea4" Jun 05 13:11:23.858261 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:23.858209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:11:23.860654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:23.860615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d722289-5264-41e2-bd1e-57c3684d73e0-metrics-tls\") pod \"dns-default-wxvpw\" (UID: \"3d722289-5264-41e2-bd1e-57c3684d73e0\") " pod="openshift-dns/dns-default-wxvpw" Jun 05 13:11:23.900216 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:23.900178 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d25hl\"" Jun 05 13:11:23.908271 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:23.908237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wxvpw" Jun 05 13:11:24.102019 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:24.101981 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wxvpw"] Jun 05 13:11:24.106563 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:11:24.106530 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d722289_5264_41e2_bd1e_57c3684d73e0.slice/crio-bdd2571914e630bb9d968e2ec2159a92ccb38f69e73b56809cf3f881be46ded4 WatchSource:0}: Error finding container bdd2571914e630bb9d968e2ec2159a92ccb38f69e73b56809cf3f881be46ded4: Status 404 returned error can't find the container with id bdd2571914e630bb9d968e2ec2159a92ccb38f69e73b56809cf3f881be46ded4 Jun 05 13:11:24.604110 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:24.604066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wxvpw" event={"ID":"3d722289-5264-41e2-bd1e-57c3684d73e0","Type":"ContainerStarted","Data":"bdd2571914e630bb9d968e2ec2159a92ccb38f69e73b56809cf3f881be46ded4"} Jun 05 13:11:25.636956 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:25.636909 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/init-config-reloader/0.log" Jun 05 13:11:25.844080 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:25.844030 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/alertmanager/0.log" Jun 05 13:11:26.036587 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.036546 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/config-reloader/0.log" Jun 05 13:11:26.237436 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.237401 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/kube-rbac-proxy-web/0.log" Jun 05 13:11:26.438732 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.438646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/kube-rbac-proxy/0.log" Jun 05 13:11:26.614030 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.613995 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wxvpw" event={"ID":"3d722289-5264-41e2-bd1e-57c3684d73e0","Type":"ContainerStarted","Data":"49e5935a9d0fdd908c22f511c89d2735d4a97734c20076a8f2373ddfd62c2885"} Jun 05 13:11:26.614213 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.614045 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wxvpw" event={"ID":"3d722289-5264-41e2-bd1e-57c3684d73e0","Type":"ContainerStarted","Data":"5be80921739d8c1c65e027f8003db3fb620aa4db619a90d4ba4df13da8fcbbbb"} Jun 05 13:11:26.614213 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.614139 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wxvpw" Jun 05 13:11:26.647603 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.647560 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/kube-rbac-proxy-metric/0.log" Jun 05 13:11:26.650955 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.650913 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wxvpw" podStartSLOduration=251.670080514 podStartE2EDuration="4m13.650883905s" totalImagesPullingTime="1.980803391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:11:26.645563456 +0000 UTC m=+287.629420240" watchObservedRunningTime="2026-06-05 13:11:26.650883905 +0000 UTC m=+287.634740690" Jun 05 13:11:26.699225 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.699136 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" Jun 05 13:11:26.699592 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.699576 2572 scope.go:117] "RemoveContainer" containerID="eaaf6f9dd38b128e7589b3910d3a460382766eba8e8e2c36b27588f50c180954" Jun 05 13:11:26.699752 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:11:26.699733 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-677795b454-6pxmp_open-cluster-management-agent-addon(2056b042-0594-418a-94c2-154f96ddfea4)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" podUID="2056b042-0594-418a-94c2-154f96ddfea4" Jun 05 13:11:26.835167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:26.835135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3c6b4514-d938-4009-b070-1c78bedef13e/prom-label-proxy/0.log" Jun 05 13:11:28.235686 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:28.235655 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkf5q_89661447-6aa6-4b61-93d4-05f1293f0ac8/init-textfile/0.log" Jun 05 13:11:28.438765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:28.438729 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkf5q_89661447-6aa6-4b61-93d4-05f1293f0ac8/node-exporter/0.log" Jun 05 13:11:28.634212 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:28.634182 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkf5q_89661447-6aa6-4b61-93d4-05f1293f0ac8/kube-rbac-proxy/0.log" Jun 05 13:11:29.955797 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:29.955736 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d499fccb-vc9s4"] Jun 05 13:11:30.042864 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:30.042830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-58fmd_0d7d703c-e467-4228-86bf-dd4179f3f3df/kube-rbac-proxy-main/0.log" Jun 05 13:11:30.235578 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:30.235453 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-58fmd_0d7d703c-e467-4228-86bf-dd4179f3f3df/kube-rbac-proxy-self/0.log" Jun 05 13:11:30.440662 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:30.440620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-58fmd_0d7d703c-e467-4228-86bf-dd4179f3f3df/openshift-state-metrics/0.log" Jun 05 13:11:33.240557 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:33.240523 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/thanos-query/0.log" Jun 05 13:11:33.443101 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:33.443065 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy-web/0.log" Jun 05 13:11:33.635249 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:33.635219 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy/0.log" Jun 05 13:11:33.837349 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:33.837319 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/prom-label-proxy/0.log" Jun 05 13:11:34.041020 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:34.040985 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy-rules/0.log" Jun 05 13:11:34.245123 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:34.245091 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy-metrics/0.log" Jun 05 13:11:35.246251 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:35.246225 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d499fccb-vc9s4_bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0/console/0.log" Jun 05 13:11:35.445434 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:35.445381 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-6dpw9_36753604-612f-45a9-a5a7-6ab50b20a7ea/download-server/0.log" Jun 05 13:11:36.443797 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:36.443760 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wxvpw_3d722289-5264-41e2-bd1e-57c3684d73e0/dns/0.log" Jun 05 13:11:36.622544 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:36.622511 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wxvpw" Jun 05 13:11:36.694472 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:36.694375 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wxvpw_3d722289-5264-41e2-bd1e-57c3684d73e0/kube-rbac-proxy/0.log" Jun 05 13:11:37.273629 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:37.273602 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjbt9_0729fc09-a1b6-4791-bcc3-ab3b8f8666bf/dns-node-resolver/0.log" Jun 05 13:11:37.846346 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:37.846313 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mm8w9_6f22c6a9-c23d-47ae-8341-b43c65f5e50d/node-ca/0.log" Jun 05 13:11:38.435914 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:38.435881 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7b8db57c-qvq67_f291c94e-af95-494f-9acc-b33ead60d2aa/router/0.log" Jun 05 13:11:39.037712 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:39.037687 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwh7x_2ca1d20e-34b9-416b-b297-831a956bde72/serve-healthcheck-canary/0.log" Jun 05 13:11:39.374556 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:39.374507 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:11:39.378771 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:39.378739 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:11:39.386321 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:39.386290 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 13:11:41.432023 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:41.431928 2572 scope.go:117] "RemoveContainer" containerID="eaaf6f9dd38b128e7589b3910d3a460382766eba8e8e2c36b27588f50c180954" Jun 05 13:11:41.685401 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:41.684529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-677795b454-6pxmp" event={"ID":"2056b042-0594-418a-94c2-154f96ddfea4","Type":"ContainerStarted","Data":"acfd203cc19bffdac9f162d69c0659170d7cefa0a151f4f61a83a5669edc365a"} Jun 05 13:11:54.978149 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:54.978086 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d499fccb-vc9s4" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" containerID="cri-o://f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09" gracePeriod=15 Jun 05 13:11:55.236432 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.236338 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:11:55.328952 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.328882 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-oauth-config\") pod \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " Jun 05 13:11:55.329154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.328992 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-service-ca\") pod \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " Jun 05 13:11:55.329154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329015 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-oauth-serving-cert\") pod \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " Jun 05 13:11:55.329154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329036 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-serving-cert\") pod \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " Jun 05 13:11:55.329154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329068 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c2dd\" (UniqueName: \"kubernetes.io/projected/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-kube-api-access-4c2dd\") pod \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " Jun 05 13:11:55.329154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329106 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-config\") pod \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\" (UID: \"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0\") " Jun 05 13:11:55.329492 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329463 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" (UID: "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:55.329567 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329500 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" (UID: "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:55.329630 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.329584 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-config" (OuterVolumeSpecName: "console-config") pod "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" (UID: "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:55.331735 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.331695 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" (UID: "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:55.331735 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.331728 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-kube-api-access-4c2dd" (OuterVolumeSpecName: "kube-api-access-4c2dd") pod "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" (UID: "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0"). InnerVolumeSpecName "kube-api-access-4c2dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:55.331918 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.331709 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" (UID: "bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:55.430013 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.429972 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:55.430013 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.430009 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-oauth-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:55.430374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.430027 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:55.430374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.430038 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c2dd\" (UniqueName: \"kubernetes.io/projected/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-kube-api-access-4c2dd\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:55.430374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.430049 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:55.430374 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.430058 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0-console-oauth-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:55.743587 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.743543 2572 generic.go:356] "Generic (PLEG): container finished" podID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerID="f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09" exitCode=0 Jun 05 13:11:55.743587 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.743591 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d499fccb-vc9s4" event={"ID":"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0","Type":"ContainerDied","Data":"f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09"} Jun 05 13:11:55.743800 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.743603 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d499fccb-vc9s4" Jun 05 13:11:55.743800 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.743657 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d499fccb-vc9s4" event={"ID":"bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0","Type":"ContainerDied","Data":"933df0edc73fb6eb123fc515d848db94073d1c88db694c4b4263d459804ef0b9"} Jun 05 13:11:55.743800 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.743678 2572 scope.go:117] "RemoveContainer" containerID="f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09" Jun 05 13:11:55.751804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.751781 2572 scope.go:117] "RemoveContainer" containerID="f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09" Jun 05 13:11:55.752078 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:11:55.752057 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09\": container with ID starting with f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09 not found: ID does not exist" containerID="f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09" Jun 05 13:11:55.752154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.752091 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09"} err="failed to get container status \"f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09\": rpc error: code = NotFound desc = could not find container \"f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09\": container with ID starting with f36bb12636fc4d87a76f522dde9b5365f43ef62af61d13cd9b74c5e8d53a3c09 not found: ID does not exist" Jun 05 13:11:55.779886 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.779846 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d499fccb-vc9s4"] Jun 05 13:11:55.785435 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:55.785408 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d499fccb-vc9s4"] Jun 05 13:11:56.548245 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548204 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:11:56.548664 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548509 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="alertmanager" containerID="cri-o://1a12f14b3c3342e08119d2fd7ecde0b7ae54f7d8ed68a0e1b965e024e377d2a9" gracePeriod=120 Jun 05 13:11:56.548664 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548577 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-web" containerID="cri-o://8f3958b6457decb6d97c64d250e8c38829f2359cb90b31f8d3251fcd51e93d96" gracePeriod=120 Jun 05 13:11:56.548664 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548577 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-metric" containerID="cri-o://b9236cec386cf9b5eb4bcca86fc537911c7e85ef8759527b95484140d48fd2aa" gracePeriod=120 Jun 05 13:11:56.548664 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548631 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy" containerID="cri-o://3bb5dc1acc72d83e66d4e85e6142029f557b67ea0f7b788fc31cf392e7ea8b00" gracePeriod=120 Jun 05 13:11:56.548876 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548650 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="config-reloader" containerID="cri-o://8d1c988d0b22ff8db79281efb6f504b6e469bdc77cfbea912f80e3343f1da01d" gracePeriod=120 Jun 05 13:11:56.548876 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.548668 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="prom-label-proxy" containerID="cri-o://3cec09a35fa2ba448e013819dd4abe090bdb032930053bb8fd913e7b61975c80" gracePeriod=120 Jun 05 13:11:56.751027 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.750994 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="3cec09a35fa2ba448e013819dd4abe090bdb032930053bb8fd913e7b61975c80" exitCode=0 Jun 05 13:11:56.751027 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751021 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="3bb5dc1acc72d83e66d4e85e6142029f557b67ea0f7b788fc31cf392e7ea8b00" exitCode=0 Jun 05 13:11:56.751027 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751028 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="8d1c988d0b22ff8db79281efb6f504b6e469bdc77cfbea912f80e3343f1da01d" exitCode=0 Jun 05 13:11:56.751027 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751036 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="1a12f14b3c3342e08119d2fd7ecde0b7ae54f7d8ed68a0e1b965e024e377d2a9" exitCode=0 Jun 05 13:11:56.751319 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751068 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"3cec09a35fa2ba448e013819dd4abe090bdb032930053bb8fd913e7b61975c80"} Jun 05 13:11:56.751319 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"3bb5dc1acc72d83e66d4e85e6142029f557b67ea0f7b788fc31cf392e7ea8b00"} Jun 05 13:11:56.751319 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751172 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"8d1c988d0b22ff8db79281efb6f504b6e469bdc77cfbea912f80e3343f1da01d"} Jun 05 13:11:56.751319 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:56.751205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"1a12f14b3c3342e08119d2fd7ecde0b7ae54f7d8ed68a0e1b965e024e377d2a9"} Jun 05 13:11:57.422865 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.422809 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" path="/var/lib/kubelet/pods/bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0/volumes" Jun 05 13:11:57.761014 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.760975 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="b9236cec386cf9b5eb4bcca86fc537911c7e85ef8759527b95484140d48fd2aa" exitCode=0 Jun 05 13:11:57.761014 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.761003 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c6b4514-d938-4009-b070-1c78bedef13e" containerID="8f3958b6457decb6d97c64d250e8c38829f2359cb90b31f8d3251fcd51e93d96" exitCode=0 Jun 05 13:11:57.761414 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.761043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"b9236cec386cf9b5eb4bcca86fc537911c7e85ef8759527b95484140d48fd2aa"} Jun 05 13:11:57.761414 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.761112 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"8f3958b6457decb6d97c64d250e8c38829f2359cb90b31f8d3251fcd51e93d96"} Jun 05 13:11:57.800975 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.800944 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:57.950241 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950198 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-tls-assets\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950263 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-web-config\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950301 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-config-out\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950325 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-metrics-client-ca\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950359 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950388 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg5xj\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-kube-api-access-qg5xj\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950414 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-config-volume\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950463 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-trusted-ca-bundle\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950511 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950541 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-web\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950566 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-cluster-tls-config\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950590 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-main-tls\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.950770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950620 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-main-db\") pod \"3c6b4514-d938-4009-b070-1c78bedef13e\" (UID: \"3c6b4514-d938-4009-b070-1c78bedef13e\") " Jun 05 13:11:57.951157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950771 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:57.951157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.950874 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-metrics-client-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:57.951157 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.951084 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:57.952145 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.952109 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:11:57.953362 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.953315 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-config-out" (OuterVolumeSpecName: "config-out") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:11:57.953654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.953625 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:57.954070 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.954008 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:57.954166 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.954058 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:57.954166 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.954129 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-kube-api-access-qg5xj" (OuterVolumeSpecName: "kube-api-access-qg5xj") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "kube-api-access-qg5xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:11:57.954792 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.954757 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-config-volume" (OuterVolumeSpecName: "config-volume") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:57.954977 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.954955 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:57.955748 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.955715 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:57.957700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.957666 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:57.965112 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:57.965033 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-web-config" (OuterVolumeSpecName: "web-config") pod "3c6b4514-d938-4009-b070-1c78bedef13e" (UID: "3c6b4514-d938-4009-b070-1c78bedef13e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:11:58.051300 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051262 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-web-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051300 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051300 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-config-out\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051300 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051309 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051319 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg5xj\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-kube-api-access-qg5xj\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051328 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-config-volume\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051337 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051346 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051355 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051363 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-cluster-tls-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051371 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c6b4514-d938-4009-b070-1c78bedef13e-secret-alertmanager-main-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051379 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c6b4514-d938-4009-b070-1c78bedef13e-alertmanager-main-db\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.051503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.051391 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c6b4514-d938-4009-b070-1c78bedef13e-tls-assets\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:11:58.769026 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.768994 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c6b4514-d938-4009-b070-1c78bedef13e","Type":"ContainerDied","Data":"59cf6b66d6e416e530126330d7d215ab8ead82f8fe815a1bba0481ceb2677149"} Jun 05 13:11:58.769464 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.769060 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:58.769464 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.769072 2572 scope.go:117] "RemoveContainer" containerID="3cec09a35fa2ba448e013819dd4abe090bdb032930053bb8fd913e7b61975c80" Jun 05 13:11:58.777089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.777017 2572 scope.go:117] "RemoveContainer" containerID="b9236cec386cf9b5eb4bcca86fc537911c7e85ef8759527b95484140d48fd2aa" Jun 05 13:11:58.788418 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.788394 2572 scope.go:117] "RemoveContainer" containerID="3bb5dc1acc72d83e66d4e85e6142029f557b67ea0f7b788fc31cf392e7ea8b00" Jun 05 13:11:58.796115 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.796088 2572 scope.go:117] "RemoveContainer" containerID="8f3958b6457decb6d97c64d250e8c38829f2359cb90b31f8d3251fcd51e93d96" Jun 05 13:11:58.802039 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.802009 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:11:58.804146 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.804126 2572 scope.go:117] "RemoveContainer" containerID="8d1c988d0b22ff8db79281efb6f504b6e469bdc77cfbea912f80e3343f1da01d" Jun 05 13:11:58.811782 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.811756 2572 scope.go:117] "RemoveContainer" containerID="1a12f14b3c3342e08119d2fd7ecde0b7ae54f7d8ed68a0e1b965e024e377d2a9" Jun 05 13:11:58.819699 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.819677 2572 scope.go:117] "RemoveContainer" containerID="bba8c065b2d29ea48b9f537a77d677907114052e61915b845176e2ac32c8fe47" Jun 05 13:11:58.828656 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.828631 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:11:58.890640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890555 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:11:58.890873 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890861 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890875 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890884 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-web" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890889 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-web" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890909 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890915 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890924 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890932 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" Jun 05 13:11:58.890941 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890941 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="prom-label-proxy" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890947 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="prom-label-proxy" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890956 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="init-config-reloader" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890961 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="init-config-reloader" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890970 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="alertmanager" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890975 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="alertmanager" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890983 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-metric" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890989 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-metric" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.890996 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="config-reloader" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891001 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="config-reloader" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891044 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="prom-label-proxy" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891054 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891060 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-metric" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891067 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="alertmanager" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891073 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="kube-rbac-proxy-web" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891079 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="696751f7-e782-47cc-823d-06993fed7b13" containerName="registry" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891084 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" containerName="config-reloader" Jun 05 13:11:58.891167 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.891089 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc50ebcc-aaa5-40b6-9416-31bbfaacc4b0" containerName="console" Jun 05 13:11:58.896315 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.896296 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:58.899265 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.899241 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 13:11:58.900404 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.900382 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 13:11:58.901066 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.901048 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 13:11:58.901146 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.901100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 13:11:58.901280 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.901262 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 13:11:58.901423 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.901407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 13:11:58.901592 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.901580 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 13:11:58.901656 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.901636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 13:11:58.902181 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.902164 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rb9zz\"" Jun 05 13:11:58.906348 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.906327 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 13:11:58.919721 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:58.919679 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:11:59.059025 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.058987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059025 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059025 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69124386-147c-489c-9cce-2caa276ad55e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69124386-147c-489c-9cce-2caa276ad55e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059074 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-config-volume\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-web-config\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059263 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69124386-147c-489c-9cce-2caa276ad55e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059463 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69124386-147c-489c-9cce-2caa276ad55e-config-out\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059463 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059463 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059334 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmhg\" (UniqueName: \"kubernetes.io/projected/69124386-147c-489c-9cce-2caa276ad55e-kube-api-access-wpmhg\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059463 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.059463 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.059386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69124386-147c-489c-9cce-2caa276ad55e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160285 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-web-config\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69124386-147c-489c-9cce-2caa276ad55e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160384 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69124386-147c-489c-9cce-2caa276ad55e-config-out\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160577 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmhg\" (UniqueName: \"kubernetes.io/projected/69124386-147c-489c-9cce-2caa276ad55e-kube-api-access-wpmhg\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69124386-147c-489c-9cce-2caa276ad55e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.160770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69124386-147c-489c-9cce-2caa276ad55e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.161114 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69124386-147c-489c-9cce-2caa276ad55e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.161114 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.160817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-config-volume\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.162155 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.161693 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69124386-147c-489c-9cce-2caa276ad55e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.162313 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.162246 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69124386-147c-489c-9cce-2caa276ad55e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.162657 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.162633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69124386-147c-489c-9cce-2caa276ad55e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.163724 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.163693 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.163828 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.163773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.163916 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.163831 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69124386-147c-489c-9cce-2caa276ad55e-config-out\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.163979 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.163963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69124386-147c-489c-9cce-2caa276ad55e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.164222 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.164201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.164629 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.164607 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-web-config\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.164806 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.164787 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-config-volume\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.165397 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.165364 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.165766 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.165749 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69124386-147c-489c-9cce-2caa276ad55e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.171721 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.171686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmhg\" (UniqueName: \"kubernetes.io/projected/69124386-147c-489c-9cce-2caa276ad55e-kube-api-access-wpmhg\") pod \"alertmanager-main-0\" (UID: \"69124386-147c-489c-9cce-2caa276ad55e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.206576 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.206526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:11:59.373203 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.373164 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:11:59.376558 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:11:59.376526 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69124386_147c_489c_9cce_2caa276ad55e.slice/crio-ced4e238df6be558be102daa24c5d02d2f3ddb7189bc0cbf94adec6b29709a60 WatchSource:0}: Error finding container ced4e238df6be558be102daa24c5d02d2f3ddb7189bc0cbf94adec6b29709a60: Status 404 returned error can't find the container with id ced4e238df6be558be102daa24c5d02d2f3ddb7189bc0cbf94adec6b29709a60 Jun 05 13:11:59.423798 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.423765 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6b4514-d938-4009-b070-1c78bedef13e" path="/var/lib/kubelet/pods/3c6b4514-d938-4009-b070-1c78bedef13e/volumes" Jun 05 13:11:59.778227 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.778187 2572 generic.go:356] "Generic (PLEG): container finished" podID="69124386-147c-489c-9cce-2caa276ad55e" containerID="8ac8e981920db2ad3d2bd002150f6961fabde541aca4ed8d49ff34c30fbb28b3" exitCode=0 Jun 05 13:11:59.778685 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.778235 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerDied","Data":"8ac8e981920db2ad3d2bd002150f6961fabde541aca4ed8d49ff34c30fbb28b3"} Jun 05 13:11:59.778685 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:11:59.778292 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"ced4e238df6be558be102daa24c5d02d2f3ddb7189bc0cbf94adec6b29709a60"} Jun 05 13:12:00.786590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:12:00.786541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"2cd00d90f1fb37cdd120121d19034ec05a39b9ea86e9e7d94b5c0da04608e040"} Jun 05 13:12:00.787154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:12:00.786662 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"d7ad5a5af7f602ac917740a95c8f05e8d963397f30463afe911618df41ce5bda"} Jun 05 13:12:00.787154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:12:00.786690 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"971d97abc1cdb18397981a73612846ded630bee82a9da48ae027280815cf5ab8"} Jun 05 13:12:00.787154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:12:00.786715 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"7d02edbfbb4070ab19e1982253a76f4940988c06f1e3a530b792643f0dcd2cc5"} Jun 05 13:12:00.787154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:12:00.786741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"f441dcaea10f86b174286557586cc182a558b8bfdf296663659beb8aa520cc9f"} Jun 05 13:12:00.787154 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:12:00.786766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69124386-147c-489c-9cce-2caa276ad55e","Type":"ContainerStarted","Data":"a569bfaf6b53172d7ddbf9b6b4817f6364123ad6838d599597cb9929a46ae8b6"} Jun 05 13:13:23.753866 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.753814 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=85.739485318 podStartE2EDuration="1m25.753798517s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.313199ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:12:00.847483088 +0000 UTC m=+321.831339886" watchObservedRunningTime="2026-06-05 13:13:23.753798517 +0000 UTC m=+404.737655303" Jun 05 13:13:23.754746 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.754727 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f"] Jun 05 13:13:23.757995 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.757978 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.761958 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.761935 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:13:23.762149 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.762131 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrd7p\"" Jun 05 13:13:23.762372 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.762353 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:13:23.770935 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.770888 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f"] Jun 05 13:13:23.868026 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.867985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbfm\" (UniqueName: \"kubernetes.io/projected/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-kube-api-access-mhbfm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.868200 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.868039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.868200 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.868120 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.968735 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.968686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbfm\" (UniqueName: \"kubernetes.io/projected/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-kube-api-access-mhbfm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.968735 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.968745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.969048 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.968790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.969284 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.969261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.969355 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.969272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:23.982755 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:23.982717 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbfm\" (UniqueName: \"kubernetes.io/projected/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-kube-api-access-mhbfm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:24.068043 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:24.067943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:24.207386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:24.207356 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f"] Jun 05 13:13:24.209759 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:13:24.209725 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09533fb_5e9a_42cd_9559_9d6a8bd4922f.slice/crio-2f5a0397061fae8d1cc30e9ce9c5495223ca0cb2abd75781d3a8184955bd5ee9 WatchSource:0}: Error finding container 2f5a0397061fae8d1cc30e9ce9c5495223ca0cb2abd75781d3a8184955bd5ee9: Status 404 returned error can't find the container with id 2f5a0397061fae8d1cc30e9ce9c5495223ca0cb2abd75781d3a8184955bd5ee9 Jun 05 13:13:24.211555 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:24.211534 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:13:25.116649 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:25.116602 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" event={"ID":"e09533fb-5e9a-42cd-9559-9d6a8bd4922f","Type":"ContainerStarted","Data":"2f5a0397061fae8d1cc30e9ce9c5495223ca0cb2abd75781d3a8184955bd5ee9"} Jun 05 13:13:35.160414 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:35.160372 2572 generic.go:356] "Generic (PLEG): container finished" podID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerID="24540502530b081e8eb3c1ded4bbf6cfc6760c64bf75ede9deb300b3cce8ebd9" exitCode=0 Jun 05 13:13:35.160818 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:35.160458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" event={"ID":"e09533fb-5e9a-42cd-9559-9d6a8bd4922f","Type":"ContainerDied","Data":"24540502530b081e8eb3c1ded4bbf6cfc6760c64bf75ede9deb300b3cce8ebd9"} Jun 05 13:13:36.166590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:36.166552 2572 generic.go:356] "Generic (PLEG): container finished" podID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerID="3ef4f71d1506573ea587c8c8c75b2712aa9e121f5b655e7bea2bb02858d040b5" exitCode=0 Jun 05 13:13:36.166957 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:36.166640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" event={"ID":"e09533fb-5e9a-42cd-9559-9d6a8bd4922f","Type":"ContainerDied","Data":"3ef4f71d1506573ea587c8c8c75b2712aa9e121f5b655e7bea2bb02858d040b5"} Jun 05 13:13:44.204104 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:44.204014 2572 generic.go:356] "Generic (PLEG): container finished" podID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerID="732fa88cde349c5f18b96dd4e98357aa8cb9c070b58313d593a4f3da03dec029" exitCode=0 Jun 05 13:13:44.204104 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:44.204092 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" event={"ID":"e09533fb-5e9a-42cd-9559-9d6a8bd4922f","Type":"ContainerDied","Data":"732fa88cde349c5f18b96dd4e98357aa8cb9c070b58313d593a4f3da03dec029"} Jun 05 13:13:45.347103 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.347071 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:45.447234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.447196 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-util\") pod \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " Jun 05 13:13:45.447446 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.447271 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-bundle\") pod \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " Jun 05 13:13:45.447446 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.447312 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhbfm\" (UniqueName: \"kubernetes.io/projected/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-kube-api-access-mhbfm\") pod \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\" (UID: \"e09533fb-5e9a-42cd-9559-9d6a8bd4922f\") " Jun 05 13:13:45.448035 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.448002 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-bundle" (OuterVolumeSpecName: "bundle") pod "e09533fb-5e9a-42cd-9559-9d6a8bd4922f" (UID: "e09533fb-5e9a-42cd-9559-9d6a8bd4922f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:13:45.449652 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.449611 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-kube-api-access-mhbfm" (OuterVolumeSpecName: "kube-api-access-mhbfm") pod "e09533fb-5e9a-42cd-9559-9d6a8bd4922f" (UID: "e09533fb-5e9a-42cd-9559-9d6a8bd4922f"). InnerVolumeSpecName "kube-api-access-mhbfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:13:45.452197 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.452165 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-util" (OuterVolumeSpecName: "util") pod "e09533fb-5e9a-42cd-9559-9d6a8bd4922f" (UID: "e09533fb-5e9a-42cd-9559-9d6a8bd4922f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:13:45.548196 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.548140 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:13:45.548196 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.548191 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhbfm\" (UniqueName: \"kubernetes.io/projected/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-kube-api-access-mhbfm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:13:45.548196 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:45.548202 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e09533fb-5e9a-42cd-9559-9d6a8bd4922f-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:13:46.213911 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:46.213870 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" event={"ID":"e09533fb-5e9a-42cd-9559-9d6a8bd4922f","Type":"ContainerDied","Data":"2f5a0397061fae8d1cc30e9ce9c5495223ca0cb2abd75781d3a8184955bd5ee9"} Jun 05 13:13:46.214089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:46.213941 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4rr6f" Jun 05 13:13:46.214089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:46.213950 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f5a0397061fae8d1cc30e9ce9c5495223ca0cb2abd75781d3a8184955bd5ee9" Jun 05 13:13:52.818848 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.818767 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt"] Jun 05 13:13:52.819258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819126 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="util" Jun 05 13:13:52.819258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819139 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="util" Jun 05 13:13:52.819258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819148 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="extract" Jun 05 13:13:52.819258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819156 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="extract" Jun 05 13:13:52.819258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819172 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="pull" Jun 05 13:13:52.819258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819177 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="pull" Jun 05 13:13:52.819439 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.819269 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09533fb-5e9a-42cd-9559-9d6a8bd4922f" containerName="extract" Jun 05 13:13:52.822120 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.822103 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:52.825997 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.825967 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 13:13:52.826391 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.826371 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vx888\"" Jun 05 13:13:52.826683 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.826666 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:13:52.839127 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.839101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt"] Jun 05 13:13:52.905030 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.904989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89166582-fa98-4aaa-b916-61868ac22956-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zdgjt\" (UID: \"89166582-fa98-4aaa-b916-61868ac22956\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:52.905030 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:52.905029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d6k9\" (UniqueName: \"kubernetes.io/projected/89166582-fa98-4aaa-b916-61868ac22956-kube-api-access-9d6k9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zdgjt\" (UID: \"89166582-fa98-4aaa-b916-61868ac22956\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:53.006337 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:53.006291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89166582-fa98-4aaa-b916-61868ac22956-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zdgjt\" (UID: \"89166582-fa98-4aaa-b916-61868ac22956\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:53.006337 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:53.006338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d6k9\" (UniqueName: \"kubernetes.io/projected/89166582-fa98-4aaa-b916-61868ac22956-kube-api-access-9d6k9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zdgjt\" (UID: \"89166582-fa98-4aaa-b916-61868ac22956\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:53.006750 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:53.006723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89166582-fa98-4aaa-b916-61868ac22956-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zdgjt\" (UID: \"89166582-fa98-4aaa-b916-61868ac22956\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:53.021634 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:53.021602 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d6k9\" (UniqueName: \"kubernetes.io/projected/89166582-fa98-4aaa-b916-61868ac22956-kube-api-access-9d6k9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-zdgjt\" (UID: \"89166582-fa98-4aaa-b916-61868ac22956\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:53.131708 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:53.131613 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" Jun 05 13:13:53.287822 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:53.287795 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt"] Jun 05 13:13:53.290087 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:13:53.290056 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89166582_fa98_4aaa_b916_61868ac22956.slice/crio-bd43f4c476c2b471203307143c9526ed8b4c56869347bebd93cc22869f1f9a2c WatchSource:0}: Error finding container bd43f4c476c2b471203307143c9526ed8b4c56869347bebd93cc22869f1f9a2c: Status 404 returned error can't find the container with id bd43f4c476c2b471203307143c9526ed8b4c56869347bebd93cc22869f1f9a2c Jun 05 13:13:54.247471 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:54.247428 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" event={"ID":"89166582-fa98-4aaa-b916-61868ac22956","Type":"ContainerStarted","Data":"bd43f4c476c2b471203307143c9526ed8b4c56869347bebd93cc22869f1f9a2c"} Jun 05 13:13:55.254500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:55.254464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" event={"ID":"89166582-fa98-4aaa-b916-61868ac22956","Type":"ContainerStarted","Data":"2d3a88675d0f0fcf9741eea784202e6c55b2b23e05ffa81a9b6b994184a2e5fa"} Jun 05 13:13:55.280441 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:55.280381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-zdgjt" podStartSLOduration=1.434372919 podStartE2EDuration="3.280363111s" totalImagesPullingTime="1.845990192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:55.279252572 +0000 UTC m=+436.263109357" watchObservedRunningTime="2026-06-05 13:13:55.280363111 +0000 UTC m=+436.264219895" Jun 05 13:13:56.754513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.754455 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk"] Jun 05 13:13:56.759654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.759633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.770066 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.770039 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:13:56.770210 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.770098 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:13:56.771270 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.771250 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrd7p\"" Jun 05 13:13:56.795189 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.795158 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk"] Jun 05 13:13:56.839289 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.839247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-987xr\" (UniqueName: \"kubernetes.io/projected/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-kube-api-access-987xr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.839482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.839305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.839482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.839336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.940345 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.940311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-987xr\" (UniqueName: \"kubernetes.io/projected/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-kube-api-access-987xr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.940537 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.940358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.940537 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.940385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.940810 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.940788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:56.940892 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:56.940819 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:57.003003 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.002968 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-987xr\" (UniqueName: \"kubernetes.io/projected/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-kube-api-access-987xr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:57.068976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.068853 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:13:57.338051 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.337935 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk"] Jun 05 13:13:57.340940 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:13:57.340887 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a34f4e_dfa5_403c_a5e1_ad0e9ee3877e.slice/crio-92aa7ebb740137a39eb1e083c2ff3f93de05efc3a6730dd26676df6394439fba WatchSource:0}: Error finding container 92aa7ebb740137a39eb1e083c2ff3f93de05efc3a6730dd26676df6394439fba: Status 404 returned error can't find the container with id 92aa7ebb740137a39eb1e083c2ff3f93de05efc3a6730dd26676df6394439fba Jun 05 13:13:57.457212 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:13:57.457176 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a34f4e_dfa5_403c_a5e1_ad0e9ee3877e.slice/crio-f9b6039bac1328fef01a30f438a172a1ac69dfa2533d386012e85d8c54a543e0.scope\": RecentStats: unable to find data in memory cache]" Jun 05 13:13:57.479188 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.479154 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-46z2v"] Jun 05 13:13:57.482982 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.482960 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.486050 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.486024 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 13:13:57.486150 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.486121 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 13:13:57.501104 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.501063 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-46z2v"] Jun 05 13:13:57.644807 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.644706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2vh\" (UniqueName: \"kubernetes.io/projected/f13d3034-a471-48ef-aeaa-991ea67ac99f-kube-api-access-fw2vh\") pod \"cert-manager-webhook-7dc76cbb94-46z2v\" (UID: \"f13d3034-a471-48ef-aeaa-991ea67ac99f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.644807 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.644760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f13d3034-a471-48ef-aeaa-991ea67ac99f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-46z2v\" (UID: \"f13d3034-a471-48ef-aeaa-991ea67ac99f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.746145 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.746103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2vh\" (UniqueName: \"kubernetes.io/projected/f13d3034-a471-48ef-aeaa-991ea67ac99f-kube-api-access-fw2vh\") pod \"cert-manager-webhook-7dc76cbb94-46z2v\" (UID: \"f13d3034-a471-48ef-aeaa-991ea67ac99f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.746337 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.746159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f13d3034-a471-48ef-aeaa-991ea67ac99f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-46z2v\" (UID: \"f13d3034-a471-48ef-aeaa-991ea67ac99f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.767342 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.767301 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2vh\" (UniqueName: \"kubernetes.io/projected/f13d3034-a471-48ef-aeaa-991ea67ac99f-kube-api-access-fw2vh\") pod \"cert-manager-webhook-7dc76cbb94-46z2v\" (UID: \"f13d3034-a471-48ef-aeaa-991ea67ac99f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.774084 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.774057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f13d3034-a471-48ef-aeaa-991ea67ac99f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-46z2v\" (UID: \"f13d3034-a471-48ef-aeaa-991ea67ac99f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.809743 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.809685 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:13:57.971958 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:57.971931 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-46z2v"] Jun 05 13:13:57.973932 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:13:57.973813 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf13d3034_a471_48ef_aeaa_991ea67ac99f.slice/crio-665ea88171792963520f9b930adba37690a0b6feedf6670be7b104a696d17261 WatchSource:0}: Error finding container 665ea88171792963520f9b930adba37690a0b6feedf6670be7b104a696d17261: Status 404 returned error can't find the container with id 665ea88171792963520f9b930adba37690a0b6feedf6670be7b104a696d17261 Jun 05 13:13:58.270221 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:58.270178 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" event={"ID":"f13d3034-a471-48ef-aeaa-991ea67ac99f","Type":"ContainerStarted","Data":"665ea88171792963520f9b930adba37690a0b6feedf6670be7b104a696d17261"} Jun 05 13:13:58.271925 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:58.271877 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerID="f9b6039bac1328fef01a30f438a172a1ac69dfa2533d386012e85d8c54a543e0" exitCode=0 Jun 05 13:13:58.272107 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:58.271963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" event={"ID":"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e","Type":"ContainerDied","Data":"f9b6039bac1328fef01a30f438a172a1ac69dfa2533d386012e85d8c54a543e0"} Jun 05 13:13:58.272107 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:13:58.272029 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" event={"ID":"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e","Type":"ContainerStarted","Data":"92aa7ebb740137a39eb1e083c2ff3f93de05efc3a6730dd26676df6394439fba"} Jun 05 13:14:02.292997 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:02.292962 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerID="03848776f02e8c047668b4b91faa65715ecdbf6d17d094e47b180f2fd7b568c2" exitCode=0 Jun 05 13:14:02.293501 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:02.293051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" event={"ID":"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e","Type":"ContainerDied","Data":"03848776f02e8c047668b4b91faa65715ecdbf6d17d094e47b180f2fd7b568c2"} Jun 05 13:14:02.294577 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:02.294551 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" event={"ID":"f13d3034-a471-48ef-aeaa-991ea67ac99f","Type":"ContainerStarted","Data":"2b1b69d6024c307afeb18c3f964f0d350089cf46aaca4c510de64a3586e73350"} Jun 05 13:14:02.294712 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:02.294691 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:14:03.300428 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:03.300391 2572 generic.go:356] "Generic (PLEG): container finished" podID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerID="c4a6ac2a15d43ba3eaa554c3cbaaf0f7d69f7d9acb93a99419408c8fe7c7d303" exitCode=0 Jun 05 13:14:03.300838 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:03.300485 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" event={"ID":"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e","Type":"ContainerDied","Data":"c4a6ac2a15d43ba3eaa554c3cbaaf0f7d69f7d9acb93a99419408c8fe7c7d303"} Jun 05 13:14:03.332868 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:03.332808 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" podStartSLOduration=2.927867413 podStartE2EDuration="6.332791283s" totalImagesPullingTime="3.40492387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:02.406353388 +0000 UTC m=+443.390210186" watchObservedRunningTime="2026-06-05 13:14:03.332791283 +0000 UTC m=+444.316648068" Jun 05 13:14:04.458344 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.458308 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:14:04.608431 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.608342 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-bundle\") pod \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " Jun 05 13:14:04.608431 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.608379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-util\") pod \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " Jun 05 13:14:04.608620 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.608459 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-987xr\" (UniqueName: \"kubernetes.io/projected/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-kube-api-access-987xr\") pod \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\" (UID: \"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e\") " Jun 05 13:14:04.608816 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.608780 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-bundle" (OuterVolumeSpecName: "bundle") pod "c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" (UID: "c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:14:04.610716 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.610682 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-kube-api-access-987xr" (OuterVolumeSpecName: "kube-api-access-987xr") pod "c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" (UID: "c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e"). InnerVolumeSpecName "kube-api-access-987xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:14:04.613647 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.613594 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-util" (OuterVolumeSpecName: "util") pod "c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" (UID: "c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:14:04.709258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.709213 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-987xr\" (UniqueName: \"kubernetes.io/projected/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-kube-api-access-987xr\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:14:04.709258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.709249 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:14:04.709258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:04.709262 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:14:05.310995 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:05.310964 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" Jun 05 13:14:05.310995 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:05.310970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqvzhk" event={"ID":"c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e","Type":"ContainerDied","Data":"92aa7ebb740137a39eb1e083c2ff3f93de05efc3a6730dd26676df6394439fba"} Jun 05 13:14:05.311204 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:05.311015 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92aa7ebb740137a39eb1e083c2ff3f93de05efc3a6730dd26676df6394439fba" Jun 05 13:14:08.303796 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:08.303752 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-46z2v" Jun 05 13:14:09.964375 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964325 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf"] Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964645 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="util" Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964657 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="util" Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964670 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="extract" Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964676 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="extract" Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964684 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="pull" Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964689 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="pull" Jun 05 13:14:09.964762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.964741 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a34f4e-dfa5-403c-a5e1-ad0e9ee3877e" containerName="extract" Jun 05 13:14:09.966983 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.966965 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:09.969359 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.969331 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:14:09.969556 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.969542 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9jl72\"" Jun 05 13:14:09.970162 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.970149 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 13:14:09.979112 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:09.979087 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf"] Jun 05 13:14:10.158757 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.158718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2ds8\" (UniqueName: \"kubernetes.io/projected/357fd7e0-4e11-46a3-b8ff-6413dba17a95-kube-api-access-q2ds8\") pod \"openshift-lws-operator-fd8ccff4c-8sbhf\" (UID: \"357fd7e0-4e11-46a3-b8ff-6413dba17a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.158968 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.158768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357fd7e0-4e11-46a3-b8ff-6413dba17a95-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8sbhf\" (UID: \"357fd7e0-4e11-46a3-b8ff-6413dba17a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.259638 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.259603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357fd7e0-4e11-46a3-b8ff-6413dba17a95-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8sbhf\" (UID: \"357fd7e0-4e11-46a3-b8ff-6413dba17a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.259844 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.259708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2ds8\" (UniqueName: \"kubernetes.io/projected/357fd7e0-4e11-46a3-b8ff-6413dba17a95-kube-api-access-q2ds8\") pod \"openshift-lws-operator-fd8ccff4c-8sbhf\" (UID: \"357fd7e0-4e11-46a3-b8ff-6413dba17a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.260085 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.260059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/357fd7e0-4e11-46a3-b8ff-6413dba17a95-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8sbhf\" (UID: \"357fd7e0-4e11-46a3-b8ff-6413dba17a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.271459 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.271429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2ds8\" (UniqueName: \"kubernetes.io/projected/357fd7e0-4e11-46a3-b8ff-6413dba17a95-kube-api-access-q2ds8\") pod \"openshift-lws-operator-fd8ccff4c-8sbhf\" (UID: \"357fd7e0-4e11-46a3-b8ff-6413dba17a95\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.276217 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.276199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" Jun 05 13:14:10.417921 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:10.417865 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf"] Jun 05 13:14:10.422109 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:10.422077 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod357fd7e0_4e11_46a3_b8ff_6413dba17a95.slice/crio-827a7ebc0d552ea5db4454cb8896d29d63865e83a621feb51a041ff28fd115c4 WatchSource:0}: Error finding container 827a7ebc0d552ea5db4454cb8896d29d63865e83a621feb51a041ff28fd115c4: Status 404 returned error can't find the container with id 827a7ebc0d552ea5db4454cb8896d29d63865e83a621feb51a041ff28fd115c4 Jun 05 13:14:11.340565 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:11.340513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" event={"ID":"357fd7e0-4e11-46a3-b8ff-6413dba17a95","Type":"ContainerStarted","Data":"827a7ebc0d552ea5db4454cb8896d29d63865e83a621feb51a041ff28fd115c4"} Jun 05 13:14:13.351392 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:13.351352 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" event={"ID":"357fd7e0-4e11-46a3-b8ff-6413dba17a95","Type":"ContainerStarted","Data":"75ae9ee8d78dd493bf879e2394842df3d6777787f3c4fbd94415d2c9265918be"} Jun 05 13:14:13.369672 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:13.369608 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8sbhf" podStartSLOduration=2.394960831 podStartE2EDuration="4.369590903s" totalImagesPullingTime="1.974630072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:13.368939296 +0000 UTC m=+454.352796071" watchObservedRunningTime="2026-06-05 13:14:13.369590903 +0000 UTC m=+454.353447688" Jun 05 13:14:15.892846 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.892801 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r"] Jun 05 13:14:15.896410 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.896391 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:15.898814 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.898780 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:14:15.899485 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.899466 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrd7p\"" Jun 05 13:14:15.899606 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.899520 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:14:15.905529 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.905504 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2m5\" (UniqueName: \"kubernetes.io/projected/8b156a89-0ad8-455c-ade2-291ac41444b2-kube-api-access-tr2m5\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:15.905647 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.905542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:15.905647 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.905600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:15.909740 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:15.909716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r"] Jun 05 13:14:16.006126 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.006087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.006316 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.006134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.006316 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.006189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2m5\" (UniqueName: \"kubernetes.io/projected/8b156a89-0ad8-455c-ade2-291ac41444b2-kube-api-access-tr2m5\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.006541 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.006520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.006581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.006532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.015283 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.015253 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2m5\" (UniqueName: \"kubernetes.io/projected/8b156a89-0ad8-455c-ade2-291ac41444b2-kube-api-access-tr2m5\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.205368 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.205269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:16.337412 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.337240 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r"] Jun 05 13:14:16.340004 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:16.339977 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b156a89_0ad8_455c_ade2_291ac41444b2.slice/crio-c3ef7e1e76d83aa323aabec7ba377da28ac59be25301eff6b958ded923acbdf7 WatchSource:0}: Error finding container c3ef7e1e76d83aa323aabec7ba377da28ac59be25301eff6b958ded923acbdf7: Status 404 returned error can't find the container with id c3ef7e1e76d83aa323aabec7ba377da28ac59be25301eff6b958ded923acbdf7 Jun 05 13:14:16.365096 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.365054 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" event={"ID":"8b156a89-0ad8-455c-ade2-291ac41444b2","Type":"ContainerStarted","Data":"c3ef7e1e76d83aa323aabec7ba377da28ac59be25301eff6b958ded923acbdf7"} Jun 05 13:14:16.889277 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.889241 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-szswn"] Jun 05 13:14:16.892585 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.892542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:16.895375 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.895330 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bw54d\"" Jun 05 13:14:16.903066 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.903032 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-szswn"] Jun 05 13:14:16.912576 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.912539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c3aaec8-4317-4d97-a979-6ac313235cdc-bound-sa-token\") pod \"cert-manager-59c77684cc-szswn\" (UID: \"0c3aaec8-4317-4d97-a979-6ac313235cdc\") " pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:16.912732 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:16.912603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhr8b\" (UniqueName: \"kubernetes.io/projected/0c3aaec8-4317-4d97-a979-6ac313235cdc-kube-api-access-nhr8b\") pod \"cert-manager-59c77684cc-szswn\" (UID: \"0c3aaec8-4317-4d97-a979-6ac313235cdc\") " pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:17.013617 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.013579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c3aaec8-4317-4d97-a979-6ac313235cdc-bound-sa-token\") pod \"cert-manager-59c77684cc-szswn\" (UID: \"0c3aaec8-4317-4d97-a979-6ac313235cdc\") " pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:17.013826 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.013650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhr8b\" (UniqueName: \"kubernetes.io/projected/0c3aaec8-4317-4d97-a979-6ac313235cdc-kube-api-access-nhr8b\") pod \"cert-manager-59c77684cc-szswn\" (UID: \"0c3aaec8-4317-4d97-a979-6ac313235cdc\") " pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:17.023519 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.023482 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c3aaec8-4317-4d97-a979-6ac313235cdc-bound-sa-token\") pod \"cert-manager-59c77684cc-szswn\" (UID: \"0c3aaec8-4317-4d97-a979-6ac313235cdc\") " pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:17.023666 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.023590 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhr8b\" (UniqueName: \"kubernetes.io/projected/0c3aaec8-4317-4d97-a979-6ac313235cdc-kube-api-access-nhr8b\") pod \"cert-manager-59c77684cc-szswn\" (UID: \"0c3aaec8-4317-4d97-a979-6ac313235cdc\") " pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:17.207544 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.207447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-szswn" Jun 05 13:14:17.337145 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.337117 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-szswn"] Jun 05 13:14:17.339494 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:17.339464 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c3aaec8_4317_4d97_a979_6ac313235cdc.slice/crio-01bb259aef89ed38c3397808bc68ab05f39bbfbb90656c9e01b17c6fc327c2d4 WatchSource:0}: Error finding container 01bb259aef89ed38c3397808bc68ab05f39bbfbb90656c9e01b17c6fc327c2d4: Status 404 returned error can't find the container with id 01bb259aef89ed38c3397808bc68ab05f39bbfbb90656c9e01b17c6fc327c2d4 Jun 05 13:14:17.370996 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.370962 2572 generic.go:356] "Generic (PLEG): container finished" podID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerID="dc7ef7aaa3068c4f649cd5608dc0fafce7d785a5e1b40bdf67efc679de84615a" exitCode=0 Jun 05 13:14:17.371142 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.371047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" event={"ID":"8b156a89-0ad8-455c-ade2-291ac41444b2","Type":"ContainerDied","Data":"dc7ef7aaa3068c4f649cd5608dc0fafce7d785a5e1b40bdf67efc679de84615a"} Jun 05 13:14:17.372330 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:17.372299 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-szswn" event={"ID":"0c3aaec8-4317-4d97-a979-6ac313235cdc","Type":"ContainerStarted","Data":"01bb259aef89ed38c3397808bc68ab05f39bbfbb90656c9e01b17c6fc327c2d4"} Jun 05 13:14:18.379015 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:18.378971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-szswn" event={"ID":"0c3aaec8-4317-4d97-a979-6ac313235cdc","Type":"ContainerStarted","Data":"5c90a82452c7ac4d7d2a165faa9069b79f6c7248570ed2eaa0597c3f712e7d53"} Jun 05 13:14:18.380773 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:18.380741 2572 generic.go:356] "Generic (PLEG): container finished" podID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerID="7f68dfeef3d685e0d71fe0abd54a0282a9631bea0ecc770405b39b53cf0180a6" exitCode=0 Jun 05 13:14:18.380773 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:18.380774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" event={"ID":"8b156a89-0ad8-455c-ade2-291ac41444b2","Type":"ContainerDied","Data":"7f68dfeef3d685e0d71fe0abd54a0282a9631bea0ecc770405b39b53cf0180a6"} Jun 05 13:14:18.394616 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:18.394564 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-szswn" podStartSLOduration=2.394545446 podStartE2EDuration="2.394545446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:18.39405562 +0000 UTC m=+459.377912404" watchObservedRunningTime="2026-06-05 13:14:18.394545446 +0000 UTC m=+459.378402231" Jun 05 13:14:19.388752 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:19.388706 2572 generic.go:356] "Generic (PLEG): container finished" podID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerID="a175f19e8f3fbdf188cbf394b41effe459383a35854c8625cd2ddd57f048c9e0" exitCode=0 Jun 05 13:14:19.389258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:19.388781 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" event={"ID":"8b156a89-0ad8-455c-ade2-291ac41444b2","Type":"ContainerDied","Data":"a175f19e8f3fbdf188cbf394b41effe459383a35854c8625cd2ddd57f048c9e0"} Jun 05 13:14:20.529511 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.529478 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:20.537400 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.537366 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-bundle\") pod \"8b156a89-0ad8-455c-ade2-291ac41444b2\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " Jun 05 13:14:20.537501 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.537412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr2m5\" (UniqueName: \"kubernetes.io/projected/8b156a89-0ad8-455c-ade2-291ac41444b2-kube-api-access-tr2m5\") pod \"8b156a89-0ad8-455c-ade2-291ac41444b2\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " Jun 05 13:14:20.537501 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.537462 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-util\") pod \"8b156a89-0ad8-455c-ade2-291ac41444b2\" (UID: \"8b156a89-0ad8-455c-ade2-291ac41444b2\") " Jun 05 13:14:20.538241 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.538213 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-bundle" (OuterVolumeSpecName: "bundle") pod "8b156a89-0ad8-455c-ade2-291ac41444b2" (UID: "8b156a89-0ad8-455c-ade2-291ac41444b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:14:20.539628 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.539598 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b156a89-0ad8-455c-ade2-291ac41444b2-kube-api-access-tr2m5" (OuterVolumeSpecName: "kube-api-access-tr2m5") pod "8b156a89-0ad8-455c-ade2-291ac41444b2" (UID: "8b156a89-0ad8-455c-ade2-291ac41444b2"). InnerVolumeSpecName "kube-api-access-tr2m5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:14:20.543095 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.543049 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-util" (OuterVolumeSpecName: "util") pod "8b156a89-0ad8-455c-ade2-291ac41444b2" (UID: "8b156a89-0ad8-455c-ade2-291ac41444b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:14:20.643325 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.638675 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:14:20.643522 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.643340 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b156a89-0ad8-455c-ade2-291ac41444b2-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:14:20.643522 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:20.643357 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr2m5\" (UniqueName: \"kubernetes.io/projected/8b156a89-0ad8-455c-ade2-291ac41444b2-kube-api-access-tr2m5\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:14:21.399725 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:21.399683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" event={"ID":"8b156a89-0ad8-455c-ade2-291ac41444b2","Type":"ContainerDied","Data":"c3ef7e1e76d83aa323aabec7ba377da28ac59be25301eff6b958ded923acbdf7"} Jun 05 13:14:21.399927 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:21.399776 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3ef7e1e76d83aa323aabec7ba377da28ac59be25301eff6b958ded923acbdf7" Jun 05 13:14:21.399927 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:21.399705 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdqg54r" Jun 05 13:14:28.718773 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.718732 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l"] Jun 05 13:14:28.719236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719142 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="util" Jun 05 13:14:28.719236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719159 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="util" Jun 05 13:14:28.719236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719177 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="extract" Jun 05 13:14:28.719236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719183 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="extract" Jun 05 13:14:28.719236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719196 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="pull" Jun 05 13:14:28.719236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719202 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="pull" Jun 05 13:14:28.719422 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.719256 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b156a89-0ad8-455c-ade2-291ac41444b2" containerName="extract" Jun 05 13:14:28.722887 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.722858 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.725817 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.725786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-49q62\"" Jun 05 13:14:28.726004 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.725971 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 13:14:28.726184 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.726161 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 13:14:28.726276 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.726182 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 13:14:28.726276 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.726255 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 13:14:28.741739 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.741707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l"] Jun 05 13:14:28.809626 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.809580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.809626 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.809632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-tmp\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.809881 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.809664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.809881 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.809760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-manifests\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.809881 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.809798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gd4r\" (UniqueName: \"kubernetes.io/projected/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-kube-api-access-7gd4r\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.911195 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.911127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-manifests\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.911388 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.911214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gd4r\" (UniqueName: \"kubernetes.io/projected/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-kube-api-access-7gd4r\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.911388 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.911286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.911388 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.911322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-tmp\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.911388 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.911355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.911681 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.911653 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-manifests\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.913640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.913616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-tmp\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.913946 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.913924 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.913995 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.913949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:28.923708 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:28.923667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gd4r\" (UniqueName: \"kubernetes.io/projected/90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc-kube-api-access-7gd4r\") pod \"opendatahub-operator-controller-manager-58b9f446d7-6rk9l\" (UID: \"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc\") " pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:29.034466 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:29.034427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:29.188275 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:29.188242 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l"] Jun 05 13:14:29.191150 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:29.191119 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cb1ef8_b1ac_44d5_9fac_69a3b1dff5bc.slice/crio-e8b1d82518a1c7057662a524b704f85b6c39fdb560ea7332fe69911b27da8bff WatchSource:0}: Error finding container e8b1d82518a1c7057662a524b704f85b6c39fdb560ea7332fe69911b27da8bff: Status 404 returned error can't find the container with id e8b1d82518a1c7057662a524b704f85b6c39fdb560ea7332fe69911b27da8bff Jun 05 13:14:29.440533 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:29.440414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" event={"ID":"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc","Type":"ContainerStarted","Data":"e8b1d82518a1c7057662a524b704f85b6c39fdb560ea7332fe69911b27da8bff"} Jun 05 13:14:32.461345 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:32.461241 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" event={"ID":"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc","Type":"ContainerStarted","Data":"6c680b1fc0984549440740727ce6797d5fc9e6317c841e2ba3653123e39acbd2"} Jun 05 13:14:33.467801 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:33.467698 2572 generic.go:356] "Generic (PLEG): container finished" podID="90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc" containerID="6c680b1fc0984549440740727ce6797d5fc9e6317c841e2ba3653123e39acbd2" exitCode=0 Jun 05 13:14:33.467801 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:33.467736 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" event={"ID":"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc","Type":"ContainerDied","Data":"6c680b1fc0984549440740727ce6797d5fc9e6317c841e2ba3653123e39acbd2"} Jun 05 13:14:34.475376 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:34.475340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" event={"ID":"90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc","Type":"ContainerStarted","Data":"3d1ebef429ef8a1a626104ee425c0b43c124fb70da1d27ba41c86d6044513cea"} Jun 05 13:14:34.475791 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:34.475476 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:34.497872 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:34.497817 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" podStartSLOduration=2.360702771 podStartE2EDuration="6.497801084s" totalImagesPullingTime="3.089184292s" totalInitContainerRuntime="1.047914021s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:34.497525092 +0000 UTC m=+475.481381877" watchObservedRunningTime="2026-06-05 13:14:34.497801084 +0000 UTC m=+475.481657868" Jun 05 13:14:45.482700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:45.482660 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58b9f446d7-6rk9l" Jun 05 13:14:58.666268 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.666228 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7x7ll"] Jun 05 13:14:58.671192 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.671165 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:58.674466 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.674436 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bqr24\"" Jun 05 13:14:58.674616 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.674472 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 13:14:58.688354 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.688307 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj"] Jun 05 13:14:58.691783 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.691756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.694743 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.694721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-blpgk\"" Jun 05 13:14:58.698117 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.698090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 13:14:58.701666 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.701640 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7x7ll"] Jun 05 13:14:58.716295 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.716257 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj"] Jun 05 13:14:58.771248 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.771209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31da7ce3-8120-4e65-bde2-381a87b6dbc0-cert\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:58.771248 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.771252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwnj2\" (UniqueName: \"kubernetes.io/projected/34d4ecc7-4288-4a65-b85c-1cc46656dab0-kube-api-access-gwnj2\") pod \"llmisvc-controller-manager-864bfd7bc9-lpjbj\" (UID: \"34d4ecc7-4288-4a65-b85c-1cc46656dab0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.771491 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.771271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d4ecc7-4288-4a65-b85c-1cc46656dab0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lpjbj\" (UID: \"34d4ecc7-4288-4a65-b85c-1cc46656dab0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.771491 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.771350 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpq28\" (UniqueName: \"kubernetes.io/projected/31da7ce3-8120-4e65-bde2-381a87b6dbc0-kube-api-access-hpq28\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:58.872513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.872475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31da7ce3-8120-4e65-bde2-381a87b6dbc0-cert\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:58.872513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.872515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnj2\" (UniqueName: \"kubernetes.io/projected/34d4ecc7-4288-4a65-b85c-1cc46656dab0-kube-api-access-gwnj2\") pod \"llmisvc-controller-manager-864bfd7bc9-lpjbj\" (UID: \"34d4ecc7-4288-4a65-b85c-1cc46656dab0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.872724 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.872534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d4ecc7-4288-4a65-b85c-1cc46656dab0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lpjbj\" (UID: \"34d4ecc7-4288-4a65-b85c-1cc46656dab0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.872724 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.872558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpq28\" (UniqueName: \"kubernetes.io/projected/31da7ce3-8120-4e65-bde2-381a87b6dbc0-kube-api-access-hpq28\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:58.872724 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:14:58.872647 2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 05 13:14:58.872821 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:14:58.872738 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31da7ce3-8120-4e65-bde2-381a87b6dbc0-cert podName:31da7ce3-8120-4e65-bde2-381a87b6dbc0 nodeName:}" failed. No retries permitted until 2026-06-05 13:14:59.372716142 +0000 UTC m=+500.356572905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/31da7ce3-8120-4e65-bde2-381a87b6dbc0-cert") pod "kserve-controller-manager-69fc866d76-7x7ll" (UID: "31da7ce3-8120-4e65-bde2-381a87b6dbc0") : secret "kserve-webhook-server-cert" not found Jun 05 13:14:58.875014 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.874981 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d4ecc7-4288-4a65-b85c-1cc46656dab0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lpjbj\" (UID: \"34d4ecc7-4288-4a65-b85c-1cc46656dab0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.900325 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.900281 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwnj2\" (UniqueName: \"kubernetes.io/projected/34d4ecc7-4288-4a65-b85c-1cc46656dab0-kube-api-access-gwnj2\") pod \"llmisvc-controller-manager-864bfd7bc9-lpjbj\" (UID: \"34d4ecc7-4288-4a65-b85c-1cc46656dab0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:58.907113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.907071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpq28\" (UniqueName: \"kubernetes.io/projected/31da7ce3-8120-4e65-bde2-381a87b6dbc0-kube-api-access-hpq28\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:58.933144 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.933056 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p"] Jun 05 13:14:58.936772 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.936747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:58.939771 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.939747 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 13:14:58.940261 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.940236 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 13:14:58.950775 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:58.950751 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p"] Jun 05 13:14:59.002531 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.002497 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:14:59.036660 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.036623 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk"] Jun 05 13:14:59.040435 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.040406 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.046003 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.045978 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrd7p\"" Jun 05 13:14:59.046580 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.046559 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:14:59.046724 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.046589 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:14:59.067544 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.067449 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk"] Jun 05 13:14:59.076224 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.075772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6196143-142a-434c-a2f0-5c55d21810fe-tls-certs\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.076224 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.075832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26cl\" (UniqueName: \"kubernetes.io/projected/f6196143-142a-434c-a2f0-5c55d21810fe-kube-api-access-d26cl\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.076224 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.075937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6196143-142a-434c-a2f0-5c55d21810fe-tmp\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.177216 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.177176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.177216 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.177216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.177500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.177300 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6196143-142a-434c-a2f0-5c55d21810fe-tls-certs\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.177500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.177369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d26cl\" (UniqueName: \"kubernetes.io/projected/f6196143-142a-434c-a2f0-5c55d21810fe-kube-api-access-d26cl\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.177500 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.177437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pslw\" (UniqueName: \"kubernetes.io/projected/5d5201a7-5b92-4610-bd54-e0af0f664f0c-kube-api-access-4pslw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.177654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.177510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6196143-142a-434c-a2f0-5c55d21810fe-tmp\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.179598 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.179577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6196143-142a-434c-a2f0-5c55d21810fe-tmp\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.179821 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.179804 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6196143-142a-434c-a2f0-5c55d21810fe-tls-certs\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.195751 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.195723 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj"] Jun 05 13:14:59.198566 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:59.198536 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34d4ecc7_4288_4a65_b85c_1cc46656dab0.slice/crio-aa0f4270af2f47e9afa3bd4b3452578e47ca6b21dd68003b2ee477f39efcfbb4 WatchSource:0}: Error finding container aa0f4270af2f47e9afa3bd4b3452578e47ca6b21dd68003b2ee477f39efcfbb4: Status 404 returned error can't find the container with id aa0f4270af2f47e9afa3bd4b3452578e47ca6b21dd68003b2ee477f39efcfbb4 Jun 05 13:14:59.199338 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.199315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26cl\" (UniqueName: \"kubernetes.io/projected/f6196143-142a-434c-a2f0-5c55d21810fe-kube-api-access-d26cl\") pod \"kube-auth-proxy-f65db7bc7-sr96p\" (UID: \"f6196143-142a-434c-a2f0-5c55d21810fe\") " pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.247071 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.247027 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" Jun 05 13:14:59.278959 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.278884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.279125 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.278985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.279125 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.279087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pslw\" (UniqueName: \"kubernetes.io/projected/5d5201a7-5b92-4610-bd54-e0af0f664f0c-kube-api-access-4pslw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.279346 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.279320 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.279382 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.279330 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.300582 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.300461 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pslw\" (UniqueName: \"kubernetes.io/projected/5d5201a7-5b92-4610-bd54-e0af0f664f0c-kube-api-access-4pslw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.351056 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.351011 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:14:59.379840 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.379799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31da7ce3-8120-4e65-bde2-381a87b6dbc0-cert\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:59.382441 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.382409 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31da7ce3-8120-4e65-bde2-381a87b6dbc0-cert\") pod \"kserve-controller-manager-69fc866d76-7x7ll\" (UID: \"31da7ce3-8120-4e65-bde2-381a87b6dbc0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:59.387132 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.387036 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p"] Jun 05 13:14:59.390451 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:59.390424 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6196143_142a_434c_a2f0_5c55d21810fe.slice/crio-425ad03427caa166939d0c33b357d6f0a8977e18e7484d2c273e23e716070ab8 WatchSource:0}: Error finding container 425ad03427caa166939d0c33b357d6f0a8977e18e7484d2c273e23e716070ab8: Status 404 returned error can't find the container with id 425ad03427caa166939d0c33b357d6f0a8977e18e7484d2c273e23e716070ab8 Jun 05 13:14:59.499124 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.499097 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk"] Jun 05 13:14:59.500839 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:59.500810 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5201a7_5b92_4610_bd54_e0af0f664f0c.slice/crio-b0ebb0674a6c44e19f415c780cc5eefe83aabb432d91b8af8c2dadb5edc2a694 WatchSource:0}: Error finding container b0ebb0674a6c44e19f415c780cc5eefe83aabb432d91b8af8c2dadb5edc2a694: Status 404 returned error can't find the container with id b0ebb0674a6c44e19f415c780cc5eefe83aabb432d91b8af8c2dadb5edc2a694 Jun 05 13:14:59.581775 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.581730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:14:59.612689 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.612647 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" event={"ID":"5d5201a7-5b92-4610-bd54-e0af0f664f0c","Type":"ContainerStarted","Data":"fa3a9f5028afb4f3e2b7229d4f1bef916fb4919b184c66bbd5936dce1607e1f8"} Jun 05 13:14:59.612888 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.612716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" event={"ID":"5d5201a7-5b92-4610-bd54-e0af0f664f0c","Type":"ContainerStarted","Data":"b0ebb0674a6c44e19f415c780cc5eefe83aabb432d91b8af8c2dadb5edc2a694"} Jun 05 13:14:59.614159 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.614103 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" event={"ID":"f6196143-142a-434c-a2f0-5c55d21810fe","Type":"ContainerStarted","Data":"425ad03427caa166939d0c33b357d6f0a8977e18e7484d2c273e23e716070ab8"} Jun 05 13:14:59.615642 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.615607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" event={"ID":"34d4ecc7-4288-4a65-b85c-1cc46656dab0","Type":"ContainerStarted","Data":"aa0f4270af2f47e9afa3bd4b3452578e47ca6b21dd68003b2ee477f39efcfbb4"} Jun 05 13:14:59.743443 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:14:59.743410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7x7ll"] Jun 05 13:14:59.745509 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:14:59.745475 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31da7ce3_8120_4e65_bde2_381a87b6dbc0.slice/crio-2b5becb9469ed21acea1dfb5a3f9bf287af289edd19706c6110be49fe794b38e WatchSource:0}: Error finding container 2b5becb9469ed21acea1dfb5a3f9bf287af289edd19706c6110be49fe794b38e: Status 404 returned error can't find the container with id 2b5becb9469ed21acea1dfb5a3f9bf287af289edd19706c6110be49fe794b38e Jun 05 13:15:00.627600 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:00.627558 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" event={"ID":"31da7ce3-8120-4e65-bde2-381a87b6dbc0","Type":"ContainerStarted","Data":"2b5becb9469ed21acea1dfb5a3f9bf287af289edd19706c6110be49fe794b38e"} Jun 05 13:15:00.629891 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:00.629855 2572 generic.go:356] "Generic (PLEG): container finished" podID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerID="fa3a9f5028afb4f3e2b7229d4f1bef916fb4919b184c66bbd5936dce1607e1f8" exitCode=0 Jun 05 13:15:00.630069 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:00.629969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" event={"ID":"5d5201a7-5b92-4610-bd54-e0af0f664f0c","Type":"ContainerDied","Data":"fa3a9f5028afb4f3e2b7229d4f1bef916fb4919b184c66bbd5936dce1607e1f8"} Jun 05 13:15:04.655007 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.654959 2572 generic.go:356] "Generic (PLEG): container finished" podID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerID="83296266964e46e74a3147182ebd6e9d8dd818871ea31904d863fdc90c2e3f5e" exitCode=0 Jun 05 13:15:04.655490 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.655076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" event={"ID":"5d5201a7-5b92-4610-bd54-e0af0f664f0c","Type":"ContainerDied","Data":"83296266964e46e74a3147182ebd6e9d8dd818871ea31904d863fdc90c2e3f5e"} Jun 05 13:15:04.657086 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.657053 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" event={"ID":"f6196143-142a-434c-a2f0-5c55d21810fe","Type":"ContainerStarted","Data":"d9381c1a48052cd05d0a381c0d70edbcac46a3f4558a684c3a7c0a8e08713448"} Jun 05 13:15:04.659088 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.659062 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" event={"ID":"34d4ecc7-4288-4a65-b85c-1cc46656dab0","Type":"ContainerStarted","Data":"d9fe0d4c8433f094349fd4ee55e4e3fda6d2638e02d523a78ba49add99a57fd6"} Jun 05 13:15:04.660540 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.660519 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:15:04.661031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.661009 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" event={"ID":"31da7ce3-8120-4e65-bde2-381a87b6dbc0","Type":"ContainerStarted","Data":"70d50c972760ae72f7f8ed8d767c5f920a8d750da5184319489930586df34852"} Jun 05 13:15:04.661082 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.661060 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:15:04.691643 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.691592 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f65db7bc7-sr96p" podStartSLOduration=2.106038279 podStartE2EDuration="6.691573569s" totalImagesPullingTime="4.58553529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:15:04.690601857 +0000 UTC m=+505.674458666" watchObservedRunningTime="2026-06-05 13:15:04.691573569 +0000 UTC m=+505.675430354" Jun 05 13:15:04.709299 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.709236 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" podStartSLOduration=2.457594544 podStartE2EDuration="6.709215928s" totalImagesPullingTime="4.251621384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:15:04.707440896 +0000 UTC m=+505.691297684" watchObservedRunningTime="2026-06-05 13:15:04.709215928 +0000 UTC m=+505.693072714" Jun 05 13:15:04.728173 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:04.728115 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" podStartSLOduration=1.9431810459999999 podStartE2EDuration="6.728091935s" totalImagesPullingTime="4.784910889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:15:04.725731964 +0000 UTC m=+505.709588749" watchObservedRunningTime="2026-06-05 13:15:04.728091935 +0000 UTC m=+505.711948719" Jun 05 13:15:05.668518 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:05.668481 2572 generic.go:356] "Generic (PLEG): container finished" podID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerID="86df2be9e434b705cb57bfe291d5d8a8a08ba781b6a335527f0654141c677a2f" exitCode=0 Jun 05 13:15:05.668972 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:05.668569 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" event={"ID":"5d5201a7-5b92-4610-bd54-e0af0f664f0c","Type":"ContainerDied","Data":"86df2be9e434b705cb57bfe291d5d8a8a08ba781b6a335527f0654141c677a2f"} Jun 05 13:15:06.809399 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.809375 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:15:06.849641 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.849598 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-util\") pod \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " Jun 05 13:15:06.849843 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.849686 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pslw\" (UniqueName: \"kubernetes.io/projected/5d5201a7-5b92-4610-bd54-e0af0f664f0c-kube-api-access-4pslw\") pod \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " Jun 05 13:15:06.849843 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.849719 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-bundle\") pod \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\" (UID: \"5d5201a7-5b92-4610-bd54-e0af0f664f0c\") " Jun 05 13:15:06.850923 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.850858 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-bundle" (OuterVolumeSpecName: "bundle") pod "5d5201a7-5b92-4610-bd54-e0af0f664f0c" (UID: "5d5201a7-5b92-4610-bd54-e0af0f664f0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:15:06.851988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.851949 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d5201a7-5b92-4610-bd54-e0af0f664f0c-kube-api-access-4pslw" (OuterVolumeSpecName: "kube-api-access-4pslw") pod "5d5201a7-5b92-4610-bd54-e0af0f664f0c" (UID: "5d5201a7-5b92-4610-bd54-e0af0f664f0c"). InnerVolumeSpecName "kube-api-access-4pslw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:15:06.854690 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.854660 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-util" (OuterVolumeSpecName: "util") pod "5d5201a7-5b92-4610-bd54-e0af0f664f0c" (UID: "5d5201a7-5b92-4610-bd54-e0af0f664f0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:15:06.950465 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.950383 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pslw\" (UniqueName: \"kubernetes.io/projected/5d5201a7-5b92-4610-bd54-e0af0f664f0c-kube-api-access-4pslw\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:15:06.950465 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.950411 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:15:06.950465 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:06.950419 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d5201a7-5b92-4610-bd54-e0af0f664f0c-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:15:07.680314 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:07.680288 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" Jun 05 13:15:07.680466 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:07.680287 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067v5jk" event={"ID":"5d5201a7-5b92-4610-bd54-e0af0f664f0c","Type":"ContainerDied","Data":"b0ebb0674a6c44e19f415c780cc5eefe83aabb432d91b8af8c2dadb5edc2a694"} Jun 05 13:15:07.680466 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:07.680407 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0ebb0674a6c44e19f415c780cc5eefe83aabb432d91b8af8c2dadb5edc2a694" Jun 05 13:15:13.487249 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487209 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8"] Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487581 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="util" Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487596 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="util" Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487619 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="pull" Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487624 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="pull" Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487633 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="extract" Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487638 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="extract" Jun 05 13:15:13.487722 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.487700 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d5201a7-5b92-4610-bd54-e0af0f664f0c" containerName="extract" Jun 05 13:15:13.492328 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.492303 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.497951 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.497892 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrd7p\"" Jun 05 13:15:13.498141 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.497892 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:15:13.498211 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.498154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.498274 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.498254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8jh9\" (UniqueName: \"kubernetes.io/projected/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-kube-api-access-v8jh9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.498503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.498468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.498654 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.498635 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:15:13.517697 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.517660 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8"] Jun 05 13:15:13.599085 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.599037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8jh9\" (UniqueName: \"kubernetes.io/projected/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-kube-api-access-v8jh9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.599313 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.599110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.599313 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.599177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.599562 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.599542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.599630 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.599596 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.628232 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.628205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8jh9\" (UniqueName: \"kubernetes.io/projected/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-kube-api-access-v8jh9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.802916 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.802860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:13.983939 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:13.983878 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8"] Jun 05 13:15:13.985297 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:15:13.985268 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3a764b_a281_4b4c_8fbe_58fd03efc28f.slice/crio-5ed2aced84ee010b4d8ad2c24fb064c3e3f2c8e473896f1bd38867a3c04415cc WatchSource:0}: Error finding container 5ed2aced84ee010b4d8ad2c24fb064c3e3f2c8e473896f1bd38867a3c04415cc: Status 404 returned error can't find the container with id 5ed2aced84ee010b4d8ad2c24fb064c3e3f2c8e473896f1bd38867a3c04415cc Jun 05 13:15:14.726935 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:14.726867 2572 generic.go:356] "Generic (PLEG): container finished" podID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerID="b28e2b2a43c274edd4ecda61b4a472866e4a9b274393b2d280ff2e8b2d399041" exitCode=0 Jun 05 13:15:14.727334 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:14.726944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" event={"ID":"1c3a764b-a281-4b4c-8fbe-58fd03efc28f","Type":"ContainerDied","Data":"b28e2b2a43c274edd4ecda61b4a472866e4a9b274393b2d280ff2e8b2d399041"} Jun 05 13:15:14.727334 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:14.726995 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" event={"ID":"1c3a764b-a281-4b4c-8fbe-58fd03efc28f","Type":"ContainerStarted","Data":"5ed2aced84ee010b4d8ad2c24fb064c3e3f2c8e473896f1bd38867a3c04415cc"} Jun 05 13:15:15.101693 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.101651 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-wnq88"] Jun 05 13:15:15.105151 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.105128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.109523 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.109488 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 13:15:15.109760 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.109737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-xhbnf\"" Jun 05 13:15:15.109822 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.109765 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 13:15:15.112282 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.112118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/23d560b1-241d-46c6-87a7-73b0881c9eb3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-wnq88\" (UID: \"23d560b1-241d-46c6-87a7-73b0881c9eb3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.112371 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.112291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grw22\" (UniqueName: \"kubernetes.io/projected/23d560b1-241d-46c6-87a7-73b0881c9eb3-kube-api-access-grw22\") pod \"servicemesh-operator3-57f65f65fb-wnq88\" (UID: \"23d560b1-241d-46c6-87a7-73b0881c9eb3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.128505 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.128465 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-wnq88"] Jun 05 13:15:15.212976 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.212929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grw22\" (UniqueName: \"kubernetes.io/projected/23d560b1-241d-46c6-87a7-73b0881c9eb3-kube-api-access-grw22\") pod \"servicemesh-operator3-57f65f65fb-wnq88\" (UID: \"23d560b1-241d-46c6-87a7-73b0881c9eb3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.213201 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.212986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/23d560b1-241d-46c6-87a7-73b0881c9eb3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-wnq88\" (UID: \"23d560b1-241d-46c6-87a7-73b0881c9eb3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.215840 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.215806 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/23d560b1-241d-46c6-87a7-73b0881c9eb3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-wnq88\" (UID: \"23d560b1-241d-46c6-87a7-73b0881c9eb3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.228252 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.228217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grw22\" (UniqueName: \"kubernetes.io/projected/23d560b1-241d-46c6-87a7-73b0881c9eb3-kube-api-access-grw22\") pod \"servicemesh-operator3-57f65f65fb-wnq88\" (UID: \"23d560b1-241d-46c6-87a7-73b0881c9eb3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.415318 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.415212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:15.592264 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.592125 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-wnq88"] Jun 05 13:15:15.639988 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:15:15.639946 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d560b1_241d_46c6_87a7_73b0881c9eb3.slice/crio-4613cca9ae2f35b35a4d242cfc18bc232fe2648aab574b61a86215633410d132 WatchSource:0}: Error finding container 4613cca9ae2f35b35a4d242cfc18bc232fe2648aab574b61a86215633410d132: Status 404 returned error can't find the container with id 4613cca9ae2f35b35a4d242cfc18bc232fe2648aab574b61a86215633410d132 Jun 05 13:15:15.734724 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.734608 2572 generic.go:356] "Generic (PLEG): container finished" podID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerID="31c29e90c373816e28691f62ff3b92c9be1ff2a128d41ed69434727a8558ac94" exitCode=0 Jun 05 13:15:15.734724 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.734694 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" event={"ID":"1c3a764b-a281-4b4c-8fbe-58fd03efc28f","Type":"ContainerDied","Data":"31c29e90c373816e28691f62ff3b92c9be1ff2a128d41ed69434727a8558ac94"} Jun 05 13:15:15.736879 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.736850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" event={"ID":"23d560b1-241d-46c6-87a7-73b0881c9eb3","Type":"ContainerStarted","Data":"4613cca9ae2f35b35a4d242cfc18bc232fe2648aab574b61a86215633410d132"} Jun 05 13:15:15.874776 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.874732 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6bb7cdc59b-6znjc"] Jun 05 13:15:15.878863 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.878834 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:15.881977 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.881941 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 13:15:15.882169 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.882002 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6tdh5\"" Jun 05 13:15:15.898093 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.898036 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6bb7cdc59b-6znjc"] Jun 05 13:15:15.918728 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.918680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbwbq\" (UniqueName: \"kubernetes.io/projected/ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c-kube-api-access-sbwbq\") pod \"dashboard-redirect-6bb7cdc59b-6znjc\" (UID: \"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c\") " pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:15.918987 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:15.918811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c-redirect-config\") pod \"dashboard-redirect-6bb7cdc59b-6znjc\" (UID: \"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c\") " pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:16.019672 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.019632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c-redirect-config\") pod \"dashboard-redirect-6bb7cdc59b-6znjc\" (UID: \"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c\") " pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:16.019853 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.019695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbwbq\" (UniqueName: \"kubernetes.io/projected/ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c-kube-api-access-sbwbq\") pod \"dashboard-redirect-6bb7cdc59b-6znjc\" (UID: \"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c\") " pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:16.020380 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.020354 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c-redirect-config\") pod \"dashboard-redirect-6bb7cdc59b-6znjc\" (UID: \"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c\") " pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:16.037038 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.037000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbwbq\" (UniqueName: \"kubernetes.io/projected/ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c-kube-api-access-sbwbq\") pod \"dashboard-redirect-6bb7cdc59b-6znjc\" (UID: \"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c\") " pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:16.195119 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.195077 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" Jun 05 13:15:16.337585 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.337556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6bb7cdc59b-6znjc"] Jun 05 13:15:16.339306 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:15:16.339274 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8ad8b1_aa7d_46da_ad56_64b5e5f4d75c.slice/crio-4cfa9a65c270ae816acd89488a08b8dcb3a026b565a35f8ddf5b496ba59fa235 WatchSource:0}: Error finding container 4cfa9a65c270ae816acd89488a08b8dcb3a026b565a35f8ddf5b496ba59fa235: Status 404 returned error can't find the container with id 4cfa9a65c270ae816acd89488a08b8dcb3a026b565a35f8ddf5b496ba59fa235 Jun 05 13:15:16.744213 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.744179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" event={"ID":"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c","Type":"ContainerStarted","Data":"4cfa9a65c270ae816acd89488a08b8dcb3a026b565a35f8ddf5b496ba59fa235"} Jun 05 13:15:16.746510 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.746466 2572 generic.go:356] "Generic (PLEG): container finished" podID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerID="4cd7b5278b3bcc3468cc637ef9abe745839c50b6d34109943d137d72ca507e7f" exitCode=0 Jun 05 13:15:16.746643 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:16.746544 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" event={"ID":"1c3a764b-a281-4b4c-8fbe-58fd03efc28f","Type":"ContainerDied","Data":"4cd7b5278b3bcc3468cc637ef9abe745839c50b6d34109943d137d72ca507e7f"} Jun 05 13:15:18.592837 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.592805 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:18.646798 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.646759 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-util\") pod \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " Jun 05 13:15:18.647027 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.646809 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8jh9\" (UniqueName: \"kubernetes.io/projected/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-kube-api-access-v8jh9\") pod \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " Jun 05 13:15:18.647027 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.646911 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-bundle\") pod \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\" (UID: \"1c3a764b-a281-4b4c-8fbe-58fd03efc28f\") " Jun 05 13:15:18.648134 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.648084 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-bundle" (OuterVolumeSpecName: "bundle") pod "1c3a764b-a281-4b4c-8fbe-58fd03efc28f" (UID: "1c3a764b-a281-4b4c-8fbe-58fd03efc28f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:15:18.650071 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.649945 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-kube-api-access-v8jh9" (OuterVolumeSpecName: "kube-api-access-v8jh9") pod "1c3a764b-a281-4b4c-8fbe-58fd03efc28f" (UID: "1c3a764b-a281-4b4c-8fbe-58fd03efc28f"). InnerVolumeSpecName "kube-api-access-v8jh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:15:18.653477 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.653435 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-util" (OuterVolumeSpecName: "util") pod "1c3a764b-a281-4b4c-8fbe-58fd03efc28f" (UID: "1c3a764b-a281-4b4c-8fbe-58fd03efc28f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:15:18.748237 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.748205 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:15:18.748237 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.748238 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8jh9\" (UniqueName: \"kubernetes.io/projected/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-kube-api-access-v8jh9\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:15:18.748441 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.748252 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c3a764b-a281-4b4c-8fbe-58fd03efc28f-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:15:18.761173 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.761140 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" Jun 05 13:15:18.761327 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.761140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abhnh8" event={"ID":"1c3a764b-a281-4b4c-8fbe-58fd03efc28f","Type":"ContainerDied","Data":"5ed2aced84ee010b4d8ad2c24fb064c3e3f2c8e473896f1bd38867a3c04415cc"} Jun 05 13:15:18.761327 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:18.761271 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ed2aced84ee010b4d8ad2c24fb064c3e3f2c8e473896f1bd38867a3c04415cc" Jun 05 13:15:19.770650 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:19.770611 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" event={"ID":"ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c","Type":"ContainerStarted","Data":"544ce6f4676816d0ea515fde5df6804ab08c4fa32db48e80dcbc06250bf261e8"} Jun 05 13:15:19.773196 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:19.773153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" event={"ID":"23d560b1-241d-46c6-87a7-73b0881c9eb3","Type":"ContainerStarted","Data":"596ba363a8c154bbf48b64b405e9376911c5350397358c8626cbdfabf7ceadb3"} Jun 05 13:15:19.773394 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:19.773273 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:19.789628 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:19.789566 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6bb7cdc59b-6znjc" podStartSLOduration=1.67714221 podStartE2EDuration="4.789548185s" totalImagesPullingTime="3.112405975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:15:19.787616139 +0000 UTC m=+520.771472926" watchObservedRunningTime="2026-06-05 13:15:19.789548185 +0000 UTC m=+520.773405004" Jun 05 13:15:19.814234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:19.814172 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" podStartSLOduration=1.065145617 podStartE2EDuration="4.8141524s" totalImagesPullingTime="3.749006783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:15:19.812951166 +0000 UTC m=+520.796807942" watchObservedRunningTime="2026-06-05 13:15:19.8141524 +0000 UTC m=+520.798009185" Jun 05 13:15:30.754956 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.754890 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c"] Jun 05 13:15:30.755411 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755396 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="pull" Jun 05 13:15:30.755452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755415 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="pull" Jun 05 13:15:30.755452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755435 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="extract" Jun 05 13:15:30.755452 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755444 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="extract" Jun 05 13:15:30.755557 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755454 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="util" Jun 05 13:15:30.755557 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755463 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="util" Jun 05 13:15:30.755557 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.755552 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3a764b-a281-4b4c-8fbe-58fd03efc28f" containerName="extract" Jun 05 13:15:30.760169 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.760142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.765406 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.765379 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 13:15:30.765695 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.765675 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c58nl\"" Jun 05 13:15:30.765982 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.765750 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 13:15:30.766089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.765805 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 13:15:30.766426 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.766411 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 13:15:30.780013 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.779989 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-wnq88" Jun 05 13:15:30.786394 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.786364 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c"] Jun 05 13:15:30.855944 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.855908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.856140 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.856039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt45m\" (UniqueName: \"kubernetes.io/projected/0b03d498-2369-41d9-9a99-b29d20cb7c60-kube-api-access-gt45m\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.856140 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.856067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.856140 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.856111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03d498-2369-41d9-9a99-b29d20cb7c60-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.856140 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.856137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.856308 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.856195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.856308 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.856238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957297 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt45m\" (UniqueName: \"kubernetes.io/projected/0b03d498-2369-41d9-9a99-b29d20cb7c60-kube-api-access-gt45m\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957297 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957541 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03d498-2369-41d9-9a99-b29d20cb7c60-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957541 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957541 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957390 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957541 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.957541 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.957473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.958254 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.958202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.960052 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.960025 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.960152 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.960052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.960198 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.960155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03d498-2369-41d9-9a99-b29d20cb7c60-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.960353 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.960331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.970426 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.970402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03d498-2369-41d9-9a99-b29d20cb7c60-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:30.970601 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:30.970577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt45m\" (UniqueName: \"kubernetes.io/projected/0b03d498-2369-41d9-9a99-b29d20cb7c60-kube-api-access-gt45m\") pod \"istiod-openshift-gateway-75c67f8887-zc97c\" (UID: \"0b03d498-2369-41d9-9a99-b29d20cb7c60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:31.071513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:31.071408 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:31.242051 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:31.242017 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c"] Jun 05 13:15:31.243603 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:15:31.243574 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b03d498_2369_41d9_9a99_b29d20cb7c60.slice/crio-cc28ac75d0b029f293384ef9d7c9042cd03419001dd82d3cd300858ad6b7fec2 WatchSource:0}: Error finding container cc28ac75d0b029f293384ef9d7c9042cd03419001dd82d3cd300858ad6b7fec2: Status 404 returned error can't find the container with id cc28ac75d0b029f293384ef9d7c9042cd03419001dd82d3cd300858ad6b7fec2 Jun 05 13:15:31.839269 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:31.839232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" event={"ID":"0b03d498-2369-41d9-9a99-b29d20cb7c60","Type":"ContainerStarted","Data":"cc28ac75d0b029f293384ef9d7c9042cd03419001dd82d3cd300858ad6b7fec2"} Jun 05 13:15:33.735189 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:33.735143 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:15:33.735584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:33.735233 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:15:33.854498 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:33.854458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" event={"ID":"0b03d498-2369-41d9-9a99-b29d20cb7c60","Type":"ContainerStarted","Data":"05b632102013222067bbf59e00c98cbe4cca54cac368f235240d80a6fc3813d3"} Jun 05 13:15:33.854667 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:33.854556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:15:33.916350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:33.916298 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" podStartSLOduration=1.427361254 podStartE2EDuration="3.916279831s" totalImagesPullingTime="2.488918577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:15:33.912788361 +0000 UTC m=+534.896645181" watchObservedRunningTime="2026-06-05 13:15:33.916279831 +0000 UTC m=+534.900136616" Jun 05 13:15:34.863776 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:34.863743 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-zc97c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 13:15:34.864160 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:34.863802 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" podUID="0b03d498-2369-41d9-9a99-b29d20cb7c60" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:15:35.671424 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:35.671394 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lpjbj" Jun 05 13:15:35.674596 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:35.674563 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7x7ll" Jun 05 13:15:37.863324 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:15:37.863288 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zc97c" Jun 05 13:16:04.440446 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.440402 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2"] Jun 05 13:16:04.456386 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.456355 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.459302 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.459245 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 13:16:04.459622 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.459594 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 13:16:04.459782 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.459632 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2"] Jun 05 13:16:04.460178 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.460159 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7rswj\"" Jun 05 13:16:04.550421 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.550376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.550599 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.550479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49wls\" (UniqueName: \"kubernetes.io/projected/719786e2-f588-49b1-af70-9a1d10489ed9-kube-api-access-49wls\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.550599 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.550523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.650998 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.650952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.651198 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.651040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49wls\" (UniqueName: \"kubernetes.io/projected/719786e2-f588-49b1-af70-9a1d10489ed9-kube-api-access-49wls\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.651198 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.651090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.651350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.651327 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.651448 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.651429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.661595 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.661562 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49wls\" (UniqueName: \"kubernetes.io/projected/719786e2-f588-49b1-af70-9a1d10489ed9-kube-api-access-49wls\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.767047 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.767005 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:04.912582 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.912556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2"] Jun 05 13:16:04.915089 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:04.915053 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719786e2_f588_49b1_af70_9a1d10489ed9.slice/crio-f13742af614437a2c1e18c52a268cc41877002c8627427f52cfa97bf02dd9523 WatchSource:0}: Error finding container f13742af614437a2c1e18c52a268cc41877002c8627427f52cfa97bf02dd9523: Status 404 returned error can't find the container with id f13742af614437a2c1e18c52a268cc41877002c8627427f52cfa97bf02dd9523 Jun 05 13:16:04.991083 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.991046 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp"] Jun 05 13:16:04.995170 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:04.995146 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.005273 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.005235 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp"] Jun 05 13:16:05.026491 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.026460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" event={"ID":"719786e2-f588-49b1-af70-9a1d10489ed9","Type":"ContainerStarted","Data":"639d9ac169128de3b1e990d96df61cb85263012e3647e1256f50ed9adf5177df"} Jun 05 13:16:05.026640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.026511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" event={"ID":"719786e2-f588-49b1-af70-9a1d10489ed9","Type":"ContainerStarted","Data":"f13742af614437a2c1e18c52a268cc41877002c8627427f52cfa97bf02dd9523"} Jun 05 13:16:05.055439 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.055392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.055636 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.055476 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.055636 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.055522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzsrl\" (UniqueName: \"kubernetes.io/projected/d482ce40-8754-463c-b43c-8571d4c46b87-kube-api-access-pzsrl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.156513 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.156470 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzsrl\" (UniqueName: \"kubernetes.io/projected/d482ce40-8754-463c-b43c-8571d4c46b87-kube-api-access-pzsrl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.156700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.156539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.156700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.156612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.157017 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.156966 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.157103 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.157022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.166018 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.165990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzsrl\" (UniqueName: \"kubernetes.io/projected/d482ce40-8754-463c-b43c-8571d4c46b87-kube-api-access-pzsrl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.306223 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.306114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:05.457886 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.457857 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp"] Jun 05 13:16:05.460200 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:05.460168 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd482ce40_8754_463c_b43c_8571d4c46b87.slice/crio-587a519e6467b03cb62aa6360800b1f8d0513ef11f68009672a81c74c330227f WatchSource:0}: Error finding container 587a519e6467b03cb62aa6360800b1f8d0513ef11f68009672a81c74c330227f: Status 404 returned error can't find the container with id 587a519e6467b03cb62aa6360800b1f8d0513ef11f68009672a81c74c330227f Jun 05 13:16:05.590327 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.590295 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q"] Jun 05 13:16:05.594061 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.594040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.603230 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.603199 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q"] Jun 05 13:16:05.661596 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.661561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.661787 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.661683 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.661787 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.661739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7pz\" (UniqueName: \"kubernetes.io/projected/25b04d58-7418-4280-bf1b-b402a8e4643c-kube-api-access-dc7pz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.762987 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.762950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7pz\" (UniqueName: \"kubernetes.io/projected/25b04d58-7418-4280-bf1b-b402a8e4643c-kube-api-access-dc7pz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.763204 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.762997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.763204 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.763064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.763451 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.763429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.763506 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.763449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.773155 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.773132 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7pz\" (UniqueName: \"kubernetes.io/projected/25b04d58-7418-4280-bf1b-b402a8e4643c-kube-api-access-dc7pz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:05.939506 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:05.939418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:06.006790 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.006750 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz"] Jun 05 13:16:06.010990 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.010958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.021345 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.021303 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz"] Jun 05 13:16:06.037570 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.037527 2572 generic.go:356] "Generic (PLEG): container finished" podID="d482ce40-8754-463c-b43c-8571d4c46b87" containerID="ee62ba2554de7d4724b4d0f402c45390a2bfc9679798be240174a0c6d70a10a0" exitCode=0 Jun 05 13:16:06.037745 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.037616 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" event={"ID":"d482ce40-8754-463c-b43c-8571d4c46b87","Type":"ContainerDied","Data":"ee62ba2554de7d4724b4d0f402c45390a2bfc9679798be240174a0c6d70a10a0"} Jun 05 13:16:06.037745 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.037706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" event={"ID":"d482ce40-8754-463c-b43c-8571d4c46b87","Type":"ContainerStarted","Data":"587a519e6467b03cb62aa6360800b1f8d0513ef11f68009672a81c74c330227f"} Jun 05 13:16:06.039698 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.039668 2572 generic.go:356] "Generic (PLEG): container finished" podID="719786e2-f588-49b1-af70-9a1d10489ed9" containerID="639d9ac169128de3b1e990d96df61cb85263012e3647e1256f50ed9adf5177df" exitCode=0 Jun 05 13:16:06.039819 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.039743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" event={"ID":"719786e2-f588-49b1-af70-9a1d10489ed9","Type":"ContainerDied","Data":"639d9ac169128de3b1e990d96df61cb85263012e3647e1256f50ed9adf5177df"} Jun 05 13:16:06.069712 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.066602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.069712 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.066679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xzrc\" (UniqueName: \"kubernetes.io/projected/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-kube-api-access-6xzrc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.069712 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.066717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.095225 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.095191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q"] Jun 05 13:16:06.097213 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:06.097188 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b04d58_7418_4280_bf1b_b402a8e4643c.slice/crio-667d1c53dbb3827fefc05fcd1d06f5073179901c00d81a56383df75f96b4b842 WatchSource:0}: Error finding container 667d1c53dbb3827fefc05fcd1d06f5073179901c00d81a56383df75f96b4b842: Status 404 returned error can't find the container with id 667d1c53dbb3827fefc05fcd1d06f5073179901c00d81a56383df75f96b4b842 Jun 05 13:16:06.167490 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.167455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.167684 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.167522 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xzrc\" (UniqueName: \"kubernetes.io/projected/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-kube-api-access-6xzrc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.167684 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.167556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.167821 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.167797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.167930 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.167888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.176962 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.176932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xzrc\" (UniqueName: \"kubernetes.io/projected/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-kube-api-access-6xzrc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.323523 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.323482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:06.472969 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:06.472844 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz"] Jun 05 13:16:06.477181 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:06.477140 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9775e1ee_cb83_42cd_8e8e_9ea4667e047a.slice/crio-27283593ffabdc545a2bbc58101a4e944f5b5981c64d2b9f268aeb6a46241ab7 WatchSource:0}: Error finding container 27283593ffabdc545a2bbc58101a4e944f5b5981c64d2b9f268aeb6a46241ab7: Status 404 returned error can't find the container with id 27283593ffabdc545a2bbc58101a4e944f5b5981c64d2b9f268aeb6a46241ab7 Jun 05 13:16:07.047036 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:07.047003 2572 generic.go:356] "Generic (PLEG): container finished" podID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerID="e15ef68d7c7cff520ffeb3f0ac69749c1cadeddfa79acc726b825eb899b9997b" exitCode=0 Jun 05 13:16:07.047160 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:07.047135 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" event={"ID":"25b04d58-7418-4280-bf1b-b402a8e4643c","Type":"ContainerDied","Data":"e15ef68d7c7cff520ffeb3f0ac69749c1cadeddfa79acc726b825eb899b9997b"} Jun 05 13:16:07.047245 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:07.047187 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" event={"ID":"25b04d58-7418-4280-bf1b-b402a8e4643c","Type":"ContainerStarted","Data":"667d1c53dbb3827fefc05fcd1d06f5073179901c00d81a56383df75f96b4b842"} Jun 05 13:16:07.051236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:07.051205 2572 generic.go:356] "Generic (PLEG): container finished" podID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerID="4ab7e747d6bdedd46a8d993b3c02398d26e7d02e98ee9bc222a942b3b3d2f023" exitCode=0 Jun 05 13:16:07.051350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:07.051256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" event={"ID":"9775e1ee-cb83-42cd-8e8e-9ea4667e047a","Type":"ContainerDied","Data":"4ab7e747d6bdedd46a8d993b3c02398d26e7d02e98ee9bc222a942b3b3d2f023"} Jun 05 13:16:07.051350 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:07.051299 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" event={"ID":"9775e1ee-cb83-42cd-8e8e-9ea4667e047a","Type":"ContainerStarted","Data":"27283593ffabdc545a2bbc58101a4e944f5b5981c64d2b9f268aeb6a46241ab7"} Jun 05 13:16:08.058592 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.058494 2572 generic.go:356] "Generic (PLEG): container finished" podID="d482ce40-8754-463c-b43c-8571d4c46b87" containerID="2ba54c6d469a96ad5997b3c610ee4844e949005113010a997eec23d2993d02d3" exitCode=0 Jun 05 13:16:08.059012 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.058594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" event={"ID":"d482ce40-8754-463c-b43c-8571d4c46b87","Type":"ContainerDied","Data":"2ba54c6d469a96ad5997b3c610ee4844e949005113010a997eec23d2993d02d3"} Jun 05 13:16:08.060590 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.060554 2572 generic.go:356] "Generic (PLEG): container finished" podID="719786e2-f588-49b1-af70-9a1d10489ed9" containerID="76b8b01f634014386ef3ef158b35b1db5b69b226b4c4c7f60d74a502829a3ac1" exitCode=0 Jun 05 13:16:08.060695 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.060642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" event={"ID":"719786e2-f588-49b1-af70-9a1d10489ed9","Type":"ContainerDied","Data":"76b8b01f634014386ef3ef158b35b1db5b69b226b4c4c7f60d74a502829a3ac1"} Jun 05 13:16:08.062643 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.062620 2572 generic.go:356] "Generic (PLEG): container finished" podID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerID="f302d3b08d770c809f90af7b155e3da07034c3ff2ebab81ceb0fec066fd1fc78" exitCode=0 Jun 05 13:16:08.062733 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.062696 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" event={"ID":"9775e1ee-cb83-42cd-8e8e-9ea4667e047a","Type":"ContainerDied","Data":"f302d3b08d770c809f90af7b155e3da07034c3ff2ebab81ceb0fec066fd1fc78"} Jun 05 13:16:08.064933 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.064876 2572 generic.go:356] "Generic (PLEG): container finished" podID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerID="d68c612f951cbee0a7b9ef713204f672f068e427d1a8f813c790f5e1d0c2de92" exitCode=0 Jun 05 13:16:08.065044 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:08.064942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" event={"ID":"25b04d58-7418-4280-bf1b-b402a8e4643c","Type":"ContainerDied","Data":"d68c612f951cbee0a7b9ef713204f672f068e427d1a8f813c790f5e1d0c2de92"} Jun 05 13:16:09.072220 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.072186 2572 generic.go:356] "Generic (PLEG): container finished" podID="d482ce40-8754-463c-b43c-8571d4c46b87" containerID="4c76a5eb7d1e33aac58ba41e80edefde601a05250414779fd36fbf4f0689a972" exitCode=0 Jun 05 13:16:09.072713 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.072261 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" event={"ID":"d482ce40-8754-463c-b43c-8571d4c46b87","Type":"ContainerDied","Data":"4c76a5eb7d1e33aac58ba41e80edefde601a05250414779fd36fbf4f0689a972"} Jun 05 13:16:09.074460 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.074436 2572 generic.go:356] "Generic (PLEG): container finished" podID="719786e2-f588-49b1-af70-9a1d10489ed9" containerID="57e968ac8af302f5ea9c95e1e589524d0e07972d61779f5254121dcea1b300ad" exitCode=0 Jun 05 13:16:09.074581 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.074515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" event={"ID":"719786e2-f588-49b1-af70-9a1d10489ed9","Type":"ContainerDied","Data":"57e968ac8af302f5ea9c95e1e589524d0e07972d61779f5254121dcea1b300ad"} Jun 05 13:16:09.076727 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.076707 2572 generic.go:356] "Generic (PLEG): container finished" podID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerID="e301757373795836ed6d2fb64a0abb3478031960fecbe361d52f364b56632772" exitCode=0 Jun 05 13:16:09.076837 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.076791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" event={"ID":"9775e1ee-cb83-42cd-8e8e-9ea4667e047a","Type":"ContainerDied","Data":"e301757373795836ed6d2fb64a0abb3478031960fecbe361d52f364b56632772"} Jun 05 13:16:09.078835 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.078814 2572 generic.go:356] "Generic (PLEG): container finished" podID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerID="06e387ac464346cee79d5035b5399f7fb8b0db1a12e6d1f2e4f413bd767c781d" exitCode=0 Jun 05 13:16:09.079077 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:09.078845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" event={"ID":"25b04d58-7418-4280-bf1b-b402a8e4643c","Type":"ContainerDied","Data":"06e387ac464346cee79d5035b5399f7fb8b0db1a12e6d1f2e4f413bd767c781d"} Jun 05 13:16:10.248354 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.248322 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:10.279540 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.279507 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:10.303917 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.303875 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-bundle\") pod \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " Jun 05 13:16:10.304052 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.303972 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-util\") pod \"25b04d58-7418-4280-bf1b-b402a8e4643c\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " Jun 05 13:16:10.304130 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.304053 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-bundle\") pod \"25b04d58-7418-4280-bf1b-b402a8e4643c\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " Jun 05 13:16:10.304130 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.304093 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc7pz\" (UniqueName: \"kubernetes.io/projected/25b04d58-7418-4280-bf1b-b402a8e4643c-kube-api-access-dc7pz\") pod \"25b04d58-7418-4280-bf1b-b402a8e4643c\" (UID: \"25b04d58-7418-4280-bf1b-b402a8e4643c\") " Jun 05 13:16:10.304130 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.304120 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-util\") pod \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " Jun 05 13:16:10.304304 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.304150 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xzrc\" (UniqueName: \"kubernetes.io/projected/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-kube-api-access-6xzrc\") pod \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\" (UID: \"9775e1ee-cb83-42cd-8e8e-9ea4667e047a\") " Jun 05 13:16:10.304585 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.304553 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-bundle" (OuterVolumeSpecName: "bundle") pod "25b04d58-7418-4280-bf1b-b402a8e4643c" (UID: "25b04d58-7418-4280-bf1b-b402a8e4643c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.304646 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.304622 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-bundle" (OuterVolumeSpecName: "bundle") pod "9775e1ee-cb83-42cd-8e8e-9ea4667e047a" (UID: "9775e1ee-cb83-42cd-8e8e-9ea4667e047a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.305763 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.305737 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:10.307066 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.307034 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-kube-api-access-6xzrc" (OuterVolumeSpecName: "kube-api-access-6xzrc") pod "9775e1ee-cb83-42cd-8e8e-9ea4667e047a" (UID: "9775e1ee-cb83-42cd-8e8e-9ea4667e047a"). InnerVolumeSpecName "kube-api-access-6xzrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:16:10.307304 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.307283 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b04d58-7418-4280-bf1b-b402a8e4643c-kube-api-access-dc7pz" (OuterVolumeSpecName: "kube-api-access-dc7pz") pod "25b04d58-7418-4280-bf1b-b402a8e4643c" (UID: "25b04d58-7418-4280-bf1b-b402a8e4643c"). InnerVolumeSpecName "kube-api-access-dc7pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:16:10.310483 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.310458 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:10.313044 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.313015 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-util" (OuterVolumeSpecName: "util") pod "25b04d58-7418-4280-bf1b-b402a8e4643c" (UID: "25b04d58-7418-4280-bf1b-b402a8e4643c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.313715 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.313693 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-util" (OuterVolumeSpecName: "util") pod "9775e1ee-cb83-42cd-8e8e-9ea4667e047a" (UID: "9775e1ee-cb83-42cd-8e8e-9ea4667e047a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.405482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405377 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-util\") pod \"d482ce40-8754-463c-b43c-8571d4c46b87\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " Jun 05 13:16:10.405482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405435 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-util\") pod \"719786e2-f588-49b1-af70-9a1d10489ed9\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " Jun 05 13:16:10.405482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405455 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzsrl\" (UniqueName: \"kubernetes.io/projected/d482ce40-8754-463c-b43c-8571d4c46b87-kube-api-access-pzsrl\") pod \"d482ce40-8754-463c-b43c-8571d4c46b87\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " Jun 05 13:16:10.405787 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405488 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-bundle\") pod \"d482ce40-8754-463c-b43c-8571d4c46b87\" (UID: \"d482ce40-8754-463c-b43c-8571d4c46b87\") " Jun 05 13:16:10.405787 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-bundle\") pod \"719786e2-f588-49b1-af70-9a1d10489ed9\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " Jun 05 13:16:10.405787 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405549 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49wls\" (UniqueName: \"kubernetes.io/projected/719786e2-f588-49b1-af70-9a1d10489ed9-kube-api-access-49wls\") pod \"719786e2-f588-49b1-af70-9a1d10489ed9\" (UID: \"719786e2-f588-49b1-af70-9a1d10489ed9\") " Jun 05 13:16:10.405787 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405780 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.406034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405803 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc7pz\" (UniqueName: \"kubernetes.io/projected/25b04d58-7418-4280-bf1b-b402a8e4643c-kube-api-access-dc7pz\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.406034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405819 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.406034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405833 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xzrc\" (UniqueName: \"kubernetes.io/projected/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-kube-api-access-6xzrc\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.406034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405847 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9775e1ee-cb83-42cd-8e8e-9ea4667e047a-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.406034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.405862 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b04d58-7418-4280-bf1b-b402a8e4643c-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.406283 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.406056 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-bundle" (OuterVolumeSpecName: "bundle") pod "719786e2-f588-49b1-af70-9a1d10489ed9" (UID: "719786e2-f588-49b1-af70-9a1d10489ed9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.406283 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.406141 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-bundle" (OuterVolumeSpecName: "bundle") pod "d482ce40-8754-463c-b43c-8571d4c46b87" (UID: "d482ce40-8754-463c-b43c-8571d4c46b87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.407706 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.407680 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719786e2-f588-49b1-af70-9a1d10489ed9-kube-api-access-49wls" (OuterVolumeSpecName: "kube-api-access-49wls") pod "719786e2-f588-49b1-af70-9a1d10489ed9" (UID: "719786e2-f588-49b1-af70-9a1d10489ed9"). InnerVolumeSpecName "kube-api-access-49wls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:16:10.408075 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.408052 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d482ce40-8754-463c-b43c-8571d4c46b87-kube-api-access-pzsrl" (OuterVolumeSpecName: "kube-api-access-pzsrl") pod "d482ce40-8754-463c-b43c-8571d4c46b87" (UID: "d482ce40-8754-463c-b43c-8571d4c46b87"). InnerVolumeSpecName "kube-api-access-pzsrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:16:10.410648 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.410595 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-util" (OuterVolumeSpecName: "util") pod "719786e2-f588-49b1-af70-9a1d10489ed9" (UID: "719786e2-f588-49b1-af70-9a1d10489ed9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.411757 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.411735 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-util" (OuterVolumeSpecName: "util") pod "d482ce40-8754-463c-b43c-8571d4c46b87" (UID: "d482ce40-8754-463c-b43c-8571d4c46b87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:16:10.507089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.507044 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.507089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.507084 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.507089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.507094 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzsrl\" (UniqueName: \"kubernetes.io/projected/d482ce40-8754-463c-b43c-8571d4c46b87-kube-api-access-pzsrl\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.507089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.507105 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d482ce40-8754-463c-b43c-8571d4c46b87-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.507324 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.507117 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/719786e2-f588-49b1-af70-9a1d10489ed9-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:10.507324 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:10.507126 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49wls\" (UniqueName: \"kubernetes.io/projected/719786e2-f588-49b1-af70-9a1d10489ed9-kube-api-access-49wls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:11.093845 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.093810 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" Jun 05 13:16:11.094058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.093811 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz" event={"ID":"9775e1ee-cb83-42cd-8e8e-9ea4667e047a","Type":"ContainerDied","Data":"27283593ffabdc545a2bbc58101a4e944f5b5981c64d2b9f268aeb6a46241ab7"} Jun 05 13:16:11.094058 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.093963 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27283593ffabdc545a2bbc58101a4e944f5b5981c64d2b9f268aeb6a46241ab7" Jun 05 13:16:11.095810 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.095792 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" Jun 05 13:16:11.095947 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.095829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q" event={"ID":"25b04d58-7418-4280-bf1b-b402a8e4643c","Type":"ContainerDied","Data":"667d1c53dbb3827fefc05fcd1d06f5073179901c00d81a56383df75f96b4b842"} Jun 05 13:16:11.095947 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.095863 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="667d1c53dbb3827fefc05fcd1d06f5073179901c00d81a56383df75f96b4b842" Jun 05 13:16:11.097880 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.097863 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" Jun 05 13:16:11.098009 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.097893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp" event={"ID":"d482ce40-8754-463c-b43c-8571d4c46b87","Type":"ContainerDied","Data":"587a519e6467b03cb62aa6360800b1f8d0513ef11f68009672a81c74c330227f"} Jun 05 13:16:11.098009 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.097947 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="587a519e6467b03cb62aa6360800b1f8d0513ef11f68009672a81c74c330227f" Jun 05 13:16:11.100099 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.100076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" event={"ID":"719786e2-f588-49b1-af70-9a1d10489ed9","Type":"ContainerDied","Data":"f13742af614437a2c1e18c52a268cc41877002c8627427f52cfa97bf02dd9523"} Jun 05 13:16:11.100205 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.100114 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f13742af614437a2c1e18c52a268cc41877002c8627427f52cfa97bf02dd9523" Jun 05 13:16:11.100205 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:11.100139 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2" Jun 05 13:16:28.424576 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424536 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct"] Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424894 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="pull" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424925 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="pull" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424941 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="pull" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424949 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="pull" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424958 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="extract" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424967 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="extract" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424977 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="pull" Jun 05 13:16:28.424988 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424983 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="pull" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424992 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.424999 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425008 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425013 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425019 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425024 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425033 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425038 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425043 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425048 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425066 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="pull" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425071 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="pull" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425080 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425085 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="util" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425090 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425095 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425157 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9775e1ee-cb83-42cd-8e8e-9ea4667e047a" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425164 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d482ce40-8754-463c-b43c-8571d4c46b87" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425170 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b04d58-7418-4280-bf1b-b402a8e4643c" containerName="extract" Jun 05 13:16:28.425234 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.425176 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="719786e2-f588-49b1-af70-9a1d10489ed9" containerName="extract" Jun 05 13:16:28.428501 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.428476 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:28.432415 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.432389 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m769c\"" Jun 05 13:16:28.433615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.433592 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 13:16:28.433696 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.433617 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 13:16:28.433696 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.433619 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 13:16:28.446601 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.446556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct"] Jun 05 13:16:28.465421 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.465383 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82l9t\" (UniqueName: \"kubernetes.io/projected/2bc6af5a-d23f-4039-b656-9c97f3ae0fd6-kube-api-access-82l9t\") pod \"dns-operator-controller-manager-864dd78c4c-f7gct\" (UID: \"2bc6af5a-d23f-4039-b656-9c97f3ae0fd6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:28.566809 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.566762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82l9t\" (UniqueName: \"kubernetes.io/projected/2bc6af5a-d23f-4039-b656-9c97f3ae0fd6-kube-api-access-82l9t\") pod \"dns-operator-controller-manager-864dd78c4c-f7gct\" (UID: \"2bc6af5a-d23f-4039-b656-9c97f3ae0fd6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:28.577728 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.577693 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82l9t\" (UniqueName: \"kubernetes.io/projected/2bc6af5a-d23f-4039-b656-9c97f3ae0fd6-kube-api-access-82l9t\") pod \"dns-operator-controller-manager-864dd78c4c-f7gct\" (UID: \"2bc6af5a-d23f-4039-b656-9c97f3ae0fd6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:28.739562 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.739468 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:28.916959 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:28.916929 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct"] Jun 05 13:16:28.919434 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:28.919409 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc6af5a_d23f_4039_b656_9c97f3ae0fd6.slice/crio-7b80e6c5fbb39f668e082f82ce6f736927d17074caf8fe5b105128bbfc4abf0c WatchSource:0}: Error finding container 7b80e6c5fbb39f668e082f82ce6f736927d17074caf8fe5b105128bbfc4abf0c: Status 404 returned error can't find the container with id 7b80e6c5fbb39f668e082f82ce6f736927d17074caf8fe5b105128bbfc4abf0c Jun 05 13:16:29.205525 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:29.205486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" event={"ID":"2bc6af5a-d23f-4039-b656-9c97f3ae0fd6","Type":"ContainerStarted","Data":"7b80e6c5fbb39f668e082f82ce6f736927d17074caf8fe5b105128bbfc4abf0c"} Jun 05 13:16:31.034435 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.034389 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7"] Jun 05 13:16:31.040938 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.040429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:31.047418 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.047377 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zl77x\"" Jun 05 13:16:31.082396 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.082343 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7"] Jun 05 13:16:31.089398 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.089348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjs6\" (UniqueName: \"kubernetes.io/projected/cb991cf2-f60d-4a94-8d3c-996984c2669b-kube-api-access-fxjs6\") pod \"limitador-operator-controller-manager-859d7b78bd-vb2h7\" (UID: \"cb991cf2-f60d-4a94-8d3c-996984c2669b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:31.190108 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.189894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjs6\" (UniqueName: \"kubernetes.io/projected/cb991cf2-f60d-4a94-8d3c-996984c2669b-kube-api-access-fxjs6\") pod \"limitador-operator-controller-manager-859d7b78bd-vb2h7\" (UID: \"cb991cf2-f60d-4a94-8d3c-996984c2669b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:31.205520 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.205483 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjs6\" (UniqueName: \"kubernetes.io/projected/cb991cf2-f60d-4a94-8d3c-996984c2669b-kube-api-access-fxjs6\") pod \"limitador-operator-controller-manager-859d7b78bd-vb2h7\" (UID: \"cb991cf2-f60d-4a94-8d3c-996984c2669b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:31.220505 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.220448 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" event={"ID":"2bc6af5a-d23f-4039-b656-9c97f3ae0fd6","Type":"ContainerStarted","Data":"810673f0f0d1cffd82145264ad0a61c20a807e5f5314c27204fbc29be72df562"} Jun 05 13:16:31.220753 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.220553 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:31.263397 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.263326 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" podStartSLOduration=1.266945866 podStartE2EDuration="3.263302946s" totalImagesPullingTime="1.99635708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:16:31.262788485 +0000 UTC m=+592.246645271" watchObservedRunningTime="2026-06-05 13:16:31.263302946 +0000 UTC m=+592.247159843" Jun 05 13:16:31.355544 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.355493 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:31.539321 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:31.539279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7"] Jun 05 13:16:31.545237 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:31.545196 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb991cf2_f60d_4a94_8d3c_996984c2669b.slice/crio-a6dd13287d7103f2b73b1495760a19e93756e529ad23dfc261a5fdb3968ff96c WatchSource:0}: Error finding container a6dd13287d7103f2b73b1495760a19e93756e529ad23dfc261a5fdb3968ff96c: Status 404 returned error can't find the container with id a6dd13287d7103f2b73b1495760a19e93756e529ad23dfc261a5fdb3968ff96c Jun 05 13:16:32.228972 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:32.228936 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" event={"ID":"cb991cf2-f60d-4a94-8d3c-996984c2669b","Type":"ContainerStarted","Data":"a6dd13287d7103f2b73b1495760a19e93756e529ad23dfc261a5fdb3968ff96c"} Jun 05 13:16:35.247736 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:35.247692 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" event={"ID":"cb991cf2-f60d-4a94-8d3c-996984c2669b","Type":"ContainerStarted","Data":"25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e"} Jun 05 13:16:35.248258 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:35.247864 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:35.277915 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:35.277846 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" podStartSLOduration=2.595961397 podStartE2EDuration="5.277831421s" totalImagesPullingTime="2.681870024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:16:35.27680863 +0000 UTC m=+596.260665415" watchObservedRunningTime="2026-06-05 13:16:35.277831421 +0000 UTC m=+596.261688205" Jun 05 13:16:39.432164 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:39.432125 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:16:39.432915 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:39.432876 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:16:42.232631 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:42.232586 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f7gct" Jun 05 13:16:46.256138 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:46.256105 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:47.265940 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.265867 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7"] Jun 05 13:16:47.266530 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.266197 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" podUID="cb991cf2-f60d-4a94-8d3c-996984c2669b" containerName="manager" containerID="cri-o://25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e" gracePeriod=2 Jun 05 13:16:47.278029 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.277976 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7"] Jun 05 13:16:47.343529 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.343455 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6"] Jun 05 13:16:47.344514 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.344476 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb991cf2-f60d-4a94-8d3c-996984c2669b" containerName="manager" Jun 05 13:16:47.344514 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.344523 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb991cf2-f60d-4a94-8d3c-996984c2669b" containerName="manager" Jun 05 13:16:47.344860 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.344842 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb991cf2-f60d-4a94-8d3c-996984c2669b" containerName="manager" Jun 05 13:16:47.349389 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.349333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:16:47.372259 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.372218 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6"] Jun 05 13:16:47.439357 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:16:47.439299 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vb2h7\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="cb991cf2-f60d-4a94-8d3c-996984c2669b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:47.448874 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.448827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgkdc\" (UniqueName: \"kubernetes.io/projected/62208486-c9c3-45a6-bcbd-78b78f34a1d6-kube-api-access-wgkdc\") pod \"limitador-operator-controller-manager-859d7b78bd-7clv6\" (UID: \"62208486-c9c3-45a6-bcbd-78b78f34a1d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:16:47.527765 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.527667 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:47.549760 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.549717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgkdc\" (UniqueName: \"kubernetes.io/projected/62208486-c9c3-45a6-bcbd-78b78f34a1d6-kube-api-access-wgkdc\") pod \"limitador-operator-controller-manager-859d7b78bd-7clv6\" (UID: \"62208486-c9c3-45a6-bcbd-78b78f34a1d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:16:47.568432 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.568399 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgkdc\" (UniqueName: \"kubernetes.io/projected/62208486-c9c3-45a6-bcbd-78b78f34a1d6-kube-api-access-wgkdc\") pod \"limitador-operator-controller-manager-859d7b78bd-7clv6\" (UID: \"62208486-c9c3-45a6-bcbd-78b78f34a1d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:16:47.650855 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.650810 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxjs6\" (UniqueName: \"kubernetes.io/projected/cb991cf2-f60d-4a94-8d3c-996984c2669b-kube-api-access-fxjs6\") pod \"cb991cf2-f60d-4a94-8d3c-996984c2669b\" (UID: \"cb991cf2-f60d-4a94-8d3c-996984c2669b\") " Jun 05 13:16:47.653164 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.653120 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb991cf2-f60d-4a94-8d3c-996984c2669b-kube-api-access-fxjs6" (OuterVolumeSpecName: "kube-api-access-fxjs6") pod "cb991cf2-f60d-4a94-8d3c-996984c2669b" (UID: "cb991cf2-f60d-4a94-8d3c-996984c2669b"). InnerVolumeSpecName "kube-api-access-fxjs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:16:47.662353 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.662302 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:16:47.751741 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.751704 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxjs6\" (UniqueName: \"kubernetes.io/projected/cb991cf2-f60d-4a94-8d3c-996984c2669b-kube-api-access-fxjs6\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:16:47.818934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:47.818824 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6"] Jun 05 13:16:47.823628 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:16:47.823599 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62208486_c9c3_45a6_bcbd_78b78f34a1d6.slice/crio-16a5c5628408ad1b9716032b01ce53df0a33371469b3896bb33bec5fe04ba312 WatchSource:0}: Error finding container 16a5c5628408ad1b9716032b01ce53df0a33371469b3896bb33bec5fe04ba312: Status 404 returned error can't find the container with id 16a5c5628408ad1b9716032b01ce53df0a33371469b3896bb33bec5fe04ba312 Jun 05 13:16:48.330501 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.330444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" event={"ID":"62208486-c9c3-45a6-bcbd-78b78f34a1d6","Type":"ContainerStarted","Data":"6d4a8b662f345a884c3abf1efeba99483f57ff2148431eb6f4e356ae58fe3110"} Jun 05 13:16:48.331064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.330621 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:16:48.331064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.330647 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" event={"ID":"62208486-c9c3-45a6-bcbd-78b78f34a1d6","Type":"ContainerStarted","Data":"16a5c5628408ad1b9716032b01ce53df0a33371469b3896bb33bec5fe04ba312"} Jun 05 13:16:48.332077 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.332048 2572 generic.go:356] "Generic (PLEG): container finished" podID="cb991cf2-f60d-4a94-8d3c-996984c2669b" containerID="25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e" exitCode=0 Jun 05 13:16:48.332191 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.332084 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vb2h7" Jun 05 13:16:48.332191 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.332141 2572 scope.go:117] "RemoveContainer" containerID="25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e" Jun 05 13:16:48.342610 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.342583 2572 scope.go:117] "RemoveContainer" containerID="25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e" Jun 05 13:16:48.342982 ip-10-0-141-220 kubenswrapper[2572]: E0605 13:16:48.342958 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e\": container with ID starting with 25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e not found: ID does not exist" containerID="25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e" Jun 05 13:16:48.343051 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.342993 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e"} err="failed to get container status \"25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e\": rpc error: code = NotFound desc = could not find container \"25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e\": container with ID starting with 25a87d7b64ea3b74defe2b57e7070c08eaf4f4bcece4072670d59e25d503a53e not found: ID does not exist" Jun 05 13:16:48.364066 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:48.363998 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" podStartSLOduration=1.363979375 podStartE2EDuration="1.363979375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:16:48.363515131 +0000 UTC m=+609.347371934" watchObservedRunningTime="2026-06-05 13:16:48.363979375 +0000 UTC m=+609.347836161" Jun 05 13:16:49.425471 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:49.425441 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb991cf2-f60d-4a94-8d3c-996984c2669b" path="/var/lib/kubelet/pods/cb991cf2-f60d-4a94-8d3c-996984c2669b/volumes" Jun 05 13:16:59.342814 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:16:59.342759 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7clv6" Jun 05 13:17:38.418869 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.418835 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:17:38.422700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.422678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.425369 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.425335 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7rswj\"" Jun 05 13:17:38.425557 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.425536 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 13:17:38.431682 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.431658 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:17:38.464469 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.464431 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:17:38.521032 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.520989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwdjw\" (UniqueName: \"kubernetes.io/projected/116bc5f1-3cc5-4d46-9c5b-803e6375b3e2-kube-api-access-fwdjw\") pod \"limitador-limitador-54d6d988d5-z29bp\" (UID: \"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.521267 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.521149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/116bc5f1-3cc5-4d46-9c5b-803e6375b3e2-config-file\") pod \"limitador-limitador-54d6d988d5-z29bp\" (UID: \"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.622453 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.622412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/116bc5f1-3cc5-4d46-9c5b-803e6375b3e2-config-file\") pod \"limitador-limitador-54d6d988d5-z29bp\" (UID: \"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.622638 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.622466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwdjw\" (UniqueName: \"kubernetes.io/projected/116bc5f1-3cc5-4d46-9c5b-803e6375b3e2-kube-api-access-fwdjw\") pod \"limitador-limitador-54d6d988d5-z29bp\" (UID: \"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.623113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.623088 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/116bc5f1-3cc5-4d46-9c5b-803e6375b3e2-config-file\") pod \"limitador-limitador-54d6d988d5-z29bp\" (UID: \"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.631120 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.631082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwdjw\" (UniqueName: \"kubernetes.io/projected/116bc5f1-3cc5-4d46-9c5b-803e6375b3e2-kube-api-access-fwdjw\") pod \"limitador-limitador-54d6d988d5-z29bp\" (UID: \"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.734419 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.734334 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:38.923685 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:38.923650 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:17:38.926004 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:17:38.925968 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116bc5f1_3cc5_4d46_9c5b_803e6375b3e2.slice/crio-7704c2b14f1b777718096947ed54c0646336eba0f5f4552a8b2a4ecc86d1cea6 WatchSource:0}: Error finding container 7704c2b14f1b777718096947ed54c0646336eba0f5f4552a8b2a4ecc86d1cea6: Status 404 returned error can't find the container with id 7704c2b14f1b777718096947ed54c0646336eba0f5f4552a8b2a4ecc86d1cea6 Jun 05 13:17:39.654281 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:39.654239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" event={"ID":"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2","Type":"ContainerStarted","Data":"7704c2b14f1b777718096947ed54c0646336eba0f5f4552a8b2a4ecc86d1cea6"} Jun 05 13:17:41.669512 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:41.669465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" event={"ID":"116bc5f1-3cc5-4d46-9c5b-803e6375b3e2","Type":"ContainerStarted","Data":"06908d96d6821939b56c85df4b884b9d4cbfd626fe6eb2a857f1af6a35f43c38"} Jun 05 13:17:41.669891 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:41.669544 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:17:41.687790 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:41.687731 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" podStartSLOduration=1.169379804 podStartE2EDuration="3.687715501s" totalImagesPullingTime="2.518335697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:17:41.685431493 +0000 UTC m=+662.669288279" watchObservedRunningTime="2026-06-05 13:17:41.687715501 +0000 UTC m=+662.671572286" Jun 05 13:17:52.678163 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:17:52.678123 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z29bp" Jun 05 13:18:06.476064 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.476027 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8"] Jun 05 13:18:06.485236 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.485210 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.488179 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.488141 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wrd7p\"" Jun 05 13:18:06.489048 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.489027 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 13:18:06.489136 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.489027 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 13:18:06.496018 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.495986 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8"] Jun 05 13:18:06.576933 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.576867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.577139 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.576945 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzpn\" (UniqueName: \"kubernetes.io/projected/a789f879-2970-4616-9de9-8c3cb05c9d7b-kube-api-access-kzzpn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.577139 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.577079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.678394 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.678343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.678394 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.678401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzpn\" (UniqueName: \"kubernetes.io/projected/a789f879-2970-4616-9de9-8c3cb05c9d7b-kube-api-access-kzzpn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.678626 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.678466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.678745 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.678724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.678789 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.678750 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.689207 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.689181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzpn\" (UniqueName: \"kubernetes.io/projected/a789f879-2970-4616-9de9-8c3cb05c9d7b-kube-api-access-kzzpn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.796559 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.796522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:06.939630 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:06.939599 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8"] Jun 05 13:18:06.940524 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:18:06.940476 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda789f879_2970_4616_9de9_8c3cb05c9d7b.slice/crio-200f4c20ca88b906e5541af605659b17842f9d46e91e02db9f793a3c4e6849f9 WatchSource:0}: Error finding container 200f4c20ca88b906e5541af605659b17842f9d46e91e02db9f793a3c4e6849f9: Status 404 returned error can't find the container with id 200f4c20ca88b906e5541af605659b17842f9d46e91e02db9f793a3c4e6849f9 Jun 05 13:18:07.822037 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:07.821993 2572 generic.go:356] "Generic (PLEG): container finished" podID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerID="2c88a47243bdae763e0789a1c2518bf759de9a24bd26617cf8436b25b893fb02" exitCode=0 Jun 05 13:18:07.822037 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:07.822035 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" event={"ID":"a789f879-2970-4616-9de9-8c3cb05c9d7b","Type":"ContainerDied","Data":"2c88a47243bdae763e0789a1c2518bf759de9a24bd26617cf8436b25b893fb02"} Jun 05 13:18:07.822481 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:07.822072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" event={"ID":"a789f879-2970-4616-9de9-8c3cb05c9d7b","Type":"ContainerStarted","Data":"200f4c20ca88b906e5541af605659b17842f9d46e91e02db9f793a3c4e6849f9"} Jun 05 13:18:08.830423 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:08.830331 2572 generic.go:356] "Generic (PLEG): container finished" podID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerID="ceae8f820901562b967e0c4beef3d641462d908fa55d42f2fbe17f3d068cc5c9" exitCode=0 Jun 05 13:18:08.830793 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:08.830424 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" event={"ID":"a789f879-2970-4616-9de9-8c3cb05c9d7b","Type":"ContainerDied","Data":"ceae8f820901562b967e0c4beef3d641462d908fa55d42f2fbe17f3d068cc5c9"} Jun 05 13:18:09.838122 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:09.838079 2572 generic.go:356] "Generic (PLEG): container finished" podID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerID="e6eeea546f63aad918a4a7c89d59b0d223aac99ac889417cc2a018bd153ff8a9" exitCode=0 Jun 05 13:18:09.838522 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:09.838158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" event={"ID":"a789f879-2970-4616-9de9-8c3cb05c9d7b","Type":"ContainerDied","Data":"e6eeea546f63aad918a4a7c89d59b0d223aac99ac889417cc2a018bd153ff8a9"} Jun 05 13:18:10.998123 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:10.998084 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:11.120537 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.120431 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-bundle\") pod \"a789f879-2970-4616-9de9-8c3cb05c9d7b\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " Jun 05 13:18:11.120537 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.120487 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-util\") pod \"a789f879-2970-4616-9de9-8c3cb05c9d7b\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " Jun 05 13:18:11.120788 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.120572 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzzpn\" (UniqueName: \"kubernetes.io/projected/a789f879-2970-4616-9de9-8c3cb05c9d7b-kube-api-access-kzzpn\") pod \"a789f879-2970-4616-9de9-8c3cb05c9d7b\" (UID: \"a789f879-2970-4616-9de9-8c3cb05c9d7b\") " Jun 05 13:18:11.121068 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.121044 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-bundle" (OuterVolumeSpecName: "bundle") pod "a789f879-2970-4616-9de9-8c3cb05c9d7b" (UID: "a789f879-2970-4616-9de9-8c3cb05c9d7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:18:11.122805 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.122777 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a789f879-2970-4616-9de9-8c3cb05c9d7b-kube-api-access-kzzpn" (OuterVolumeSpecName: "kube-api-access-kzzpn") pod "a789f879-2970-4616-9de9-8c3cb05c9d7b" (UID: "a789f879-2970-4616-9de9-8c3cb05c9d7b"). InnerVolumeSpecName "kube-api-access-kzzpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:18:11.127136 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.127075 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-util" (OuterVolumeSpecName: "util") pod "a789f879-2970-4616-9de9-8c3cb05c9d7b" (UID: "a789f879-2970-4616-9de9-8c3cb05c9d7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:18:11.222128 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.222082 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzzpn\" (UniqueName: \"kubernetes.io/projected/a789f879-2970-4616-9de9-8c3cb05c9d7b-kube-api-access-kzzpn\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:18:11.222128 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.222123 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:18:11.222128 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.222133 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a789f879-2970-4616-9de9-8c3cb05c9d7b-util\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\"" Jun 05 13:18:11.851344 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.851306 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" event={"ID":"a789f879-2970-4616-9de9-8c3cb05c9d7b","Type":"ContainerDied","Data":"200f4c20ca88b906e5541af605659b17842f9d46e91e02db9f793a3c4e6849f9"} Jun 05 13:18:11.851551 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.851349 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70lfbg8" Jun 05 13:18:11.851551 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:18:11.851358 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="200f4c20ca88b906e5541af605659b17842f9d46e91e02db9f793a3c4e6849f9" Jun 05 13:19:41.307482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:19:41.307444 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:20:35.800878 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.800840 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj"] Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801227 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="pull" Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801240 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="pull" Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801258 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="extract" Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801263 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="extract" Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801273 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="util" Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801279 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="util" Jun 05 13:20:35.801351 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.801351 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a789f879-2970-4616-9de9-8c3cb05c9d7b" containerName="extract" Jun 05 13:20:35.804630 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.804611 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:35.810615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.810593 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 13:20:35.812416 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.812389 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 13:20:35.812645 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.812627 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 13:20:35.813000 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.812630 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g52bz\"" Jun 05 13:20:35.817448 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.817426 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj"] Jun 05 13:20:35.908618 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.908574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:35.908805 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.908634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8f6\" (UniqueName: \"kubernetes.io/projected/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-kube-api-access-hm8f6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:35.908805 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.908718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:35.908805 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.908753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:35.908805 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.908799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:35.908990 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:35.908818 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.009555 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.009511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8f6\" (UniqueName: \"kubernetes.io/projected/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-kube-api-access-hm8f6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.009733 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.009576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.009733 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.009600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.009733 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.009629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.009733 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.009645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.009733 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.009705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.010087 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.010063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.010147 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.010125 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.010184 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.010150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.012110 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.012083 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.012227 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.012200 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.017945 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.017926 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8f6\" (UniqueName: \"kubernetes.io/projected/bf5dfbda-68fd-40f1-9517-2ac40c536bb7-kube-api-access-hm8f6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj\" (UID: \"bf5dfbda-68fd-40f1-9517-2ac40c536bb7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.116519 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.116415 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:36.230210 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.230171 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:20:36.264467 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.264442 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj"] Jun 05 13:20:36.266775 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:20:36.266741 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5dfbda_68fd_40f1_9517_2ac40c536bb7.slice/crio-822d326b871750942c5076e13b286788d09d404da0d7c6cce42c6dc03cc015e2 WatchSource:0}: Error finding container 822d326b871750942c5076e13b286788d09d404da0d7c6cce42c6dc03cc015e2: Status 404 returned error can't find the container with id 822d326b871750942c5076e13b286788d09d404da0d7c6cce42c6dc03cc015e2 Jun 05 13:20:36.268833 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.268811 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:20:36.712609 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:36.712567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" event={"ID":"bf5dfbda-68fd-40f1-9517-2ac40c536bb7","Type":"ContainerStarted","Data":"822d326b871750942c5076e13b286788d09d404da0d7c6cce42c6dc03cc015e2"} Jun 05 13:20:40.745365 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:40.745316 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" event={"ID":"bf5dfbda-68fd-40f1-9517-2ac40c536bb7","Type":"ContainerStarted","Data":"58b93208cc0f113e7bb3df0733c0d14203b8c5066205783bbd2a413ec01cfef8"} Jun 05 13:20:41.752355 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:41.752309 2572 generic.go:356] "Generic (PLEG): container finished" podID="bf5dfbda-68fd-40f1-9517-2ac40c536bb7" containerID="58b93208cc0f113e7bb3df0733c0d14203b8c5066205783bbd2a413ec01cfef8" exitCode=0 Jun 05 13:20:41.752736 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:41.752386 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" event={"ID":"bf5dfbda-68fd-40f1-9517-2ac40c536bb7","Type":"ContainerDied","Data":"58b93208cc0f113e7bb3df0733c0d14203b8c5066205783bbd2a413ec01cfef8"} Jun 05 13:20:43.769043 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:43.768997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" event={"ID":"bf5dfbda-68fd-40f1-9517-2ac40c536bb7","Type":"ContainerStarted","Data":"b044bcbfbd429d6e33969ae7523150cb6735469d54cce56539d53db4f1643c57"} Jun 05 13:20:43.789031 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:43.788962 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" podStartSLOduration=2.352439096 podStartE2EDuration="8.788939426s" totalImagesPullingTime="5.039659702s" totalInitContainerRuntime="1.396840628s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:20:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:20:43.787507181 +0000 UTC m=+844.771363967" watchObservedRunningTime="2026-06-05 13:20:43.788939426 +0000 UTC m=+844.772796188" Jun 05 13:20:46.116987 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:46.116945 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:46.117401 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:46.117014 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:46.129987 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:46.129948 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:46.798398 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:46.798370 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj" Jun 05 13:20:50.186400 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:50.186342 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:20:59.286430 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:20:59.286376 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:21:14.080206 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:14.080162 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:21:22.297074 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.297030 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq"] Jun 05 13:21:22.304506 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.304467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.307219 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.307188 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 13:21:22.317482 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.317444 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq"] Jun 05 13:21:22.448788 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.448744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cks8f\" (UniqueName: \"kubernetes.io/projected/23bb368e-28b7-4349-93d2-9a4d69ba2775-kube-api-access-cks8f\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.448788 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.448787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.449082 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.448876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.449082 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.448936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.449082 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.448953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bb368e-28b7-4349-93d2-9a4d69ba2775-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.449082 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.449023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.550492 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.550492 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550426 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.550492 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bb368e-28b7-4349-93d2-9a4d69ba2775-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.550817 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.550817 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cks8f\" (UniqueName: \"kubernetes.io/projected/23bb368e-28b7-4349-93d2-9a4d69ba2775-kube-api-access-cks8f\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.550817 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.551036 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.550825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.551095 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.551032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.551312 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.551289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.553293 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.553264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bb368e-28b7-4349-93d2-9a4d69ba2775-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.553424 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.553303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23bb368e-28b7-4349-93d2-9a4d69ba2775-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.565137 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.565095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cks8f\" (UniqueName: \"kubernetes.io/projected/23bb368e-28b7-4349-93d2-9a4d69ba2775-kube-api-access-cks8f\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq\" (UID: \"23bb368e-28b7-4349-93d2-9a4d69ba2775\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.618934 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.618844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:21:22.775352 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:22.775318 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq"] Jun 05 13:21:22.776601 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:21:22.776570 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bb368e_28b7_4349_93d2_9a4d69ba2775.slice/crio-c02368d9185d82e4d7bf72da79f0a58cf79fd649b108d8aba93e84e5e1941d69 WatchSource:0}: Error finding container c02368d9185d82e4d7bf72da79f0a58cf79fd649b108d8aba93e84e5e1941d69: Status 404 returned error can't find the container with id c02368d9185d82e4d7bf72da79f0a58cf79fd649b108d8aba93e84e5e1941d69 Jun 05 13:21:23.012823 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:23.012781 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" event={"ID":"23bb368e-28b7-4349-93d2-9a4d69ba2775","Type":"ContainerStarted","Data":"a212f323e73793bc821e09554eed3edd391dd69ef213e1bf1ba1fdd05103a5ac"} Jun 05 13:21:23.013076 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:23.012856 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" event={"ID":"23bb368e-28b7-4349-93d2-9a4d69ba2775","Type":"ContainerStarted","Data":"c02368d9185d82e4d7bf72da79f0a58cf79fd649b108d8aba93e84e5e1941d69"} Jun 05 13:21:23.789301 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:23.789255 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:21:38.204381 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.202387 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk"] Jun 05 13:21:38.210457 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.210417 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.214206 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.214165 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk"] Jun 05 13:21:38.214406 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.214214 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 13:21:38.291815 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.291774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.292051 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.291833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wqr\" (UniqueName: \"kubernetes.io/projected/0ea36911-048c-4338-afce-333e5bda6321-kube-api-access-c7wqr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.292051 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.291958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea36911-048c-4338-afce-333e5bda6321-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.292051 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.292008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.292182 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.292068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.292182 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.292098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.393545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.393503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.393545 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.393549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.393811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.393582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.393811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.393611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wqr\" (UniqueName: \"kubernetes.io/projected/0ea36911-048c-4338-afce-333e5bda6321-kube-api-access-c7wqr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.393811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.393637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea36911-048c-4338-afce-333e5bda6321-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.393811 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.393670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.394057 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.394037 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.394173 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.394147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.394238 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.394187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.396123 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.396097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea36911-048c-4338-afce-333e5bda6321-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.396278 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.396259 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea36911-048c-4338-afce-333e5bda6321-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.406629 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.406595 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wqr\" (UniqueName: \"kubernetes.io/projected/0ea36911-048c-4338-afce-333e5bda6321-kube-api-access-c7wqr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-q5wpk\" (UID: \"0ea36911-048c-4338-afce-333e5bda6321\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.524253 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.524213 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:38.675828 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:38.675801 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk"] Jun 05 13:21:38.677533 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:21:38.677498 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea36911_048c_4338_afce_333e5bda6321.slice/crio-6ef84462f4391c3399342505a44edf44e26453849adce5de4268d5edd716a885 WatchSource:0}: Error finding container 6ef84462f4391c3399342505a44edf44e26453849adce5de4268d5edd716a885: Status 404 returned error can't find the container with id 6ef84462f4391c3399342505a44edf44e26453849adce5de4268d5edd716a885 Jun 05 13:21:39.119509 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:39.119462 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" event={"ID":"0ea36911-048c-4338-afce-333e5bda6321","Type":"ContainerStarted","Data":"ed3a0c5ca2e6f99b87de723ea469f16092f61191db8c56c4ec8a44bd84a707dd"} Jun 05 13:21:39.119509 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:39.119513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" event={"ID":"0ea36911-048c-4338-afce-333e5bda6321","Type":"ContainerStarted","Data":"6ef84462f4391c3399342505a44edf44e26453849adce5de4268d5edd716a885"} Jun 05 13:21:39.473866 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:39.473764 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:21:39.479582 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:39.479556 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:21:40.183100 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:40.183048 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:21:42.140264 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:42.140173 2572 generic.go:356] "Generic (PLEG): container finished" podID="0ea36911-048c-4338-afce-333e5bda6321" containerID="ed3a0c5ca2e6f99b87de723ea469f16092f61191db8c56c4ec8a44bd84a707dd" exitCode=0 Jun 05 13:21:42.140264 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:42.140247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" event={"ID":"0ea36911-048c-4338-afce-333e5bda6321","Type":"ContainerDied","Data":"ed3a0c5ca2e6f99b87de723ea469f16092f61191db8c56c4ec8a44bd84a707dd"} Jun 05 13:21:43.148341 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:43.148304 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" event={"ID":"0ea36911-048c-4338-afce-333e5bda6321","Type":"ContainerStarted","Data":"c4815e6fb5d5f2b2443779fc2429f18b7fe030f343c6b60e18fb9e1915fe8c8b"} Jun 05 13:21:43.172371 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:43.172319 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" podStartSLOduration=1.8115687459999998 podStartE2EDuration="5.172303156s" totalImagesPullingTime="259.365051ms" totalInitContainerRuntime="3.101369359s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:21:43.16910534 +0000 UTC m=+904.152962137" watchObservedRunningTime="2026-06-05 13:21:43.172303156 +0000 UTC m=+904.156159994" Jun 05 13:21:48.524888 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:48.524812 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:48.525440 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:48.524947 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:48.538608 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:48.538569 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:21:49.195911 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:21:49.195875 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-q5wpk" Jun 05 13:22:52.592128 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:22:52.592081 2572 generic.go:356] "Generic (PLEG): container finished" podID="23bb368e-28b7-4349-93d2-9a4d69ba2775" containerID="a212f323e73793bc821e09554eed3edd391dd69ef213e1bf1ba1fdd05103a5ac" exitCode=0 Jun 05 13:22:52.592613 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:22:52.592157 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" event={"ID":"23bb368e-28b7-4349-93d2-9a4d69ba2775","Type":"ContainerDied","Data":"a212f323e73793bc821e09554eed3edd391dd69ef213e1bf1ba1fdd05103a5ac"} Jun 05 13:22:53.602107 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:22:53.602066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" event={"ID":"23bb368e-28b7-4349-93d2-9a4d69ba2775","Type":"ContainerStarted","Data":"a882b3e32315d211e315df2730b993382edfe19f31d33981ef7d45297f0f1e92"} Jun 05 13:22:53.624274 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:22:53.624203 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" podStartSLOduration=1.980514681 podStartE2EDuration="1m31.624180685s" totalImagesPullingTime="247.459123ms" totalInitContainerRuntime="1m29.396206881s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:22:53.622016526 +0000 UTC m=+974.605873311" watchObservedRunningTime="2026-06-05 13:22:53.624180685 +0000 UTC m=+974.608037470" Jun 05 13:23:02.619101 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:23:02.619056 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:23:02.619626 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:23:02.619136 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:23:02.632125 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:23:02.632091 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:23:02.668643 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:23:02.668608 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq" Jun 05 13:23:49.186736 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:23:49.186695 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:23:58.879977 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:23:58.879929 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:24:08.789888 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:24:08.789847 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:24:18.281791 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:24:18.281695 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:24:26.988399 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:24:26.988352 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:24:37.296463 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:24:37.296422 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:25:50.079503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:25:50.079367 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:26:05.186530 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:26:05.186488 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:26:39.522558 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:26:39.522524 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:26:39.530492 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:26:39.530464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:26:44.991548 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:26:44.991498 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:27:01.498319 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:27:01.498266 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:27:15.395100 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:27:15.395047 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:27:30.686053 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:27:30.685968 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:28:26.981531 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:28:26.981492 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:28:35.880410 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:28:35.880369 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:28:52.778550 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:28:52.778457 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:29:01.783764 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:29:01.783714 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:29:19.183171 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:29:19.183133 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:29:27.985144 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:29:27.985099 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:29:58.779584 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:29:58.779537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:30:07.188390 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:30:07.188336 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:30:15.593083 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:30:15.593034 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:30:25.289078 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:30:25.288962 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:30:33.376719 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:30:33.376677 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:30:50.091003 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:30:50.090961 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:31:03.789130 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:31:03.789083 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:31:39.566700 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:31:39.566666 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:31:39.576089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:31:39.576062 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:31:50.286129 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:31:50.286005 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:31:56.385749 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:31:56.385707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:05.591726 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:05.591673 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:11.885499 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:11.885459 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:22.582970 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:22.582930 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:31.486281 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:31.486237 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:39.889972 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:39.889935 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:48.388218 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:48.388149 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:32:57.487089 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:32:57.487038 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:04.490431 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:04.490386 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:15.080661 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:15.080608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:24.082244 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:24.082157 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:33.579415 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:33.579368 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:40.392885 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:40.392842 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:48.488649 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:48.488591 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:33:58.526615 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:33:58.526574 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:34:07.382364 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:34:07.382321 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:34:16.511656 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:34:16.511598 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:36:34.174732 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:36:34.174686 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:36:39.616845 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:36:39.616809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:36:39.626699 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:36:39.626669 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:36:41.179526 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:36:41.179470 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:04.286454 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:04.286406 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:13.588728 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:13.588688 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:22.383460 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:22.383410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:31.486777 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:31.486720 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:40.389591 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:40.389545 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:51.482566 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:51.482479 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:37:59.578619 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:37:59.578583 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:38:10.387542 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:38:10.387503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:38:19.293640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:38:19.293588 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:38:30.493879 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:38:30.493836 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:38:39.089693 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:38:39.089636 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:39:13.591548 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:39:13.591505 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:39:55.991421 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:39:55.991324 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:40:05.385465 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:40:05.385417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:40:14.591233 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:40:14.591176 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:40:21.788293 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:40:21.788234 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:40:30.795409 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:40:30.795362 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:40:44.108638 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:40:44.108597 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:40:52.793779 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:40:52.793668 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:41:03.885738 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:03.885697 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:41:12.093288 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:12.093250 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:41:18.689697 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:18.689633 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:41:29.491196 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:29.491143 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:41:39.671028 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:39.670999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:41:39.681603 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:39.681574 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:41:41.787183 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:41.787119 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:41:58.488176 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:41:58.488134 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:42:07.288816 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:42:07.288750 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:42:15.788155 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:42:15.788087 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:42:24.594926 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:42:24.594807 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:42:39.987687 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:42:39.987645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:42:48.696767 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:42:48.696707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:42:57.189861 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:42:57.189805 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:43:05.986746 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:43:05.986697 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:43:14.884114 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:43:14.884060 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:43:24.088752 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:43:24.088707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:43:32.695510 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:43:32.695461 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:43:45.993731 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:43:45.993670 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:43:54.788407 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:43:54.788315 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:44:08.593329 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:44:08.593287 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:44:18.796117 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:44:18.796065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:44:26.886981 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:44:26.886935 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:44:36.791804 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:44:36.791751 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:44:44.788238 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:44:44.788199 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:45:03.489816 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:45:03.489779 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:45:10.187876 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:45:10.187833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:45:21.098073 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:45:21.097961 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:45:28.691617 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:45:28.691570 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:45:54.088606 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:45:54.088562 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:46:07.597952 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:07.597909 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z29bp"] Jun 05 13:46:39.722045 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:39.722007 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:46:39.731656 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:39.731622 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-66cs7_647a70be-d842-462d-b7f6-f80b7c147f1f/ovn-acl-logging/0.log" Jun 05 13:46:44.597503 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:44.597476 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6bb7cdc59b-6znjc_ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c/nginx/0.log" Jun 05 13:46:44.815460 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:44.815427 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7x7ll_31da7ce3-8120-4e65-bde2-381a87b6dbc0/manager/0.log" Jun 05 13:46:44.925572 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:44.925488 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lpjbj_34d4ecc7-4288-4a65-b85c-1cc46656dab0/manager/0.log" Jun 05 13:46:45.818573 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:45.818543 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b9f446d7-6rk9l_90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc/copy-manifests/0.log" Jun 05 13:46:45.834640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:45.834610 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b9f446d7-6rk9l_90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc/manager/0.log" Jun 05 13:46:46.823564 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:46.823533 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2_719786e2-f588-49b1-af70-9a1d10489ed9/util/0.log" Jun 05 13:46:46.831055 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:46.831032 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2_719786e2-f588-49b1-af70-9a1d10489ed9/pull/0.log" Jun 05 13:46:46.841291 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:46.841260 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2_719786e2-f588-49b1-af70-9a1d10489ed9/extract/0.log" Jun 05 13:46:46.952203 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:46.952166 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q_25b04d58-7418-4280-bf1b-b402a8e4643c/util/0.log" Jun 05 13:46:46.958673 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:46.958651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q_25b04d58-7418-4280-bf1b-b402a8e4643c/pull/0.log" Jun 05 13:46:46.964937 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:46.964914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q_25b04d58-7418-4280-bf1b-b402a8e4643c/extract/0.log" Jun 05 13:46:47.079960 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.079871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz_9775e1ee-cb83-42cd-8e8e-9ea4667e047a/util/0.log" Jun 05 13:46:47.088113 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.088086 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz_9775e1ee-cb83-42cd-8e8e-9ea4667e047a/pull/0.log" Jun 05 13:46:47.095223 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.095200 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz_9775e1ee-cb83-42cd-8e8e-9ea4667e047a/extract/0.log" Jun 05 13:46:47.208456 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.208424 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp_d482ce40-8754-463c-b43c-8571d4c46b87/util/0.log" Jun 05 13:46:47.218505 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.218480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp_d482ce40-8754-463c-b43c-8571d4c46b87/pull/0.log" Jun 05 13:46:47.226626 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.226598 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp_d482ce40-8754-463c-b43c-8571d4c46b87/extract/0.log" Jun 05 13:46:47.578332 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:47.578290 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f7gct_2bc6af5a-d23f-4039-b656-9c97f3ae0fd6/manager/0.log" Jun 05 13:46:48.035726 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:48.035696 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z29bp_116bc5f1-3cc5-4d46-9c5b-803e6375b3e2/limitador/0.log" Jun 05 13:46:48.149947 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:48.149915 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7clv6_62208486-c9c3-45a6-bcbd-78b78f34a1d6/manager/0.log" Jun 05 13:46:48.600542 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:48.600510 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zc97c_0b03d498-2369-41d9-9a99-b29d20cb7c60/discovery/0.log" Jun 05 13:46:48.821414 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:48.821380 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f65db7bc7-sr96p_f6196143-142a-434c-a2f0-5c55d21810fe/kube-auth-proxy/0.log" Jun 05 13:46:49.269219 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:49.269186 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7b8db57c-qvq67_f291c94e-af95-494f-9acc-b33ead60d2aa/router/0.log" Jun 05 13:46:49.626470 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:49.626385 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj_bf5dfbda-68fd-40f1-9517-2ac40c536bb7/storage-initializer/0.log" Jun 05 13:46:49.648569 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:49.648531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-47lnj_bf5dfbda-68fd-40f1-9517-2ac40c536bb7/main/0.log" Jun 05 13:46:50.151379 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:50.151351 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq_23bb368e-28b7-4349-93d2-9a4d69ba2775/storage-initializer/0.log" Jun 05 13:46:50.159947 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:50.159919 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-7wfqq_23bb368e-28b7-4349-93d2-9a4d69ba2775/main/0.log" Jun 05 13:46:50.278423 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:50.278393 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-q5wpk_0ea36911-048c-4338-afce-333e5bda6321/storage-initializer/0.log" Jun 05 13:46:50.286179 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:50.286155 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-q5wpk_0ea36911-048c-4338-afce-333e5bda6321/main/0.log" Jun 05 13:46:58.440308 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:58.440273 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jksxg_3d0f661f-33c1-4b02-8972-379dff5652d4/global-pull-secret-syncer/0.log" Jun 05 13:46:58.588008 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:58.587967 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lfrq2_11a43761-8917-4579-a7b0-fbb50e25c616/konnectivity-agent/0.log" Jun 05 13:46:58.675548 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:46:58.675513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-220.ec2.internal_bf824754e7c0786db2cfcf0384e43bd7/haproxy/0.log" Jun 05 13:47:02.439514 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:02.439468 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-wnq88_23d560b1-241d-46c6-87a7-73b0881c9eb3/sail-operator/0.log" Jun 05 13:47:03.203332 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.203274 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2_719786e2-f588-49b1-af70-9a1d10489ed9/extract/0.log" Jun 05 13:47:03.271078 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.271046 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2_719786e2-f588-49b1-af70-9a1d10489ed9/util/0.log" Jun 05 13:47:03.343480 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.343437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759btvv2_719786e2-f588-49b1-af70-9a1d10489ed9/pull/0.log" Jun 05 13:47:03.418496 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.418458 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q_25b04d58-7418-4280-bf1b-b402a8e4643c/extract/0.log" Jun 05 13:47:03.495006 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.494973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q_25b04d58-7418-4280-bf1b-b402a8e4643c/util/0.log" Jun 05 13:47:03.535401 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.535363 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rpn5q_25b04d58-7418-4280-bf1b-b402a8e4643c/pull/0.log" Jun 05 13:47:03.589387 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.589354 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz_9775e1ee-cb83-42cd-8e8e-9ea4667e047a/extract/0.log" Jun 05 13:47:03.631872 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.631845 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz_9775e1ee-cb83-42cd-8e8e-9ea4667e047a/util/0.log" Jun 05 13:47:03.681948 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.681914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdckz_9775e1ee-cb83-42cd-8e8e-9ea4667e047a/pull/0.log" Jun 05 13:47:03.722034 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.722000 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp_d482ce40-8754-463c-b43c-8571d4c46b87/extract/0.log" Jun 05 13:47:03.773728 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.773622 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp_d482ce40-8754-463c-b43c-8571d4c46b87/util/0.log" Jun 05 13:47:03.812205 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:03.812169 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef194ftp_d482ce40-8754-463c-b43c-8571d4c46b87/pull/0.log" Jun 05 13:47:04.202663 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:04.202579 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f7gct_2bc6af5a-d23f-4039-b656-9c97f3ae0fd6/manager/0.log" Jun 05 13:47:04.441762 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:04.441725 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z29bp_116bc5f1-3cc5-4d46-9c5b-803e6375b3e2/limitador/0.log" Jun 05 13:47:04.548925 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:04.548869 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7clv6_62208486-c9c3-45a6-bcbd-78b78f34a1d6/manager/0.log" Jun 05 13:47:06.385560 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.385528 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/alertmanager/0.log" Jun 05 13:47:06.420956 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.420925 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/config-reloader/0.log" Jun 05 13:47:06.464588 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.464560 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/kube-rbac-proxy-web/0.log" Jun 05 13:47:06.514728 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.514702 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/kube-rbac-proxy/0.log" Jun 05 13:47:06.560428 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.560396 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/kube-rbac-proxy-metric/0.log" Jun 05 13:47:06.598844 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.598813 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/prom-label-proxy/0.log" Jun 05 13:47:06.640195 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.640105 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69124386-147c-489c-9cce-2caa276ad55e/init-config-reloader/0.log" Jun 05 13:47:06.940566 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.940460 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkf5q_89661447-6aa6-4b61-93d4-05f1293f0ac8/node-exporter/0.log" Jun 05 13:47:06.971033 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:06.971005 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkf5q_89661447-6aa6-4b61-93d4-05f1293f0ac8/kube-rbac-proxy/0.log" Jun 05 13:47:07.009801 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.009772 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkf5q_89661447-6aa6-4b61-93d4-05f1293f0ac8/init-textfile/0.log" Jun 05 13:47:07.256678 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.256646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-58fmd_0d7d703c-e467-4228-86bf-dd4179f3f3df/kube-rbac-proxy-main/0.log" Jun 05 13:47:07.292237 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.292104 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-58fmd_0d7d703c-e467-4228-86bf-dd4179f3f3df/kube-rbac-proxy-self/0.log" Jun 05 13:47:07.324837 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.324801 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-58fmd_0d7d703c-e467-4228-86bf-dd4179f3f3df/openshift-state-metrics/0.log" Jun 05 13:47:07.889832 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.889797 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/thanos-query/0.log" Jun 05 13:47:07.943489 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.943455 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy-web/0.log" Jun 05 13:47:07.994499 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:07.994471 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy/0.log" Jun 05 13:47:08.028411 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:08.028385 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/prom-label-proxy/0.log" Jun 05 13:47:08.070599 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:08.070564 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy-rules/0.log" Jun 05 13:47:08.110462 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:08.110425 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85557b696d-cv54g_5b9822f0-7cc2-49bc-9efa-a53eb86a45ed/kube-rbac-proxy-metrics/0.log" Jun 05 13:47:09.484106 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.484053 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4"] Jun 05 13:47:09.488002 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.487975 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.490640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.490590 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nb2f\"/\"openshift-service-ca.crt\"" Jun 05 13:47:09.490812 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.490762 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4nb2f\"/\"default-dockercfg-bfjnb\"" Jun 05 13:47:09.491508 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.491485 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nb2f\"/\"kube-root-ca.crt\"" Jun 05 13:47:09.503073 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.503037 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4"] Jun 05 13:47:09.602202 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.602155 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92d5g\" (UniqueName: \"kubernetes.io/projected/b30f6eb7-7102-43b1-ac73-78a567bf9865-kube-api-access-92d5g\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.602424 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.602224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-podres\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.602424 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.602276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-proc\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.602424 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.602296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-lib-modules\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.602424 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.602405 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-sys\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703313 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92d5g\" (UniqueName: \"kubernetes.io/projected/b30f6eb7-7102-43b1-ac73-78a567bf9865-kube-api-access-92d5g\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703546 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-podres\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703546 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-proc\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703546 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-lib-modules\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703546 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-sys\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703546 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-proc\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703760 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-podres\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703760 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703549 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-sys\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.703760 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.703615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b30f6eb7-7102-43b1-ac73-78a567bf9865-lib-modules\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.712391 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.712345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92d5g\" (UniqueName: \"kubernetes.io/projected/b30f6eb7-7102-43b1-ac73-78a567bf9865-kube-api-access-92d5g\") pod \"perf-node-gather-daemonset-hlmd4\" (UID: \"b30f6eb7-7102-43b1-ac73-78a567bf9865\") " pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.800039 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.799999 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:09.974660 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:09.974618 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4"] Jun 05 13:47:09.976961 ip-10-0-141-220 kubenswrapper[2572]: W0605 13:47:09.976921 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb30f6eb7_7102_43b1_ac73_78a567bf9865.slice/crio-6bf56e3f07f6b296d521f62cec90f9ffcea34e48b723045ca6d54bd52befe092 WatchSource:0}: Error finding container 6bf56e3f07f6b296d521f62cec90f9ffcea34e48b723045ca6d54bd52befe092: Status 404 returned error can't find the container with id 6bf56e3f07f6b296d521f62cec90f9ffcea34e48b723045ca6d54bd52befe092 Jun 05 13:47:10.657421 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:10.657371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" event={"ID":"b30f6eb7-7102-43b1-ac73-78a567bf9865","Type":"ContainerStarted","Data":"5432a1c4516a119ab4f9de445cf93fe17fb4dd59b12ce33c9153301457e7768e"} Jun 05 13:47:10.658046 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:10.657457 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" event={"ID":"b30f6eb7-7102-43b1-ac73-78a567bf9865","Type":"ContainerStarted","Data":"6bf56e3f07f6b296d521f62cec90f9ffcea34e48b723045ca6d54bd52befe092"} Jun 05 13:47:10.658046 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:10.657490 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:10.691015 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:10.690949 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" podStartSLOduration=1.6908942310000001 podStartE2EDuration="1.690894231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:47:10.687074743 +0000 UTC m=+2431.670931528" watchObservedRunningTime="2026-06-05 13:47:10.690894231 +0000 UTC m=+2431.674751101" Jun 05 13:47:10.951843 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:10.951736 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-6dpw9_36753604-612f-45a9-a5a7-6ab50b20a7ea/download-server/0.log" Jun 05 13:47:12.957488 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:12.957448 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wxvpw_3d722289-5264-41e2-bd1e-57c3684d73e0/dns/0.log" Jun 05 13:47:13.008877 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:13.008844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wxvpw_3d722289-5264-41e2-bd1e-57c3684d73e0/kube-rbac-proxy/0.log" Jun 05 13:47:13.136791 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:13.136762 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjbt9_0729fc09-a1b6-4791-bcc3-ab3b8f8666bf/dns-node-resolver/0.log" Jun 05 13:47:13.777018 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:13.776981 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mm8w9_6f22c6a9-c23d-47ae-8341-b43c65f5e50d/node-ca/0.log" Jun 05 13:47:14.926752 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:14.926720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zc97c_0b03d498-2369-41d9-9a99-b29d20cb7c60/discovery/0.log" Jun 05 13:47:14.982770 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:14.982739 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f65db7bc7-sr96p_f6196143-142a-434c-a2f0-5c55d21810fe/kube-auth-proxy/0.log" Jun 05 13:47:15.186045 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:15.185973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7b8db57c-qvq67_f291c94e-af95-494f-9acc-b33ead60d2aa/router/0.log" Jun 05 13:47:15.968077 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:15.968052 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwh7x_2ca1d20e-34b9-416b-b297-831a956bde72/serve-healthcheck-canary/0.log" Jun 05 13:47:16.674363 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:16.674334 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4nb2f/perf-node-gather-daemonset-hlmd4" Jun 05 13:47:16.741042 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:16.741012 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mhl5_4ac235ed-8c05-4158-abc9-afd30d128167/kube-rbac-proxy/0.log" Jun 05 13:47:16.771856 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:16.771829 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mhl5_4ac235ed-8c05-4158-abc9-afd30d128167/exporter/0.log" Jun 05 13:47:16.796269 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:16.796238 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mhl5_4ac235ed-8c05-4158-abc9-afd30d128167/extractor/0.log" Jun 05 13:47:19.678692 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:19.678640 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6bb7cdc59b-6znjc_ca8ad8b1-aa7d-46da-ad56-64b5e5f4d75c/nginx/0.log" Jun 05 13:47:19.736648 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:19.736613 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7x7ll_31da7ce3-8120-4e65-bde2-381a87b6dbc0/manager/0.log" Jun 05 13:47:19.821975 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:19.821932 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lpjbj_34d4ecc7-4288-4a65-b85c-1cc46656dab0/manager/0.log" Jun 05 13:47:20.333747 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:20.333700 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b9f446d7-6rk9l_90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc/manager/0.log" Jun 05 13:47:20.352007 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:20.351974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b9f446d7-6rk9l_90cb1ef8-b1ac-44d5-9fac-69a3b1dff5bc/copy-manifests/0.log" Jun 05 13:47:22.202512 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:22.202480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8sbhf_357fd7e0-4e11-46a3-b8ff-6413dba17a95/openshift-lws-operator/0.log" Jun 05 13:47:23.563706 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:23.563643 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zc97c_0b03d498-2369-41d9-9a99-b29d20cb7c60/discovery/0.log" Jun 05 13:47:23.611798 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:23.611762 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f65db7bc7-sr96p_f6196143-142a-434c-a2f0-5c55d21810fe/kube-auth-proxy/0.log" Jun 05 13:47:23.772222 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:23.772188 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7b8db57c-qvq67_f291c94e-af95-494f-9acc-b33ead60d2aa/router/0.log" Jun 05 13:47:24.973612 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:24.973568 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zc97c_0b03d498-2369-41d9-9a99-b29d20cb7c60/discovery/0.log" Jun 05 13:47:25.005337 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:25.005291 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f65db7bc7-sr96p_f6196143-142a-434c-a2f0-5c55d21810fe/kube-auth-proxy/0.log" Jun 05 13:47:25.166290 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:25.166260 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7b8db57c-qvq67_f291c94e-af95-494f-9acc-b33ead60d2aa/router/0.log" Jun 05 13:47:27.043139 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:27.043105 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zc97c_0b03d498-2369-41d9-9a99-b29d20cb7c60/discovery/0.log" Jun 05 13:47:27.074640 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:27.074606 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f65db7bc7-sr96p_f6196143-142a-434c-a2f0-5c55d21810fe/kube-auth-proxy/0.log" Jun 05 13:47:27.227589 ip-10-0-141-220 kubenswrapper[2572]: I0605 13:47:27.227553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7b8db57c-qvq67_f291c94e-af95-494f-9acc-b33ead60d2aa/router/0.log"