Jun 10 00:57:53.357063 ip-10-0-139-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 00:57:53.357075 ip-10-0-139-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 00:57:53.357085 ip-10-0-139-200 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 00:57:53.357329 ip-10-0-139-200 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 00:58:03.573059 ip-10-0-139-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 00:58:03.573075 ip-10-0-139-200 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 00dcdc6cc3e14f60a755cea6bb884337 -- Jun 10 01:00:15.441622 ip-10-0-139-200 systemd[1]: Starting Kubernetes Kubelet... Jun 10 01:00:15.888752 ip-10-0-139-200 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:00:15.888752 ip-10-0-139-200 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 01:00:15.888752 ip-10-0-139-200 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:00:15.888752 ip-10-0-139-200 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 01:00:15.888752 ip-10-0-139-200 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:00:15.889690 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.889600 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 01:00:15.897523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897498 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:15.897523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897517 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:15.897523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897521 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:15.897523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897525 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:15.897523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897528 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:15.897523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897531 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897534 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897537 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897541 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897546 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897549 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897552 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897555 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897557 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897560 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897564 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897567 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897569 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897572 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897574 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897577 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897579 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897582 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897585 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:15.897758 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897587 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897590 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897593 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897595 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897605 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897608 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897610 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897613 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897616 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897621 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897624 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897627 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897630 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897633 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897636 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897640 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897643 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897646 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897649 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:15.898222 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897651 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897654 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897657 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897662 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897665 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897667 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897670 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897672 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897675 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897678 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897680 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897683 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897686 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897688 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897691 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897693 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897696 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897699 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897702 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897707 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:15.898713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897710 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897713 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897716 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897719 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897721 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897724 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897726 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897729 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897732 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897734 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897737 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897739 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897742 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897745 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897747 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897750 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897753 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897755 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897758 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897767 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:15.899220 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897770 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897772 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897775 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897778 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897782 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897786 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897789 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897791 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897794 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897797 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897800 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897802 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897805 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897808 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.897810 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898548 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898555 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898557 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898560 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:15.899771 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898563 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898566 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898569 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898571 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898574 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898577 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898579 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898582 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898585 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898588 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898591 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898593 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898596 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898599 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898602 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898604 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898607 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898610 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898612 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898615 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:15.900246 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898618 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898621 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898623 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898626 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898629 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898631 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898634 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898636 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898639 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898641 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898644 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898648 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898652 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898655 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898657 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898660 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898663 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898666 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898669 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:15.900755 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898671 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898674 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898676 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898679 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898681 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898684 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898688 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898692 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898695 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898698 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898701 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898704 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898707 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898710 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898713 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898715 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898718 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898721 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898723 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898726 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:15.901317 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898729 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898731 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898734 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898736 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898739 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898742 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898744 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898747 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898749 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898752 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898755 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898757 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898760 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898763 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898766 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898770 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898773 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898776 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898779 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898781 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:15.901820 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898784 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898787 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898790 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898792 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898795 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898798 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898800 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898803 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898805 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898809 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898813 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898817 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898819 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898822 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898824 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.898827 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899242 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899248 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899252 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:15.902331 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899255 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899258 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899261 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899264 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899267 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899270 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899273 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899276 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899279 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899281 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899284 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899287 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899306 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899309 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899312 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899315 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899318 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899321 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899323 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899326 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:15.902804 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899328 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899331 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899334 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899336 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899339 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899341 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899344 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899346 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899349 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899352 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899356 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899360 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899363 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899366 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899370 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899373 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899376 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899379 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899381 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:15.903314 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899384 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899386 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899389 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899392 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899394 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899399 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899402 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899405 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899408 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899411 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899413 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899416 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899418 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899421 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899423 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899426 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899429 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899431 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899434 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:15.903794 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899436 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899439 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899441 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899444 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899447 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899449 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899453 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899455 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899458 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899461 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899463 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899466 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899469 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899472 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899474 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899477 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899481 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899484 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899487 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899490 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:15.904285 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899493 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899496 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899499 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899502 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899505 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899507 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899510 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899512 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899515 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899518 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899520 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899523 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899525 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899528 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899530 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899533 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899535 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.899538 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899611 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899618 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 01:00:15.904827 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899627 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899632 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899636 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899639 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899644 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899648 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899651 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899654 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899658 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899662 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899665 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899668 2559 flags.go:64] FLAG: --cgroup-root="" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899671 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899674 2559 flags.go:64] FLAG: --client-ca-file="" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899678 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899681 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899686 2559 flags.go:64] FLAG: --cluster-domain="" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899688 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899692 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899695 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899700 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899704 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899707 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 01:00:15.905325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899710 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899713 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899716 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899719 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899722 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899726 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899729 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899732 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899735 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899741 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899744 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899747 2559 flags.go:64] FLAG: --enable-server="true" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899750 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899754 2559 flags.go:64] FLAG: --event-burst="100" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899758 2559 flags.go:64] FLAG: --event-qps="50" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899761 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899765 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899768 2559 flags.go:64] FLAG: --eviction-hard="" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899774 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899778 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899781 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899784 2559 flags.go:64] FLAG: --eviction-soft="" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899787 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899790 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899793 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 01:00:15.905876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899796 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899799 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899802 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899805 2559 flags.go:64] FLAG: --feature-gates="" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899811 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899814 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899817 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899820 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899823 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899826 2559 flags.go:64] FLAG: --help="false" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899829 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-139-200.ec2.internal" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899832 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899835 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899838 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899841 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899844 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899849 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899851 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899854 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899857 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899860 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899863 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899866 2559 flags.go:64] FLAG: --kube-reserved="" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899869 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 01:00:15.906508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899872 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899875 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899877 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899880 2559 flags.go:64] FLAG: --lock-file="" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899883 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899886 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899889 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899894 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899898 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899900 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899903 2559 flags.go:64] FLAG: --logging-format="text" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899906 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899911 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899913 2559 flags.go:64] FLAG: --manifest-url="" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899916 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899921 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899924 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899928 2559 flags.go:64] FLAG: --max-pods="110" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899931 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899934 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899937 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899940 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899943 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899946 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899950 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 01:00:15.907118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899957 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899960 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899963 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899966 2559 flags.go:64] FLAG: --pod-cidr="" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899969 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899974 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899977 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899980 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899983 2559 flags.go:64] FLAG: --port="10250" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899986 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899989 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0515479251007b32c" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899992 2559 flags.go:64] FLAG: --qos-reserved="" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899995 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.899998 2559 flags.go:64] FLAG: --register-node="true" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900002 2559 flags.go:64] FLAG: --register-with-taints="" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900005 2559 flags.go:64] FLAG: --registry-burst="10" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900008 2559 flags.go:64] FLAG: --registry-qps="5" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900011 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900015 2559 flags.go:64] FLAG: --reserved-memory="" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900020 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900023 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900026 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900028 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900031 2559 flags.go:64] FLAG: --runonce="false" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900034 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 01:00:15.907796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900037 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900040 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900043 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900046 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900049 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900052 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900055 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900060 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900063 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900066 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900069 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900072 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900074 2559 flags.go:64] FLAG: --system-cgroups="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900077 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900082 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900085 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900089 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900092 2559 flags.go:64] FLAG: --tls-min-version="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900095 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900098 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900101 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900104 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900107 2559 flags.go:64] FLAG: --v="2" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900111 2559 flags.go:64] FLAG: --version="false" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900116 2559 flags.go:64] FLAG: --vmodule="" Jun 10 01:00:15.908429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900119 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.900124 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900244 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900249 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900252 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900255 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900260 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900263 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900266 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900269 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900272 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900275 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900278 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900280 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900286 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900302 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900306 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900309 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900312 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:15.909050 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900315 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900317 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900320 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900323 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900326 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900328 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900331 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900333 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900336 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900338 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900341 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900344 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900346 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900350 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900354 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900356 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900359 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900361 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900364 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900366 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:15.909523 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900369 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900371 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900374 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900377 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900379 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900382 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900384 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900388 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900392 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900396 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900399 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900401 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900404 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900406 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900409 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900412 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900414 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900417 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900420 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:15.910015 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900422 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900425 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900428 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900430 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900433 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900435 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900438 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900443 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900445 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900448 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900450 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900453 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900455 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900458 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900461 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900463 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900466 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900468 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900471 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900473 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:15.910592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900477 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900480 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900483 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900485 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900488 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900490 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900493 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900496 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900499 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900501 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900504 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900506 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900509 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900511 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900514 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900516 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900519 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900522 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900524 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900529 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:15.911082 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900531 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900534 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.900536 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.901502 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.908762 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.908877 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.908892 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.908898 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908954 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908959 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908962 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908965 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908968 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908971 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908974 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:15.911592 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908976 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908979 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908982 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908984 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908987 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908990 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908992 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908995 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.908998 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909002 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909005 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909008 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909010 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909013 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909016 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909021 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909024 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909026 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:15.911992 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909029 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909031 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909034 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909039 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909042 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909045 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909048 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909050 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909053 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909056 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909059 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909062 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909065 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909067 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909070 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909073 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909076 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909078 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909081 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909084 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:15.912497 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909086 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909089 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909092 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909094 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909097 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909099 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909102 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909104 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909109 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909112 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909116 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909118 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909121 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909125 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909127 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909130 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909134 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909137 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909139 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909142 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:15.912993 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909144 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909147 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909150 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909154 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909157 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909160 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909163 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909165 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909168 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909170 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909173 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909176 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909178 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909181 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909183 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909186 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909188 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909191 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909194 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:15.913542 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909196 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909200 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909202 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909206 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909210 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909213 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909216 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909218 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909221 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909224 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909227 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909230 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909233 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909235 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:15.914009 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.909241 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909391 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909396 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909399 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909402 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909404 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909407 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909410 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909413 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909415 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909418 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909420 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909423 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909426 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909428 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909431 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909434 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909436 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909439 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909441 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:00:15.914390 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909444 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909447 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909449 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909452 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909455 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909458 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909461 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909463 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909467 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909471 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909473 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909476 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909479 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909482 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909486 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909489 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909492 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909495 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909498 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:00:15.914918 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909501 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909504 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909506 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909509 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909512 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909514 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909517 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909519 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909523 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909526 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909530 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909533 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909536 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909540 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909542 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909545 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909548 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909550 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909553 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:00:15.915397 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909555 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909558 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909561 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909563 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909566 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909569 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909571 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909574 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909577 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909579 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909582 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909584 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909587 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909589 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909592 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909595 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909597 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909600 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909602 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:00:15.915860 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909605 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909607 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909610 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909612 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909615 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909617 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909620 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909623 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909625 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909627 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909630 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909633 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909635 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909638 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909640 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909642 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909645 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909647 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909650 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909653 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:00:15.916421 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909655 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909658 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:15.909660 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.909665 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.909776 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.912250 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.914045 2559 server.go:1019] "Starting client certificate rotation" Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.914141 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:00:15.916911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.915012 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:00:15.918816 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.918801 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:00:15.924825 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.924798 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:00:15.937161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.937139 2559 log.go:25] "Validated CRI v1 runtime API" Jun 10 01:00:15.941953 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.941935 2559 log.go:25] "Validated CRI v1 image API" Jun 10 01:00:15.942782 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.942757 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 01:00:15.944963 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.944946 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:00:15.945963 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.945934 2559 fs.go:135] Filesystem UUIDs: map[06f9024b-91e4-4d13-8946-766ad229a412:/dev/nvme0n1p3 6fdae3d3-55b8-4829-80f9-ef3064421994:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 10 01:00:15.946018 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.945964 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 01:00:15.951794 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.951673 2559 manager.go:216] Machine: {Timestamp:2026-06-10 01:00:15.95030316 +0000 UTC m=+0.379184707 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099646 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea94a95d104e9297e1d44de109f58 SystemUUID:ec2ea94a-95d1-04e9-297e-1d44de109f58 BootID:00dcdc6c-c3e1-4f60-a755-cea6bb884337 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:ae:3d:32:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:ae:3d:32:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:2e:2b:87:85:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 01:00:15.951794 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.951785 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 01:00:15.951948 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.951928 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 01:00:15.955728 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.955694 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 01:00:15.955906 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.955731 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 01:00:15.956618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.956605 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 01:00:15.956673 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.956622 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 01:00:15.956673 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.956634 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:00:15.956673 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.956654 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:00:15.958010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.957996 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 01:00:15.962591 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962575 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:00:15.962752 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962740 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 01:00:15.962813 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962782 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 10 01:00:15.962813 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962804 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 01:00:15.962896 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962820 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 01:00:15.962896 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962836 2559 kubelet.go:398] "Adding apiserver pod source" Jun 10 01:00:15.962896 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.962850 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 01:00:15.963558 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.963540 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:00:15.963840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.963566 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:00:15.966256 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.966237 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 01:00:15.968063 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.968048 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 01:00:15.968115 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.968080 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 01:00:15.968227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.968210 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qxbsr" Jun 10 01:00:15.969467 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969456 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 01:00:15.969513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969472 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 01:00:15.969513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969478 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 01:00:15.969513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969485 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 01:00:15.969513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969494 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 01:00:15.969513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969507 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 01:00:15.969649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969516 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 01:00:15.969649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969521 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 01:00:15.969649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969528 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 01:00:15.969649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969534 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 01:00:15.969649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969546 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 01:00:15.969649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.969551 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 01:00:15.970728 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.970694 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 01:00:15.971446 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.971431 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 01:00:15.973251 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:15.973227 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 01:00:15.973251 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:15.973228 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 01:00:15.973401 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.973237 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 01:00:15.974023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.974004 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qxbsr" Jun 10 01:00:15.976007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.975992 2559 server.go:1268] "Started kubelet" Jun 10 01:00:15.976111 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.976082 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 01:00:15.976237 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.976184 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 01:00:15.976286 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.976260 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 01:00:15.977505 ip-10-0-139-200 systemd[1]: Started Kubernetes Kubelet. Jun 10 01:00:15.978233 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.978207 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 01:00:15.978724 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.978710 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 10 01:00:15.982112 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:15.980925 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-200.ec2.internal.18b79276a85077a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-200.ec2.internal,UID:ip-10-0-139-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-200.ec2.internal,},FirstTimestamp:2026-06-10 01:00:15.975962536 +0000 UTC m=+0.404844046,LastTimestamp:2026-06-10 01:00:15.975962536 +0000 UTC m=+0.404844046,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-200.ec2.internal,}" Jun 10 01:00:15.983403 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:15.983385 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 01:00:15.984724 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.984708 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 01:00:15.984724 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.984715 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 01:00:15.984844 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:15.984777 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:15.985491 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985456 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 01:00:15.985491 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985469 2559 factory.go:55] Registering systemd factory Jun 10 01:00:15.985491 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985489 2559 factory.go:223] Registration of the systemd container factory successfully Jun 10 01:00:15.985661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985458 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 01:00:15.985661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985536 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 01:00:15.985661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985623 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 10 01:00:15.985661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985628 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 10 01:00:15.985840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985697 2559 factory.go:153] Registering CRI-O factory Jun 10 01:00:15.985840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985712 2559 factory.go:223] Registration of the crio container factory successfully Jun 10 01:00:15.985840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985767 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 01:00:15.985840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985792 2559 factory.go:103] Registering Raw factory Jun 10 01:00:15.985840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.985812 2559 manager.go:1196] Started watching for new ooms in manager Jun 10 01:00:15.986187 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.986172 2559 manager.go:349] Starting recovery of all containers Jun 10 01:00:15.987011 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.986983 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:15.989700 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:15.989681 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-200.ec2.internal\" not found" node="ip-10-0-139-200.ec2.internal" Jun 10 01:00:15.993069 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.993043 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 01:00:15.997000 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:15.996979 2559 manager.go:354] Recovery completed Jun 10 01:00:16.003917 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.003902 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.005963 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.005945 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.006030 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.005978 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.006030 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.005989 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.006602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.006545 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 01:00:16.006602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.006559 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 01:00:16.006602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.006581 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:00:16.006602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.006594 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.007388 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.007370 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.007451 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.007399 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.007451 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.007414 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.008770 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.008757 2559 policy_none.go:49] "None policy: Start" Jun 10 01:00:16.008810 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.008774 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 01:00:16.008810 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.008786 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 01:00:16.010547 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.010536 2559 policy_none.go:47] "Start" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.053887 2559 manager.go:337] "Starting Device Plugin manager" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.053949 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.053961 2559 server.go:87] "Starting device plugin registration server" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.054196 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.054207 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.054321 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.054421 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.054430 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.055339 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.055386 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.059255 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.059307 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.059332 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.059395 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 01:00:16.069089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.061538 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:16.155170 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.155131 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.156499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.156481 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.156596 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.156513 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.156596 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.156529 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.156596 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.156557 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.159745 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.159726 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal"] Jun 10 01:00:16.159800 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.159795 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.161703 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.161688 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.161792 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.161714 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.161792 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.161723 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.164250 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.164235 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.164378 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.164360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.164428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.164399 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.164673 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.164658 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.164723 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.164684 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-200.ec2.internal\": node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.165032 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.165020 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.165092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.165033 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.165092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.165050 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.165092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.165057 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.165092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.165061 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.165092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.165069 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.167482 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.167466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.167580 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.167491 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:00:16.170282 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.170221 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:00:16.170282 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.170248 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:00:16.170282 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.170260 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:00:16.178467 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.178448 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.185906 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.185891 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-200.ec2.internal\" not found" node="ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.186655 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.186637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad8784005483a1b4cf9efdacc967b736-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal\" (UID: \"ad8784005483a1b4cf9efdacc967b736\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.186720 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.186665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad8784005483a1b4cf9efdacc967b736-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal\" (UID: \"ad8784005483a1b4cf9efdacc967b736\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.186720 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.186683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/feee623398e5bee5c16774f65308d931-config\") pod \"kube-apiserver-proxy-ip-10-0-139-200.ec2.internal\" (UID: \"feee623398e5bee5c16774f65308d931\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.191574 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.191555 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-200.ec2.internal\" not found" node="ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.279470 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.279437 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.287786 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.287761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad8784005483a1b4cf9efdacc967b736-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal\" (UID: \"ad8784005483a1b4cf9efdacc967b736\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.287883 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.287789 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad8784005483a1b4cf9efdacc967b736-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal\" (UID: \"ad8784005483a1b4cf9efdacc967b736\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.287883 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.287806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/feee623398e5bee5c16774f65308d931-config\") pod \"kube-apiserver-proxy-ip-10-0-139-200.ec2.internal\" (UID: \"feee623398e5bee5c16774f65308d931\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.287883 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.287845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/feee623398e5bee5c16774f65308d931-config\") pod \"kube-apiserver-proxy-ip-10-0-139-200.ec2.internal\" (UID: \"feee623398e5bee5c16774f65308d931\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.287883 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.287859 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad8784005483a1b4cf9efdacc967b736-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal\" (UID: \"ad8784005483a1b4cf9efdacc967b736\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.287883 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.287868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad8784005483a1b4cf9efdacc967b736-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal\" (UID: \"ad8784005483a1b4cf9efdacc967b736\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.380589 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.380486 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.481323 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.481263 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.492783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.492764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.498555 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.498536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.582240 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.582199 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.682781 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.682752 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-200.ec2.internal\" not found" Jun 10 01:00:16.778775 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.778746 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:16.785781 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.785757 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.807441 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.807413 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:00:16.809623 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.809600 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" Jun 10 01:00:16.830938 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.830916 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:00:16.913253 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.913220 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 01:00:16.913930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.913393 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:00:16.913930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.913429 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:00:16.913930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.913430 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:00:16.963619 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.963523 2559 apiserver.go:52] "Watching apiserver" Jun 10 01:00:16.979078 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.979046 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 01:00:16.980676 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.980179 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-9bnkg","openshift-ovn-kubernetes/ovnkube-node-2s9xf","kube-system/global-pull-secret-syncer-njr9p","kube-system/konnectivity-agent-rmnhn","kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26","openshift-cluster-node-tuning-operator/tuned-vxsfq","openshift-dns/node-resolver-v2z75","openshift-multus/multus-additional-cni-plugins-bc5rj","openshift-multus/network-metrics-daemon-fbxv2","openshift-image-registry/node-ca-sn29x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal","openshift-multus/multus-pxvpn","openshift-network-diagnostics/network-check-target-fxh9n"] Jun 10 01:00:16.980835 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.980758 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:55:15 +0000 UTC" deadline="2027-11-13 14:55:55.918067155 +0000 UTC" Jun 10 01:00:16.980835 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.980807 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12517h55m38.937264182s" Jun 10 01:00:16.982878 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.982854 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:16.984785 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.984756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.984933 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.984824 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 01:00:16.985061 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.985043 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zj5pf\"" Jun 10 01:00:16.985343 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.985325 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 01:00:16.985459 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.985353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:00:16.985459 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.985438 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 01:00:16.986840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.986715 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 01:00:16.986840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.986736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:16.986840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.986750 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 01:00:16.986840 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.986801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:16.987179 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.987162 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 01:00:16.987247 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.987200 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 01:00:16.987329 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.987287 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 01:00:16.987412 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.987374 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 01:00:16.987412 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.987378 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m8t57\"" Jun 10 01:00:16.988699 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.988685 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:16.990391 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.990370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j9p56\"" Jun 10 01:00:16.990508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.990483 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 01:00:16.990594 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.990521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 01:00:16.990760 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.990746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:16.992661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.992643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:16.992769 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.992716 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 01:00:16.992925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.992905 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 01:00:16.992925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.992915 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6ljkz\"" Jun 10 01:00:16.992925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.992919 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 01:00:16.993127 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-cni-netd\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-env-overrides\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lftcc\" (UniqueName: \"kubernetes.io/projected/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-kube-api-access-lftcc\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdb6eea5-2e68-4de9-89a6-01adba311202-dbus\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:16.993249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c38a4da-91c4-469f-95a5-9963c80ba888-host-slash\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:16.993249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-run-netns\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993401 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-log-socket\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993401 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovnkube-config\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993401 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993401 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-node-log\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993542 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-run-ovn-kubernetes\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993542 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993542 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-systemd-units\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993542 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovnkube-script-lib\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993542 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w55j8\" (UniqueName: \"kubernetes.io/projected/7c38a4da-91c4-469f-95a5-9963c80ba888-kube-api-access-w55j8\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-cni-bin\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c38a4da-91c4-469f-95a5-9963c80ba888-iptables-alerter-script\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovn-node-metrics-cert\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdb6eea5-2e68-4de9-89a6-01adba311202-kubelet-config\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-slash\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-kubelet\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-var-lib-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993719 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-etc-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.993732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-ovn\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.994055 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.993748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-systemd\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:16.994703 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.994687 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-llrmw\"" Jun 10 01:00:16.994945 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.994922 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:00:16.995038 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.994983 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:16.995038 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.995010 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 01:00:16.995508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.995491 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:00:16.996842 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.996822 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 01:00:16.996934 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.996825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swcbd\"" Jun 10 01:00:16.996934 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.996854 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 01:00:16.997146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.997132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:16.999171 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999134 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwmtr\"" Jun 10 01:00:16.999616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999233 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 01:00:16.999616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:16.999616 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:16.999390 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:16.999616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999449 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 01:00:16.999616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999584 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 01:00:16.999816 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999632 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 01:00:16.999816 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:16.999700 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 01:00:17.018269 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.018230 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.018476 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.018447 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9z59" Jun 10 01:00:17.019602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.019583 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:17.020392 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.020371 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 01:00:17.020480 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.020437 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7fk2t\"" Jun 10 01:00:17.020617 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.020599 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 01:00:17.020751 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.020723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.020847 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.020786 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 01:00:17.021971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.021954 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9z59" Jun 10 01:00:17.023492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.023462 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 01:00:17.023585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.023467 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d72mg\"" Jun 10 01:00:17.023944 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.023912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:17.024078 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.024048 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:17.086830 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.086808 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 01:00:17.094898 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-multus-certs\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-slash\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-device-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-kubelet\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-slash\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.094999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229q4\" (UniqueName: \"kubernetes.io/projected/09292145-9b2f-40cc-ac41-93cec49ff39e-kube-api-access-229q4\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095069 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-kubelet\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095113 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-var-lib-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-ovn\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.095151 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095158 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-systemd\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-kubelet\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095180 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-var-lib-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-ovn\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc23ed0d-0562-4242-9c6b-03d91ce24129-tmp\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-systemd\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.095225 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:17.595206779 +0000 UTC m=+2.024088294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-socket-dir-parent\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c38a4da-91c4-469f-95a5-9963c80ba888-host-slash\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-run-netns\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c38a4da-91c4-469f-95a5-9963c80ba888-host-slash\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095351 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-log-socket\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-run-netns\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.095548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-lib-modules\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-log-socket\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-tuned\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmnnm\" (UniqueName: \"kubernetes.io/projected/bc23ed0d-0562-4242-9c6b-03d91ce24129-kube-api-access-rmnnm\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-cni-multus\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-run-ovn-kubernetes\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glkxf\" (UniqueName: \"kubernetes.io/projected/da58b347-1782-4582-a001-cf6a105aaad2-kube-api-access-glkxf\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-run-ovn-kubernetes\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-run-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-cni-bin\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-systemd-units\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovnkube-script-lib\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.096324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-registration-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5fz\" (UniqueName: \"kubernetes.io/projected/b3996a74-02dd-4947-8ef6-646e21f2c607-kube-api-access-pk5fz\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-systemd-units\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-kubernetes\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysctl-conf\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-conf-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-sys-fs\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-modprobe-d\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.095990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgk5\" (UniqueName: \"kubernetes.io/projected/3a374507-c6cd-4a5a-a096-b249f92c46d6-kube-api-access-llgk5\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-system-cni-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-etc-kubernetes\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovn-node-metrics-cert\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysctl-d\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-host\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-k8s-cni-cncf-io\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.097189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-socket-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096257 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-etc-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovnkube-script-lib\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysconfig\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096396 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-etc-openvswitch\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-host\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-cni-netd\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-env-overrides\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lftcc\" (UniqueName: \"kubernetes.io/projected/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-kube-api-access-lftcc\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-cni-netd\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096539 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdb6eea5-2e68-4de9-89a6-01adba311202-dbus\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-cni-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-hostroot\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096649 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdb6eea5-2e68-4de9-89a6-01adba311202-dbus\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovnkube-config\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.097884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-var-lib-kubelet\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096762 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-serviceca\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-env-overrides\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9m2\" (UniqueName: \"kubernetes.io/projected/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-kube-api-access-kr9m2\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-cnibin\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.096956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-node-log\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-os-release\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09292145-9b2f-40cc-ac41-93cec49ff39e-cni-binary-copy\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-run\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-node-log\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cnibin\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxxmh\" (UniqueName: \"kubernetes.io/projected/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-kube-api-access-qxxmh\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-netns\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-daemon-config\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.098481 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097195 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w55j8\" (UniqueName: \"kubernetes.io/projected/7c38a4da-91c4-469f-95a5-9963c80ba888-kube-api-access-w55j8\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-cni-bin\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6f5436e-e089-4a70-9f14-42d9d210e0ff-konnectivity-ca\") pod \"konnectivity-agent-rmnhn\" (UID: \"c6f5436e-e089-4a70-9f14-42d9d210e0ff\") " pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097310 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da58b347-1782-4582-a001-cf6a105aaad2-hosts-file\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-host-cni-bin\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-os-release\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-sys\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c38a4da-91c4-469f-95a5-9963c80ba888-iptables-alerter-script\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdb6eea5-2e68-4de9-89a6-01adba311202-kubelet-config\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6f5436e-e089-4a70-9f14-42d9d210e0ff-agent-certs\") pod \"konnectivity-agent-rmnhn\" (UID: \"c6f5436e-e089-4a70-9f14-42d9d210e0ff\") " pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da58b347-1782-4582-a001-cf6a105aaad2-tmp-dir\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdb6eea5-2e68-4de9-89a6-01adba311202-kubelet-config\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-system-cni-dir\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-systemd\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.097952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovnkube-config\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.098974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.098010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c38a4da-91c4-469f-95a5-9963c80ba888-iptables-alerter-script\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.099543 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.099528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-ovn-node-metrics-cert\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.105509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.105490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lftcc\" (UniqueName: \"kubernetes.io/projected/a31f0f5f-a912-4acb-9760-21e9e1a9ef66-kube-api-access-lftcc\") pod \"ovnkube-node-2s9xf\" (UID: \"a31f0f5f-a912-4acb-9760-21e9e1a9ef66\") " pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.105621 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.105515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w55j8\" (UniqueName: \"kubernetes.io/projected/7c38a4da-91c4-469f-95a5-9963c80ba888-kube-api-access-w55j8\") pod \"iptables-alerter-9bnkg\" (UID: \"7c38a4da-91c4-469f-95a5-9963c80ba888\") " pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.198042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.197863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-system-cni-dir\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.198042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-systemd\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-multus-certs\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.197964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-system-cni-dir\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-device-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-kubelet\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-systemd\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229q4\" (UniqueName: \"kubernetes.io/projected/09292145-9b2f-40cc-ac41-93cec49ff39e-kube-api-access-229q4\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-multus-certs\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-device-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-kubelet\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc23ed0d-0562-4242-9c6b-03d91ce24129-tmp\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-socket-dir-parent\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-lib-modules\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-tuned\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmnnm\" (UniqueName: \"kubernetes.io/projected/bc23ed0d-0562-4242-9c6b-03d91ce24129-kube-api-access-rmnnm\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-lib-modules\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198453 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-socket-dir-parent\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-cni-multus\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glkxf\" (UniqueName: \"kubernetes.io/projected/da58b347-1782-4582-a001-cf6a105aaad2-kube-api-access-glkxf\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-cni-multus\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-cni-bin\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198635 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-var-lib-cni-bin\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-registration-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5fz\" (UniqueName: \"kubernetes.io/projected/b3996a74-02dd-4947-8ef6-646e21f2c607-kube-api-access-pk5fz\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-kubernetes\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysctl-conf\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.198907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-conf-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-sys-fs\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-modprobe-d\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198876 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgk5\" (UniqueName: \"kubernetes.io/projected/3a374507-c6cd-4a5a-a096-b249f92c46d6-kube-api-access-llgk5\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-system-cni-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysctl-conf\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-etc-kubernetes\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-etc-kubernetes\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.198991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-kubernetes\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysctl-d\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-registration-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-host\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-k8s-cni-cncf-io\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-conf-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199079 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-system-cni-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.199741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199102 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-host\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-sys-fs\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-k8s-cni-cncf-io\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-socket-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-socket-dir\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-modprobe-d\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysctl-d\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysconfig\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-host\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-cni-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-hostroot\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-sysconfig\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-host\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-var-lib-kubelet\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-hostroot\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-cni-dir\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.200531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-var-lib-kubelet\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-serviceca\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3996a74-02dd-4947-8ef6-646e21f2c607-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199448 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9m2\" (UniqueName: \"kubernetes.io/projected/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-kube-api-access-kr9m2\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-cnibin\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.199497 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-os-release\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.199550 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:17.699532198 +0000 UTC m=+2.128413709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09292145-9b2f-40cc-ac41-93cec49ff39e-cni-binary-copy\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-run\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cnibin\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-os-release\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-cnibin\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxxmh\" (UniqueName: \"kubernetes.io/projected/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-kube-api-access-qxxmh\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.201180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-netns\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-daemon-config\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-serviceca\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-cnibin\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09292145-9b2f-40cc-ac41-93cec49ff39e-host-run-netns\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6f5436e-e089-4a70-9f14-42d9d210e0ff-konnectivity-ca\") pod \"konnectivity-agent-rmnhn\" (UID: \"c6f5436e-e089-4a70-9f14-42d9d210e0ff\") " pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da58b347-1782-4582-a001-cf6a105aaad2-hosts-file\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-run\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-os-release\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-sys\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6f5436e-e089-4a70-9f14-42d9d210e0ff-agent-certs\") pod \"konnectivity-agent-rmnhn\" (UID: \"c6f5436e-e089-4a70-9f14-42d9d210e0ff\") " pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.199919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da58b347-1782-4582-a001-cf6a105aaad2-tmp-dir\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200104 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-os-release\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da58b347-1782-4582-a001-cf6a105aaad2-hosts-file\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09292145-9b2f-40cc-ac41-93cec49ff39e-cni-binary-copy\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da58b347-1782-4582-a001-cf6a105aaad2-tmp-dir\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc23ed0d-0562-4242-9c6b-03d91ce24129-sys\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.202023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6f5436e-e089-4a70-9f14-42d9d210e0ff-konnectivity-ca\") pod \"konnectivity-agent-rmnhn\" (UID: \"c6f5436e-e089-4a70-9f14-42d9d210e0ff\") " pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.202950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.200479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09292145-9b2f-40cc-ac41-93cec49ff39e-multus-daemon-config\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.202950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.201317 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc23ed0d-0562-4242-9c6b-03d91ce24129-tmp\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.202950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.201504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc23ed0d-0562-4242-9c6b-03d91ce24129-etc-tuned\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.202950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.202461 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6f5436e-e089-4a70-9f14-42d9d210e0ff-agent-certs\") pod \"konnectivity-agent-rmnhn\" (UID: \"c6f5436e-e089-4a70-9f14-42d9d210e0ff\") " pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.207805 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.207773 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:17.207805 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.207803 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:17.208011 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.207818 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:17.208011 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.207890 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:17.707870407 +0000 UTC m=+2.136751964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:17.209970 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.209938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmnnm\" (UniqueName: \"kubernetes.io/projected/bc23ed0d-0562-4242-9c6b-03d91ce24129-kube-api-access-rmnnm\") pod \"tuned-vxsfq\" (UID: \"bc23ed0d-0562-4242-9c6b-03d91ce24129\") " pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.210277 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.210260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-229q4\" (UniqueName: \"kubernetes.io/projected/09292145-9b2f-40cc-ac41-93cec49ff39e-kube-api-access-229q4\") pod \"multus-pxvpn\" (UID: \"09292145-9b2f-40cc-ac41-93cec49ff39e\") " pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.210358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.210342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5fz\" (UniqueName: \"kubernetes.io/projected/b3996a74-02dd-4947-8ef6-646e21f2c607-kube-api-access-pk5fz\") pod \"aws-ebs-csi-driver-node-zkg26\" (UID: \"b3996a74-02dd-4947-8ef6-646e21f2c607\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.210400 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.210346 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgk5\" (UniqueName: \"kubernetes.io/projected/3a374507-c6cd-4a5a-a096-b249f92c46d6-kube-api-access-llgk5\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:17.210644 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.210623 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glkxf\" (UniqueName: \"kubernetes.io/projected/da58b347-1782-4582-a001-cf6a105aaad2-kube-api-access-glkxf\") pod \"node-resolver-v2z75\" (UID: \"da58b347-1782-4582-a001-cf6a105aaad2\") " pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.210846 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.210827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxxmh\" (UniqueName: \"kubernetes.io/projected/2f65f3f4-b582-4015-9edb-0b55dfe5ae8b-kube-api-access-qxxmh\") pod \"multus-additional-cni-plugins-bc5rj\" (UID: \"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b\") " pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.211410 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.211394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9m2\" (UniqueName: \"kubernetes.io/projected/81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00-kube-api-access-kr9m2\") pod \"node-ca-sn29x\" (UID: \"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00\") " pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.239556 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.239523 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeee623398e5bee5c16774f65308d931.slice/crio-bd7f207c214049dd0f44e22c4e262417cb14e401767725fc36ef77025f61d5b8 WatchSource:0}: Error finding container bd7f207c214049dd0f44e22c4e262417cb14e401767725fc36ef77025f61d5b8: Status 404 returned error can't find the container with id bd7f207c214049dd0f44e22c4e262417cb14e401767725fc36ef77025f61d5b8 Jun 10 01:00:17.240065 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.240044 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8784005483a1b4cf9efdacc967b736.slice/crio-1a4e817a5f6c68df691f94dc81ce6e35aeaefab2b3507d60dc3fc168c72b8f56 WatchSource:0}: Error finding container 1a4e817a5f6c68df691f94dc81ce6e35aeaefab2b3507d60dc3fc168c72b8f56: Status 404 returned error can't find the container with id 1a4e817a5f6c68df691f94dc81ce6e35aeaefab2b3507d60dc3fc168c72b8f56 Jun 10 01:00:17.246340 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.246324 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:00:17.328641 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.328586 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bnkg" Jun 10 01:00:17.338449 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.338410 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c38a4da_91c4_469f_95a5_9963c80ba888.slice/crio-c4882f968d1a9558003b211e754ee66caa0b104808bb1255eff72dcff1678a48 WatchSource:0}: Error finding container c4882f968d1a9558003b211e754ee66caa0b104808bb1255eff72dcff1678a48: Status 404 returned error can't find the container with id c4882f968d1a9558003b211e754ee66caa0b104808bb1255eff72dcff1678a48 Jun 10 01:00:17.345471 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.345452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v2z75" Jun 10 01:00:17.351059 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.351040 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:17.354056 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.354033 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda58b347_1782_4582_a001_cf6a105aaad2.slice/crio-7a330c1b81196c6a2917aebd062ca69ea1415eae0fd4eaf64d7f83f2fff5b0c8 WatchSource:0}: Error finding container 7a330c1b81196c6a2917aebd062ca69ea1415eae0fd4eaf64d7f83f2fff5b0c8: Status 404 returned error can't find the container with id 7a330c1b81196c6a2917aebd062ca69ea1415eae0fd4eaf64d7f83f2fff5b0c8 Jun 10 01:00:17.359690 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.359668 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31f0f5f_a912_4acb_9760_21e9e1a9ef66.slice/crio-7750db27e34093529bc602c4de62afc5ad4df1dd7528ee1cf619428e7843c36d WatchSource:0}: Error finding container 7750db27e34093529bc602c4de62afc5ad4df1dd7528ee1cf619428e7843c36d: Status 404 returned error can't find the container with id 7750db27e34093529bc602c4de62afc5ad4df1dd7528ee1cf619428e7843c36d Jun 10 01:00:17.367093 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.367072 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:17.374432 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.374413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" Jun 10 01:00:17.377146 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.377119 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f5436e_e089_4a70_9f14_42d9d210e0ff.slice/crio-ec96c5f42e851d72525ce6008be88a5ab5e1f4c7fa8ecc436bf204e319165f3b WatchSource:0}: Error finding container ec96c5f42e851d72525ce6008be88a5ab5e1f4c7fa8ecc436bf204e319165f3b: Status 404 returned error can't find the container with id ec96c5f42e851d72525ce6008be88a5ab5e1f4c7fa8ecc436bf204e319165f3b Jun 10 01:00:17.382489 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.382467 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3996a74_02dd_4947_8ef6_646e21f2c607.slice/crio-bbe351cdf306f5ba4e2897e443547dda029ced62b074373382780fd8b235896a WatchSource:0}: Error finding container bbe351cdf306f5ba4e2897e443547dda029ced62b074373382780fd8b235896a: Status 404 returned error can't find the container with id bbe351cdf306f5ba4e2897e443547dda029ced62b074373382780fd8b235896a Jun 10 01:00:17.389894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.389877 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" Jun 10 01:00:17.399375 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.399352 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc23ed0d_0562_4242_9c6b_03d91ce24129.slice/crio-db65d4350d3eac5af9765deb111983becfc087f93c48bee50f7033a1d0222ec3 WatchSource:0}: Error finding container db65d4350d3eac5af9765deb111983becfc087f93c48bee50f7033a1d0222ec3: Status 404 returned error can't find the container with id db65d4350d3eac5af9765deb111983becfc087f93c48bee50f7033a1d0222ec3 Jun 10 01:00:17.425694 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.425664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" Jun 10 01:00:17.430520 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.430495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sn29x" Jun 10 01:00:17.432726 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.432708 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxvpn" Jun 10 01:00:17.435321 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.435175 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f65f3f4_b582_4015_9edb_0b55dfe5ae8b.slice/crio-70d6b81684a7d315df62dbe61e373c13a0567a432ca6ea147924a6fa8bd74264 WatchSource:0}: Error finding container 70d6b81684a7d315df62dbe61e373c13a0567a432ca6ea147924a6fa8bd74264: Status 404 returned error can't find the container with id 70d6b81684a7d315df62dbe61e373c13a0567a432ca6ea147924a6fa8bd74264 Jun 10 01:00:17.440773 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.440752 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e36ec1_3c1e_4d37_bfe5_6552fa4cbb00.slice/crio-ecfda5ff29f3de9d4fe5592f2ecd01de617c40e8d6d803b05350ff978b9f2558 WatchSource:0}: Error finding container ecfda5ff29f3de9d4fe5592f2ecd01de617c40e8d6d803b05350ff978b9f2558: Status 404 returned error can't find the container with id ecfda5ff29f3de9d4fe5592f2ecd01de617c40e8d6d803b05350ff978b9f2558 Jun 10 01:00:17.441631 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:17.441585 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09292145_9b2f_40cc_ac41_93cec49ff39e.slice/crio-71f8c1ed48263e869af9c89786850ec952549bc9d88c7c87dcd81a8d7e840e20 WatchSource:0}: Error finding container 71f8c1ed48263e869af9c89786850ec952549bc9d88c7c87dcd81a8d7e840e20: Status 404 returned error can't find the container with id 71f8c1ed48263e869af9c89786850ec952549bc9d88c7c87dcd81a8d7e840e20 Jun 10 01:00:17.443414 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.443394 2559 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-pxvpn_openshift-multus(09292145-9b2f-40cc-ac41-93cec49ff39e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jun 10 01:00:17.443458 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.443435 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-pxvpn" podUID="09292145-9b2f-40cc-ac41-93cec49ff39e" Jun 10 01:00:17.602129 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.602044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:17.602283 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.602199 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:17.602376 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.602282 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:18.602252628 +0000 UTC m=+3.031134126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:17.703205 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.703177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:17.703362 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.703334 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:17.703424 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.703398 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:18.703378699 +0000 UTC m=+3.132260211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:17.803902 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.803864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:17.804099 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.804072 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:17.804099 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.804097 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:17.804230 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.804110 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:17.804230 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:17.804176 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:18.804156849 +0000 UTC m=+3.233038367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:17.952990 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:17.952951 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:18.026014 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.025922 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:55:17 +0000 UTC" deadline="2027-11-10 07:59:41.022353937 +0000 UTC" Jun 10 01:00:18.026014 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.025960 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12438h59m22.996398734s" Jun 10 01:00:18.062124 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.061414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:18.062124 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.061572 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:18.070834 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.070729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rmnhn" event={"ID":"c6f5436e-e089-4a70-9f14-42d9d210e0ff","Type":"ContainerStarted","Data":"ec96c5f42e851d72525ce6008be88a5ab5e1f4c7fa8ecc436bf204e319165f3b"} Jun 10 01:00:18.081262 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.081154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"7750db27e34093529bc602c4de62afc5ad4df1dd7528ee1cf619428e7843c36d"} Jun 10 01:00:18.100117 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.099410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxvpn" event={"ID":"09292145-9b2f-40cc-ac41-93cec49ff39e","Type":"ContainerStarted","Data":"71f8c1ed48263e869af9c89786850ec952549bc9d88c7c87dcd81a8d7e840e20"} Jun 10 01:00:18.101103 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.101071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:487315318c4a8b71174c93bb99307951b4069646ac623cd60bd70f14ea8ff41e\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-pxvpn" podUID="09292145-9b2f-40cc-ac41-93cec49ff39e" Jun 10 01:00:18.115217 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.115100 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerStarted","Data":"70d6b81684a7d315df62dbe61e373c13a0567a432ca6ea147924a6fa8bd74264"} Jun 10 01:00:18.121698 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.121622 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v2z75" event={"ID":"da58b347-1782-4582-a001-cf6a105aaad2","Type":"ContainerStarted","Data":"7a330c1b81196c6a2917aebd062ca69ea1415eae0fd4eaf64d7f83f2fff5b0c8"} Jun 10 01:00:18.138623 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.138491 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bnkg" event={"ID":"7c38a4da-91c4-469f-95a5-9963c80ba888","Type":"ContainerStarted","Data":"c4882f968d1a9558003b211e754ee66caa0b104808bb1255eff72dcff1678a48"} Jun 10 01:00:18.151255 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.151182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" event={"ID":"ad8784005483a1b4cf9efdacc967b736","Type":"ContainerStarted","Data":"1a4e817a5f6c68df691f94dc81ce6e35aeaefab2b3507d60dc3fc168c72b8f56"} Jun 10 01:00:18.158796 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.158758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" event={"ID":"feee623398e5bee5c16774f65308d931","Type":"ContainerStarted","Data":"bd7f207c214049dd0f44e22c4e262417cb14e401767725fc36ef77025f61d5b8"} Jun 10 01:00:18.175748 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.175708 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sn29x" event={"ID":"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00","Type":"ContainerStarted","Data":"ecfda5ff29f3de9d4fe5592f2ecd01de617c40e8d6d803b05350ff978b9f2558"} Jun 10 01:00:18.199188 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.199144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" event={"ID":"bc23ed0d-0562-4242-9c6b-03d91ce24129","Type":"ContainerStarted","Data":"db65d4350d3eac5af9765deb111983becfc087f93c48bee50f7033a1d0222ec3"} Jun 10 01:00:18.202002 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.201951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" event={"ID":"b3996a74-02dd-4947-8ef6-646e21f2c607","Type":"ContainerStarted","Data":"bbe351cdf306f5ba4e2897e443547dda029ced62b074373382780fd8b235896a"} Jun 10 01:00:18.349287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.349179 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:18.610178 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.610090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:18.610364 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.610246 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:18.610364 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.610327 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:20.610306969 +0000 UTC m=+5.039188485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:18.710971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.710934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:18.711170 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.711110 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:18.711236 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.711176 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:20.71115596 +0000 UTC m=+5.140037465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:18.720977 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.720946 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:00:18.811886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:18.811844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:18.812070 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.812018 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:18.812070 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.812035 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:18.812070 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.812048 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:18.812312 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:18.812108 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:20.812088464 +0000 UTC m=+5.240969961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:19.026958 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:19.026889 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:55:17 +0000 UTC" deadline="2027-11-12 20:54:26.007538538 +0000 UTC" Jun 10 01:00:19.026958 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:19.026956 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12499h54m6.980586803s" Jun 10 01:00:19.060500 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:19.060468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:19.060686 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:19.060614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:19.060686 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:19.060611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:19.060796 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:19.060703 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:20.062320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:20.062276 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:20.062786 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.062420 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:20.627587 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:20.627545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:20.627777 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.627732 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:20.627854 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.627829 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:24.627805763 +0000 UTC m=+9.056687281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:20.728627 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:20.728585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:20.728809 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.728773 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:20.728873 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.728858 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:24.728835932 +0000 UTC m=+9.157717445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:20.829928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:20.829776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:20.830106 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.829976 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:20.830106 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.830004 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:20.830106 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.830019 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:20.830106 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:20.830093 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:24.830069627 +0000 UTC m=+9.258951125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:21.059584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:21.059547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:21.059768 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:21.059686 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:21.060044 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:21.060015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:21.060181 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:21.060158 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:22.059633 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:22.059599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:22.060029 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:22.059727 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:23.060310 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:23.060255 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:23.060310 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:23.060280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:23.060851 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:23.060422 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:23.060851 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:23.060531 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:24.063563 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:24.063531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:24.064030 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.063655 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:24.655852 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:24.655816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:24.656042 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.655981 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:24.656099 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.656047 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:32.656031951 +0000 UTC m=+17.084913451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:24.756587 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:24.756542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:24.756782 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.756741 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:24.756844 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.756824 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:32.756802621 +0000 UTC m=+17.185684122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:24.857975 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:24.857930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:24.858160 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.858108 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:24.858160 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.858130 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:24.858160 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.858144 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:24.858345 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:24.858202 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:32.858186063 +0000 UTC m=+17.287067580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:25.059783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:25.059742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:25.059783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:25.059752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:25.060041 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:25.059930 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:25.060244 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:25.060207 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:26.063275 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:26.063241 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:26.063739 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:26.063398 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:27.059826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:27.059785 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:27.060004 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:27.059784 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:27.060004 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:27.059931 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:27.060004 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:27.059975 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:28.064277 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.064029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:28.064880 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:28.064383 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:28.226311 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.226261 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f65f3f4-b582-4015-9edb-0b55dfe5ae8b" containerID="c0a1ea5b8eda7c6d9630003ba0482b128b2f57a23e6d1a1b127324a59bf99889" exitCode=0 Jun 10 01:00:28.226464 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.226334 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerDied","Data":"c0a1ea5b8eda7c6d9630003ba0482b128b2f57a23e6d1a1b127324a59bf99889"} Jun 10 01:00:28.227870 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.227842 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v2z75" event={"ID":"da58b347-1782-4582-a001-cf6a105aaad2","Type":"ContainerStarted","Data":"830bab702c07cd3b5c36c090165a06bc5f3207fb70600a5b5df78bfacebf23cf"} Jun 10 01:00:28.229522 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.229501 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad8784005483a1b4cf9efdacc967b736" containerID="323ce63cf71257c806826239c092cd2db8efa462514eb6234462ddf8372ff4f6" exitCode=0 Jun 10 01:00:28.229643 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.229572 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" event={"ID":"ad8784005483a1b4cf9efdacc967b736","Type":"ContainerDied","Data":"323ce63cf71257c806826239c092cd2db8efa462514eb6234462ddf8372ff4f6"} Jun 10 01:00:28.231358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.231338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" event={"ID":"feee623398e5bee5c16774f65308d931","Type":"ContainerStarted","Data":"83fb70b5febc45171e6f8e277069e83f30890a65d8a3930b0c52faf6a22de634"} Jun 10 01:00:28.233330 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.233308 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sn29x" event={"ID":"81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00","Type":"ContainerStarted","Data":"82e6c9245d01098cb0abb7141b2fa7c00fbde7a7071a9929629c608a9a81b35c"} Jun 10 01:00:28.234939 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.234918 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" event={"ID":"bc23ed0d-0562-4242-9c6b-03d91ce24129","Type":"ContainerStarted","Data":"eaf35e9d6fd652455baa2cf0ac99d85bae790fdda10155eac5114f6bfc644501"} Jun 10 01:00:28.236444 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.236424 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" event={"ID":"b3996a74-02dd-4947-8ef6-646e21f2c607","Type":"ContainerStarted","Data":"3e4d8a926f9cd2aec2d384924db702dc5ae86ff449b5d1ac7ed46ef4810a804b"} Jun 10 01:00:28.237933 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.237915 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rmnhn" event={"ID":"c6f5436e-e089-4a70-9f14-42d9d210e0ff","Type":"ContainerStarted","Data":"628b347f20aef44e3f6ab5abe180f8eb091e40994212fdc62b6b1112c1fbf5f7"} Jun 10 01:00:28.261539 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.261481 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vxsfq" podStartSLOduration=2.127377965 podStartE2EDuration="12.261465183s" totalImagesPullingTime="10.134087218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:28.26112294 +0000 UTC m=+12.690004472" watchObservedRunningTime="2026-06-10 01:00:28.261465183 +0000 UTC m=+12.690346729" Jun 10 01:00:28.273745 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.273699 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-200.ec2.internal" podStartSLOduration=12.273683405 podStartE2EDuration="12.273683405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:28.273431619 +0000 UTC m=+12.702313138" watchObservedRunningTime="2026-06-10 01:00:28.273683405 +0000 UTC m=+12.702564922" Jun 10 01:00:28.286911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.286867 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v2z75" podStartSLOduration=2.125373825 podStartE2EDuration="12.2868523s" totalImagesPullingTime="10.161478475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:28.286459887 +0000 UTC m=+12.715341404" watchObservedRunningTime="2026-06-10 01:00:28.2868523 +0000 UTC m=+12.715733817" Jun 10 01:00:28.299655 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.299600 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sn29x" podStartSLOduration=2.222923416 podStartE2EDuration="12.299579896s" totalImagesPullingTime="10.07665648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:28.299003129 +0000 UTC m=+12.727884648" watchObservedRunningTime="2026-06-10 01:00:28.299579896 +0000 UTC m=+12.728461416" Jun 10 01:00:28.690483 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.690447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:28.691396 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.691369 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:28.707273 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:28.707215 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rmnhn" podStartSLOduration=2.571531328 podStartE2EDuration="12.707194041s" totalImagesPullingTime="10.135662713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:28.340911527 +0000 UTC m=+12.769793054" watchObservedRunningTime="2026-06-10 01:00:28.707194041 +0000 UTC m=+13.136075561" Jun 10 01:00:29.059837 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:29.059805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:29.060018 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:29.059930 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:29.060088 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:29.060015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:29.060204 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:29.060160 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:29.241622 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:29.241585 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bnkg" event={"ID":"7c38a4da-91c4-469f-95a5-9963c80ba888","Type":"ContainerStarted","Data":"13c12f522a7bcf19a61b3bea7c463ea78e6590337131f0fb77136218d5333947"} Jun 10 01:00:29.243501 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:29.243473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" event={"ID":"ad8784005483a1b4cf9efdacc967b736","Type":"ContainerStarted","Data":"224e36493f3264cf6b9705edcbd794a802e77ce4d2d426687d3c7e8997aef6b5"} Jun 10 01:00:29.255391 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:29.255338 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9bnkg" podStartSLOduration=3.079430808 podStartE2EDuration="13.255318957s" totalImagesPullingTime="10.175888149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:29.254978622 +0000 UTC m=+13.683860140" watchObservedRunningTime="2026-06-10 01:00:29.255318957 +0000 UTC m=+13.684200476" Jun 10 01:00:29.267448 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:29.267403 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-200.ec2.internal" podStartSLOduration=13.267385049 podStartE2EDuration="13.267385049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:29.266944489 +0000 UTC m=+13.695826036" watchObservedRunningTime="2026-06-10 01:00:29.267385049 +0000 UTC m=+13.696266567" Jun 10 01:00:30.059900 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:30.059867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:30.060089 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:30.060000 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:30.245571 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:30.245543 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 01:00:31.060038 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:31.060007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:31.060229 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:31.060041 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:31.060229 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:31.060162 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:31.060353 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:31.060262 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:32.060867 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:32.060633 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:32.061332 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.060952 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:32.717614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:32.717576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:32.717860 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.717721 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:32.717860 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.717793 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:48.717776828 +0000 UTC m=+33.146658325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:32.818501 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:32.818464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:32.818697 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.818627 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:32.818697 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.818696 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:48.818679593 +0000 UTC m=+33.247561090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:32.919112 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:32.919071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:32.919336 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.919272 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:32.919336 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.919313 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:32.919336 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.919327 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:32.919500 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:32.919384 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:00:48.919365548 +0000 UTC m=+33.348247068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:33.060356 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:33.060320 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:33.060556 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:33.060472 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:33.060556 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:33.060496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:33.060675 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:33.060614 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:33.173178 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:33.173141 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 01:00:33.255474 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:33.255286 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" event={"ID":"b3996a74-02dd-4947-8ef6-646e21f2c607","Type":"ContainerStarted","Data":"4d33859170c5bab8b5ced2f584e20a447a6ac3134b9f3184d2b08fb3506244c5"} Jun 10 01:00:33.258570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:33.258542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"d3b31eb166b5874dc83b00a4613f137e0f1a2ff4b7804c5b08d269b48b24ba91"} Jun 10 01:00:33.258683 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:33.258630 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"c4a5dbcf9edc80c493ef4e2cdfcc7731a6e50d1a3e2806f50d731df30e89c60c"} Jun 10 01:00:34.059962 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.059923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:34.060157 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:34.060071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:34.064539 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.064435 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T01:00:33.173162007Z","UUID":"a4e2b67b-3cbf-46af-8d89-cf2a5e0ce5f2","Handler":null,"Name":"","Endpoint":""} Jun 10 01:00:34.066430 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.066004 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 01:00:34.066430 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.066057 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 01:00:34.264130 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.264082 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" event={"ID":"b3996a74-02dd-4947-8ef6-646e21f2c607","Type":"ContainerStarted","Data":"04cb85ecef6d58ac05ccaaf629c299835aedcb8b63da014cbc92987c3d8dd74d"} Jun 10 01:00:34.268380 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.268348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"c17a17db3e02e398322ed1bc71ee251267b82170004bb1f1087de3f872fe3a09"} Jun 10 01:00:34.268511 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.268440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"fbe771dc39c8838a5c3d086cd80bcca1758601b9520cf86c6c53cf97dd5eafff"} Jun 10 01:00:34.268511 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.268487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"6c1475b26375cba65c5f74d56b11192e089acc37e842c7ad5d9b04a4b71505bb"} Jun 10 01:00:34.268634 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.268516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"9f7c091722da488b54b4c6535e7a8705955cfe2a61242648e27504fb559e4b2d"} Jun 10 01:00:34.284249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:34.284181 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkg26" podStartSLOduration=2.099494705 podStartE2EDuration="18.284159574s" totalImagesPullingTime="16.184664869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:34.284073179 +0000 UTC m=+18.712954700" watchObservedRunningTime="2026-06-10 01:00:34.284159574 +0000 UTC m=+18.713041094" Jun 10 01:00:35.060329 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:35.060278 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:35.060581 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:35.060339 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:35.060581 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:35.060436 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:35.060581 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:35.060562 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:36.060540 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:36.060508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:36.061001 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:36.060634 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:37.059851 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:37.059752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:37.059851 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:37.059792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:37.060072 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:37.059914 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:37.060072 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:37.060055 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:37.279501 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:37.279414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"b410d1c642ad3bfc4fb4deefb7394a21f87960b91ae7a8f876c8c331769f2dd5"} Jun 10 01:00:37.281471 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:37.281440 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f65f3f4-b582-4015-9edb-0b55dfe5ae8b" containerID="67847cb779854f30d2ff4ad1c8c5c05e79f0b68bf35c8b3621c3d8f5b00daf41" exitCode=0 Jun 10 01:00:37.281605 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:37.281499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerDied","Data":"67847cb779854f30d2ff4ad1c8c5c05e79f0b68bf35c8b3621c3d8f5b00daf41"} Jun 10 01:00:38.013016 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:38.012762 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:38.060027 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:38.059992 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:38.060219 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:38.060132 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:38.094700 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:38.094651 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:38.286410 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:38.286327 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f65f3f4-b582-4015-9edb-0b55dfe5ae8b" containerID="daf71674d2fabe718049dcc6f1a052079a3ec2ea3fb8b1da40fa51074456cf33" exitCode=0 Jun 10 01:00:38.286410 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:38.286378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerDied","Data":"daf71674d2fabe718049dcc6f1a052079a3ec2ea3fb8b1da40fa51074456cf33"} Jun 10 01:00:39.059902 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:39.059873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:39.059902 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:39.059912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:39.060130 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:39.060010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:39.060191 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:39.060154 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:40.060338 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:40.060051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:40.060870 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:40.060490 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:41.060524 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:41.060462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:41.060524 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:41.060509 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:41.061068 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:41.060593 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:41.061068 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:41.060741 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:42.063707 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:42.063677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:42.064110 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:42.063787 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:43.059798 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.059774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:43.059941 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:43.059898 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:43.060007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.059939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:43.060058 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:43.060033 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:43.304041 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.303892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" event={"ID":"a31f0f5f-a912-4acb-9760-21e9e1a9ef66","Type":"ContainerStarted","Data":"2e4625966e4a58df823a1f9aebda907cd86f10ece42edcae41bde3b5f699b529"} Jun 10 01:00:43.304648 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.304152 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:43.305864 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.305825 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxvpn" event={"ID":"09292145-9b2f-40cc-ac41-93cec49ff39e","Type":"ContainerStarted","Data":"69d12cebabbbc4d7daeeff31f164e1845e2615132462d5e8332c3fac1b243043"} Jun 10 01:00:43.308934 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.308909 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f65f3f4-b582-4015-9edb-0b55dfe5ae8b" containerID="0d370b91c00680457f67cacfb61064e43468790d61c8c061bda041e56c163a34" exitCode=0 Jun 10 01:00:43.309035 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.308960 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerDied","Data":"0d370b91c00680457f67cacfb61064e43468790d61c8c061bda041e56c163a34"} Jun 10 01:00:43.321879 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.321850 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:43.331087 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.331034 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" podStartSLOduration=11.602425119 podStartE2EDuration="27.331019915s" totalImagesPullingTime="15.728594796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:43.330909561 +0000 UTC m=+27.759791080" watchObservedRunningTime="2026-06-10 01:00:43.331019915 +0000 UTC m=+27.759901433" Jun 10 01:00:43.366200 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.366136 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pxvpn" podStartSLOduration=1.705143678 podStartE2EDuration="27.366118973s" totalImagesPullingTime="25.660975295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-06-10 01:00:43.365701042 +0000 UTC m=+27.794582560" watchObservedRunningTime="2026-06-10 01:00:43.366118973 +0000 UTC m=+27.795000488" Jun 10 01:00:43.427653 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.427619 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:43.427826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.427814 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 01:00:43.428273 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.428254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rmnhn" Jun 10 01:00:43.454975 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.454945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:43.507061 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.507033 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:43.556111 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.556012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:43.771164 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.771120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:43.871346 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:43.871240 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:44.059847 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:44.059818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:44.060000 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:44.059933 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:44.312564 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:44.312420 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:44.312564 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:44.312507 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:44.331745 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:44.331698 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:00:45.059953 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.059763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:45.060203 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.059763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:45.060203 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:45.060104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:45.060203 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:45.060141 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:45.307222 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.307074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:45.357253 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.357164 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:45.372131 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.371420 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fxh9n"] Jun 10 01:00:45.372131 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.371609 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:45.372131 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:45.371725 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:45.372437 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.372268 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-njr9p"] Jun 10 01:00:45.372437 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.372379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:45.372515 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:45.372479 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:45.374712 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.374440 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbxv2"] Jun 10 01:00:45.374712 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:45.374543 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:45.374712 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:45.374646 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:47.059928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:47.059888 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:47.059928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:47.059919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:47.060878 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:47.059919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:47.060878 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:47.060019 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njr9p" podUID="bdb6eea5-2e68-4de9-89a6-01adba311202" Jun 10 01:00:47.060878 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:47.060107 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:00:47.060878 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:47.060166 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxh9n" podUID="d37f5659-a82c-4d1a-9678-4862179a02b7" Jun 10 01:00:48.738146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.738099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:48.738722 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.738306 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:48.738722 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.738397 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret podName:bdb6eea5-2e68-4de9-89a6-01adba311202 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:20.738372841 +0000 UTC m=+65.167254358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret") pod "global-pull-secret-syncer-njr9p" (UID: "bdb6eea5-2e68-4de9-89a6-01adba311202") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:00:48.838835 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.838754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:48.839002 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.838898 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:48.839002 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.838971 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:20.838953152 +0000 UTC m=+65.267834659 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:00:48.870107 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.870079 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-200.ec2.internal" event="NodeReady" Jun 10 01:00:48.870253 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.870214 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 01:00:48.914289 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.914249 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jtqw4"] Jun 10 01:00:48.934839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.934797 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6tsx8"] Jun 10 01:00:48.935041 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.934947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:48.937372 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.937345 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 01:00:48.937487 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.937405 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vqpqf\"" Jun 10 01:00:48.937487 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.937424 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 01:00:48.939266 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.939242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:48.939392 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.939362 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:00:48.939392 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.939378 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:00:48.939392 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.939389 2559 projected.go:196] Error preparing data for projected volume kube-api-access-5r8bv for pod openshift-network-diagnostics/network-check-target-fxh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:48.939516 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:48.939429 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv podName:d37f5659-a82c-4d1a-9678-4862179a02b7 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:20.939416493 +0000 UTC m=+65.368297988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5r8bv" (UniqueName: "kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv") pod "network-check-target-fxh9n" (UID: "d37f5659-a82c-4d1a-9678-4862179a02b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:00:48.955195 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.955167 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6tsx8"] Jun 10 01:00:48.955195 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.955204 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtqw4"] Jun 10 01:00:48.955428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.955288 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:48.957678 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.957658 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 01:00:48.957795 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.957695 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 01:00:48.957902 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.957887 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 01:00:48.957965 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:48.957893 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvqtt\"" Jun 10 01:00:49.039945 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.039913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.039945 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.039960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3853474-e016-40cd-a700-d65cc29d3a7f-config-volume\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.040162 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.039983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3853474-e016-40cd-a700-d65cc29d3a7f-tmp-dir\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.040162 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.040026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deeaf967-c086-4420-8604-b16bca2c7936-cert\") pod \"ingress-canary-6tsx8\" (UID: \"deeaf967-c086-4420-8604-b16bca2c7936\") " pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.040162 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.040108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxwsf\" (UniqueName: \"kubernetes.io/projected/d3853474-e016-40cd-a700-d65cc29d3a7f-kube-api-access-zxwsf\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.040162 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.040131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxfw\" (UniqueName: \"kubernetes.io/projected/deeaf967-c086-4420-8604-b16bca2c7936-kube-api-access-trxfw\") pod \"ingress-canary-6tsx8\" (UID: \"deeaf967-c086-4420-8604-b16bca2c7936\") " pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.060193 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.060160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:00:49.060193 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.060194 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:00:49.060421 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.060200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:00:49.062943 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.062916 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:00:49.062943 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.062930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:00:49.063126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.062942 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zlvbp\"" Jun 10 01:00:49.063126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.062934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qp5n8\"" Jun 10 01:00:49.063126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.062935 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:00:49.063126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.063029 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:00:49.141111 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3853474-e016-40cd-a700-d65cc29d3a7f-tmp-dir\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.141111 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deeaf967-c086-4420-8604-b16bca2c7936-cert\") pod \"ingress-canary-6tsx8\" (UID: \"deeaf967-c086-4420-8604-b16bca2c7936\") " pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.141111 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxwsf\" (UniqueName: \"kubernetes.io/projected/d3853474-e016-40cd-a700-d65cc29d3a7f-kube-api-access-zxwsf\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.141515 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxfw\" (UniqueName: \"kubernetes.io/projected/deeaf967-c086-4420-8604-b16bca2c7936-kube-api-access-trxfw\") pod \"ingress-canary-6tsx8\" (UID: \"deeaf967-c086-4420-8604-b16bca2c7936\") " pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.141515 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.141515 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3853474-e016-40cd-a700-d65cc29d3a7f-config-volume\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.141515 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:49.141425 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:00:49.141814 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141465 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3853474-e016-40cd-a700-d65cc29d3a7f-tmp-dir\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.141814 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:49.141490 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:00:49.641471997 +0000 UTC m=+34.070353507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:00:49.141992 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.141931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3853474-e016-40cd-a700-d65cc29d3a7f-config-volume\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.145367 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.145348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deeaf967-c086-4420-8604-b16bca2c7936-cert\") pod \"ingress-canary-6tsx8\" (UID: \"deeaf967-c086-4420-8604-b16bca2c7936\") " pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.149776 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.149750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxwsf\" (UniqueName: \"kubernetes.io/projected/d3853474-e016-40cd-a700-d65cc29d3a7f-kube-api-access-zxwsf\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.149875 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.149759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxfw\" (UniqueName: \"kubernetes.io/projected/deeaf967-c086-4420-8604-b16bca2c7936-kube-api-access-trxfw\") pod \"ingress-canary-6tsx8\" (UID: \"deeaf967-c086-4420-8604-b16bca2c7936\") " pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.263765 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.263732 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6tsx8" Jun 10 01:00:49.548058 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.548028 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6tsx8"] Jun 10 01:00:49.552123 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:00:49.552079 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeeaf967_c086_4420_8604_b16bca2c7936.slice/crio-5de97dcbb20c3ec2fc337175f7502df5efc209924e439fd222352ddf9929f3b5 WatchSource:0}: Error finding container 5de97dcbb20c3ec2fc337175f7502df5efc209924e439fd222352ddf9929f3b5: Status 404 returned error can't find the container with id 5de97dcbb20c3ec2fc337175f7502df5efc209924e439fd222352ddf9929f3b5 Jun 10 01:00:49.645397 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:49.645341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:49.645591 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:49.645563 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:00:49.645683 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:49.645669 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:00:50.645643231 +0000 UTC m=+35.074524730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:00:50.329725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:50.329551 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f65f3f4-b582-4015-9edb-0b55dfe5ae8b" containerID="7b19f0557fe641b33ba5c6f26a722b522cff09e65170fddaa0c52ad708cfc328" exitCode=0 Jun 10 01:00:50.330213 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:50.329626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerDied","Data":"7b19f0557fe641b33ba5c6f26a722b522cff09e65170fddaa0c52ad708cfc328"} Jun 10 01:00:50.330985 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:50.330964 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6tsx8" event={"ID":"deeaf967-c086-4420-8604-b16bca2c7936","Type":"ContainerStarted","Data":"5de97dcbb20c3ec2fc337175f7502df5efc209924e439fd222352ddf9929f3b5"} Jun 10 01:00:50.653527 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:50.653434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:50.653684 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:50.653593 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:00:50.653684 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:50.653669 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:00:52.653652571 +0000 UTC m=+37.082534067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:00:51.335686 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:51.335652 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f65f3f4-b582-4015-9edb-0b55dfe5ae8b" containerID="ad70b57064a76f0200b20cd316d1b85e8c7319c1e8e3706050814a244d985c50" exitCode=0 Jun 10 01:00:51.336083 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:51.335702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerDied","Data":"ad70b57064a76f0200b20cd316d1b85e8c7319c1e8e3706050814a244d985c50"} Jun 10 01:00:52.340868 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:52.340826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" event={"ID":"2f65f3f4-b582-4015-9edb-0b55dfe5ae8b","Type":"ContainerStarted","Data":"34570c0764db93d8eef4e89c52cdd8eef5ca13fd7b20d5f9d6e86101ef5b0ef0"} Jun 10 01:00:52.363088 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:52.363035 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bc5rj" podStartSLOduration=5.805809358 podStartE2EDuration="36.363019504s" totalImagesPullingTime="30.557210146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:52.361008908 +0000 UTC m=+36.789890425" watchObservedRunningTime="2026-06-10 01:00:52.363019504 +0000 UTC m=+36.791901021" Jun 10 01:00:52.481005 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:52.480965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:52.534487 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:52.534417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:52.671058 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:52.670960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:52.671237 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:52.671116 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:00:52.671237 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:52.671185 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:00:56.671169053 +0000 UTC m=+41.100050549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:00:54.346845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:54.346803 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6tsx8" event={"ID":"deeaf967-c086-4420-8604-b16bca2c7936","Type":"ContainerStarted","Data":"e30350d380bba0eeaa4fb83c33005c3e29421e4a0b2d353d4d34eeb66f9f387e"} Jun 10 01:00:54.362385 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:54.362333 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6tsx8" podStartSLOduration=2.638572463 podStartE2EDuration="6.362316901s" totalImagesPullingTime="3.723744438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:54.361232542 +0000 UTC m=+38.790114061" watchObservedRunningTime="2026-06-10 01:00:54.362316901 +0000 UTC m=+38.791198410" Jun 10 01:00:56.699787 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:00:56.699748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:00:56.700341 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:56.699872 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:00:56.700341 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:00:56.699927 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:01:04.699912678 +0000 UTC m=+49.128794174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:01:00.079216 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:00.079173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:00.144182 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:00.144146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:00.205933 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:00.205898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:00.264879 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:00.264845 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:00.377752 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:00.377650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:00.428900 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:00.428864 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:01.032308 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:01.032252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:01.088885 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:01.088848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:01.435434 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:01.435399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:01.536557 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:01.536517 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:01.636788 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:01.636748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:01.692463 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:01.692378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:04.755965 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:04.755914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:01:04.756410 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:04.756076 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:04.756410 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:04.756163 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:01:20.756144731 +0000 UTC m=+65.185026228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:01:13.956981 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:13.956939 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:14.006119 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:14.006081 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:16.338323 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:16.338277 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2s9xf" Jun 10 01:01:16.488646 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:16.488608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:16.541960 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:16.541923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:20.771383 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.771336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:01:20.771778 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.771423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:01:20.771778 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:20.771534 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:20.771778 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:20.771602 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:01:52.771585059 +0000 UTC m=+97.200466555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:01:20.773974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.773957 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:01:20.785224 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.785192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdb6eea5-2e68-4de9-89a6-01adba311202-original-pull-secret\") pod \"global-pull-secret-syncer-njr9p\" (UID: \"bdb6eea5-2e68-4de9-89a6-01adba311202\") " pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:01:20.869400 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.869358 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njr9p" Jun 10 01:01:20.872668 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.872635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:01:20.874797 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.874780 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:01:20.883817 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:20.883789 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:01:20.883929 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:20.883917 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:24.883896537 +0000 UTC m=+129.312778036 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : secret "metrics-daemon-secret" not found Jun 10 01:01:20.977327 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.974613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:01:20.980307 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.980258 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:01:20.987334 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.987260 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:01:20.997779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:20.997753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8bv\" (UniqueName: \"kubernetes.io/projected/d37f5659-a82c-4d1a-9678-4862179a02b7-kube-api-access-5r8bv\") pod \"network-check-target-fxh9n\" (UID: \"d37f5659-a82c-4d1a-9678-4862179a02b7\") " pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:01:21.036998 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:21.036924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-njr9p"] Jun 10 01:01:21.040208 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:01:21.040181 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb6eea5_2e68_4de9_89a6_01adba311202.slice/crio-377da6cc5ccf20f92b3549b40e3823abec139b946c125f103b2ce54c9747b668 WatchSource:0}: Error finding container 377da6cc5ccf20f92b3549b40e3823abec139b946c125f103b2ce54c9747b668: Status 404 returned error can't find the container with id 377da6cc5ccf20f92b3549b40e3823abec139b946c125f103b2ce54c9747b668 Jun 10 01:01:21.182866 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:21.182823 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zlvbp\"" Jun 10 01:01:21.190818 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:21.190789 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:01:21.341977 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:21.341940 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fxh9n"] Jun 10 01:01:21.344906 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:01:21.344875 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37f5659_a82c_4d1a_9678_4862179a02b7.slice/crio-44dfe6c0ae0f40fd1f354a84ec5a81274ab644231f141f9caf4f0ecd0f5b6a5e WatchSource:0}: Error finding container 44dfe6c0ae0f40fd1f354a84ec5a81274ab644231f141f9caf4f0ecd0f5b6a5e: Status 404 returned error can't find the container with id 44dfe6c0ae0f40fd1f354a84ec5a81274ab644231f141f9caf4f0ecd0f5b6a5e Jun 10 01:01:21.410950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:21.410911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fxh9n" event={"ID":"d37f5659-a82c-4d1a-9678-4862179a02b7","Type":"ContainerStarted","Data":"44dfe6c0ae0f40fd1f354a84ec5a81274ab644231f141f9caf4f0ecd0f5b6a5e"} Jun 10 01:01:21.411983 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:21.411951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-njr9p" event={"ID":"bdb6eea5-2e68-4de9-89a6-01adba311202","Type":"ContainerStarted","Data":"377da6cc5ccf20f92b3549b40e3823abec139b946c125f103b2ce54c9747b668"} Jun 10 01:01:27.429289 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:27.429239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-njr9p" event={"ID":"bdb6eea5-2e68-4de9-89a6-01adba311202","Type":"ContainerStarted","Data":"c6d338a26784b3d0a292fb338f1c6a0042cf613fae02b2b491761f179cf381cb"} Jun 10 01:01:27.430726 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:27.430695 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fxh9n" event={"ID":"d37f5659-a82c-4d1a-9678-4862179a02b7","Type":"ContainerStarted","Data":"ff7c61fa51bf3c40116fc6f26cafafd7a1cc20ea5b2e3523e3da49d003a3903a"} Jun 10 01:01:27.430846 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:27.430830 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:01:27.443341 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:27.443275 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-njr9p" podStartSLOduration=66.058886648 podStartE2EDuration="1m11.443260697s" totalImagesPullingTime="5.384374049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:27.442862505 +0000 UTC m=+71.871744023" watchObservedRunningTime="2026-06-10 01:01:27.443260697 +0000 UTC m=+71.872142218" Jun 10 01:01:27.456342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:27.456274 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fxh9n" podStartSLOduration=66.380861686 podStartE2EDuration="1m11.456261705s" totalImagesPullingTime="5.075400019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:27.455188172 +0000 UTC m=+71.884069690" watchObservedRunningTime="2026-06-10 01:01:27.456261705 +0000 UTC m=+71.885143223" Jun 10 01:01:52.780449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:52.780400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:01:52.780970 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:52.780529 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:01:52.780970 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:01:52.780593 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:02:56.780577702 +0000 UTC m=+161.209459199 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:01:58.435186 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:01:58.435150 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fxh9n" Jun 10 01:02:24.898661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:02:24.898619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:02:24.899079 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:02:24.898733 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:02:24.899079 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:02:24.898788 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs podName:3a374507-c6cd-4a5a-a096-b249f92c46d6 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:26.898773529 +0000 UTC m=+251.327655025 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs") pod "network-metrics-daemon-fbxv2" (UID: "3a374507-c6cd-4a5a-a096-b249f92c46d6") : secret "metrics-daemon-secret" not found Jun 10 01:02:51.944063 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:02:51.944014 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtqw4" podUID="d3853474-e016-40cd-a700-d65cc29d3a7f" Jun 10 01:02:52.075266 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:02:52.075212 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fbxv2" podUID="3a374507-c6cd-4a5a-a096-b249f92c46d6" Jun 10 01:02:52.632420 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:02:52.632392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtqw4" Jun 10 01:02:56.821765 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:02:56.821727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:02:56.822284 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:02:56.821945 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:56.822284 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:02:56.822045 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls podName:d3853474-e016-40cd-a700-d65cc29d3a7f nodeName:}" failed. No retries permitted until 2026-06-10 01:04:58.822022617 +0000 UTC m=+283.250904128 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls") pod "dns-default-jtqw4" (UID: "d3853474-e016-40cd-a700-d65cc29d3a7f") : secret "dns-default-metrics-tls" not found Jun 10 01:03:05.060155 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:05.060114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:03:46.950165 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.950127 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr"] Jun 10 01:03:46.952928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.952906 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:46.955126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.955092 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 01:03:46.955272 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.955140 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:03:46.955272 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.955102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sxs79\"" Jun 10 01:03:46.955272 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.955143 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 01:03:46.955857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.955844 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 01:03:46.957782 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.957761 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5864487bb6-2r2kl"] Jun 10 01:03:46.960448 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.960428 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-k5sjt"] Jun 10 01:03:46.960573 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.960557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:46.963327 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.963280 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sv4x9\"" Jun 10 01:03:46.963672 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.963652 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 01:03:46.963829 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.963810 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 01:03:46.963918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.963886 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 01:03:46.966046 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.966017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:46.967644 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.967619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr"] Jun 10 01:03:46.969498 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.969366 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 01:03:46.969498 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.969393 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fldbh\"" Jun 10 01:03:46.969498 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.969447 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 01:03:46.969687 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.969538 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 01:03:46.969687 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.969576 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 01:03:46.971804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.971781 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 01:03:46.974447 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.974428 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 01:03:46.977075 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.977051 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-k5sjt"] Jun 10 01:03:46.980098 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:46.980068 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5864487bb6-2r2kl"] Jun 10 01:03:47.054106 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-image-registry-private-configuration\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054106 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054110 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-trusted-ca\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054388 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-bound-sa-token\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054388 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-ca-trust-extracted\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054388 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkmk9\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-kube-api-access-fkmk9\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054388 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c612b621-d8b7-4a0c-b10a-2b0804778825-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.054388 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5k9n\" (UniqueName: \"kubernetes.io/projected/c612b621-d8b7-4a0c-b10a-2b0804778825-kube-api-access-l5k9n\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56ee282c-0a32-4e92-853e-56294527d1d2-serving-cert\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2c7r\" (UniqueName: \"kubernetes.io/projected/56ee282c-0a32-4e92-853e-56294527d1d2-kube-api-access-q2c7r\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ee282c-0a32-4e92-853e-56294527d1d2-tmp\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/56ee282c-0a32-4e92-853e-56294527d1d2-snapshots\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-certificates\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-installation-pull-secrets\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.054636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c612b621-d8b7-4a0c-b10a-2b0804778825-config\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.054911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56ee282c-0a32-4e92-853e-56294527d1d2-trusted-ca-bundle\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.054911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56ee282c-0a32-4e92-853e-56294527d1d2-service-ca-bundle\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.054911 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.054712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.055925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.055897 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t"] Jun 10 01:03:47.058871 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.058855 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md"] Jun 10 01:03:47.058994 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.058978 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" Jun 10 01:03:47.061497 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.061481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.062091 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.062074 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7shqq\"" Jun 10 01:03:47.063780 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.063763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 01:03:47.064324 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.064271 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:03:47.064778 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.064748 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 01:03:47.064778 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.064767 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 01:03:47.064937 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.064749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rbwnx\"" Jun 10 01:03:47.069330 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.069305 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t"] Jun 10 01:03:47.070503 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.070483 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md"] Jun 10 01:03:47.147823 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.147790 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz"] Jun 10 01:03:47.150697 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.150681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" Jun 10 01:03:47.153005 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.152982 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 01:03:47.153127 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.153068 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x47wc\"" Jun 10 01:03:47.153127 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.153069 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:03:47.154968 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.154945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-bound-sa-token\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.155062 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.154977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2c7r\" (UniqueName: \"kubernetes.io/projected/56ee282c-0a32-4e92-853e-56294527d1d2-kube-api-access-q2c7r\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.155062 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155000 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4hx\" (UniqueName: \"kubernetes.io/projected/dbd1e44f-c366-4ea8-bc98-aa1b4d03215e-kube-api-access-zf4hx\") pod \"network-check-source-dbd9cf844-45r2t\" (UID: \"dbd1e44f-c366-4ea8-bc98-aa1b4d03215e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" Jun 10 01:03:47.155062 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5k9n\" (UniqueName: \"kubernetes.io/projected/c612b621-d8b7-4a0c-b10a-2b0804778825-kube-api-access-l5k9n\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.155062 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155050 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f24k\" (UniqueName: \"kubernetes.io/projected/10b9d554-7435-4079-a806-b6f8fee6eaf3-kube-api-access-4f24k\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.155264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/56ee282c-0a32-4e92-853e-56294527d1d2-snapshots\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.155264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c612b621-d8b7-4a0c-b10a-2b0804778825-config\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.155264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-certificates\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.155264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-installation-pull-secrets\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.155264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56ee282c-0a32-4e92-853e-56294527d1d2-trusted-ca-bundle\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.155579 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2qwr\" (UniqueName: \"kubernetes.io/projected/9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2-kube-api-access-f2qwr\") pod \"volume-data-source-validator-78dd696465-xspsz\" (UID: \"9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" Jun 10 01:03:47.155716 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-image-registry-private-configuration\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.155826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10b9d554-7435-4079-a806-b6f8fee6eaf3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.155826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkmk9\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-kube-api-access-fkmk9\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.155826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c612b621-d8b7-4a0c-b10a-2b0804778825-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.155826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c612b621-d8b7-4a0c-b10a-2b0804778825-config\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.155826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-ca-trust-extracted\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155848 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ee282c-0a32-4e92-853e-56294527d1d2-tmp\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10b9d554-7435-4079-a806-b6f8fee6eaf3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56ee282c-0a32-4e92-853e-56294527d1d2-serving-cert\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-certificates\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56ee282c-0a32-4e92-853e-56294527d1d2-service-ca-bundle\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.156017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.156047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-trusted-ca\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.156095 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.155919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/56ee282c-0a32-4e92-853e-56294527d1d2-snapshots\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.156538 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.156278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56ee282c-0a32-4e92-853e-56294527d1d2-trusted-ca-bundle\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.156538 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.156383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-ca-trust-extracted\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.157284 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.157062 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ee282c-0a32-4e92-853e-56294527d1d2-tmp\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.157284 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:47.157154 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:03:47.157284 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:47.157170 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5864487bb6-2r2kl: secret "image-registry-tls" not found Jun 10 01:03:47.157284 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:47.157252 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls podName:3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:47.65723423 +0000 UTC m=+212.086115744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls") pod "image-registry-5864487bb6-2r2kl" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2") : secret "image-registry-tls" not found Jun 10 01:03:47.158230 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.157372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56ee282c-0a32-4e92-853e-56294527d1d2-service-ca-bundle\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.158419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.158361 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-installation-pull-secrets\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.158855 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.158813 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56ee282c-0a32-4e92-853e-56294527d1d2-serving-cert\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.159028 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.159004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-trusted-ca\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.159125 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.159099 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c612b621-d8b7-4a0c-b10a-2b0804778825-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.159616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.159597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-image-registry-private-configuration\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.160533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.160514 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz"] Jun 10 01:03:47.166587 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.166564 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2c7r\" (UniqueName: \"kubernetes.io/projected/56ee282c-0a32-4e92-853e-56294527d1d2-kube-api-access-q2c7r\") pod \"insights-operator-896549976-k5sjt\" (UID: \"56ee282c-0a32-4e92-853e-56294527d1d2\") " pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.167770 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.167748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5k9n\" (UniqueName: \"kubernetes.io/projected/c612b621-d8b7-4a0c-b10a-2b0804778825-kube-api-access-l5k9n\") pod \"service-ca-operator-6bc5ff68f5-fnxsr\" (UID: \"c612b621-d8b7-4a0c-b10a-2b0804778825\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.167770 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.168100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-bound-sa-token\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.168643 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.168625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkmk9\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-kube-api-access-fkmk9\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.257281 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.257183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4hx\" (UniqueName: \"kubernetes.io/projected/dbd1e44f-c366-4ea8-bc98-aa1b4d03215e-kube-api-access-zf4hx\") pod \"network-check-source-dbd9cf844-45r2t\" (UID: \"dbd1e44f-c366-4ea8-bc98-aa1b4d03215e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" Jun 10 01:03:47.257281 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.257231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f24k\" (UniqueName: \"kubernetes.io/projected/10b9d554-7435-4079-a806-b6f8fee6eaf3-kube-api-access-4f24k\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.257281 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.257264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2qwr\" (UniqueName: \"kubernetes.io/projected/9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2-kube-api-access-f2qwr\") pod \"volume-data-source-validator-78dd696465-xspsz\" (UID: \"9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" Jun 10 01:03:47.257281 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.257282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10b9d554-7435-4079-a806-b6f8fee6eaf3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.257834 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.257333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10b9d554-7435-4079-a806-b6f8fee6eaf3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.257945 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.257921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10b9d554-7435-4079-a806-b6f8fee6eaf3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.259494 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.259456 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/10b9d554-7435-4079-a806-b6f8fee6eaf3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.262969 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.262941 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" Jun 10 01:03:47.265148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.265125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f24k\" (UniqueName: \"kubernetes.io/projected/10b9d554-7435-4079-a806-b6f8fee6eaf3-kube-api-access-4f24k\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wq5md\" (UID: \"10b9d554-7435-4079-a806-b6f8fee6eaf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.265355 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.265330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2qwr\" (UniqueName: \"kubernetes.io/projected/9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2-kube-api-access-f2qwr\") pod \"volume-data-source-validator-78dd696465-xspsz\" (UID: \"9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" Jun 10 01:03:47.265428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.265387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4hx\" (UniqueName: \"kubernetes.io/projected/dbd1e44f-c366-4ea8-bc98-aa1b4d03215e-kube-api-access-zf4hx\") pod \"network-check-source-dbd9cf844-45r2t\" (UID: \"dbd1e44f-c366-4ea8-bc98-aa1b4d03215e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" Jun 10 01:03:47.281434 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.281407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-k5sjt" Jun 10 01:03:47.370610 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.370583 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" Jun 10 01:03:47.375961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.375926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" Jun 10 01:03:47.399866 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.399818 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr"] Jun 10 01:03:47.419405 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.419361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-k5sjt"] Jun 10 01:03:47.424312 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:03:47.424249 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ee282c_0a32_4e92_853e_56294527d1d2.slice/crio-ce5e026f9dcbce79af3b65acf17c932deab9f23e6ef9573414deb2cf011ca6ca WatchSource:0}: Error finding container ce5e026f9dcbce79af3b65acf17c932deab9f23e6ef9573414deb2cf011ca6ca: Status 404 returned error can't find the container with id ce5e026f9dcbce79af3b65acf17c932deab9f23e6ef9573414deb2cf011ca6ca Jun 10 01:03:47.478814 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.478513 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" Jun 10 01:03:47.506314 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.506273 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t"] Jun 10 01:03:47.509641 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:03:47.509606 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd1e44f_c366_4ea8_bc98_aa1b4d03215e.slice/crio-a2e6c96a5e5d1ef53c82b6e9e243f9140c403ca0060f3841de6f4611d9672003 WatchSource:0}: Error finding container a2e6c96a5e5d1ef53c82b6e9e243f9140c403ca0060f3841de6f4611d9672003: Status 404 returned error can't find the container with id a2e6c96a5e5d1ef53c82b6e9e243f9140c403ca0060f3841de6f4611d9672003 Jun 10 01:03:47.527661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.527592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md"] Jun 10 01:03:47.544029 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:03:47.543995 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b9d554_7435_4079_a806_b6f8fee6eaf3.slice/crio-bb0290c971f71cc30135e9bfab362b43254e4210c613091cc3609a4ee56c91c9 WatchSource:0}: Error finding container bb0290c971f71cc30135e9bfab362b43254e4210c613091cc3609a4ee56c91c9: Status 404 returned error can't find the container with id bb0290c971f71cc30135e9bfab362b43254e4210c613091cc3609a4ee56c91c9 Jun 10 01:03:47.613773 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.613739 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz"] Jun 10 01:03:47.617869 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:03:47.617837 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8f031b_9eb5_45ae_a372_f5bc0bb8dfd2.slice/crio-42af7204b8d778ab4f7a015873d096fdda5fbe09fe61a8eb6764f801e2b2ae2b WatchSource:0}: Error finding container 42af7204b8d778ab4f7a015873d096fdda5fbe09fe61a8eb6764f801e2b2ae2b: Status 404 returned error can't find the container with id 42af7204b8d778ab4f7a015873d096fdda5fbe09fe61a8eb6764f801e2b2ae2b Jun 10 01:03:47.660492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.660445 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:47.660674 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:47.660596 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:03:47.660674 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:47.660616 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5864487bb6-2r2kl: secret "image-registry-tls" not found Jun 10 01:03:47.660674 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:47.660674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls podName:3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:48.660657277 +0000 UTC m=+213.089538786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls") pod "image-registry-5864487bb6-2r2kl" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2") : secret "image-registry-tls" not found Jun 10 01:03:47.765863 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.765753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" event={"ID":"dbd1e44f-c366-4ea8-bc98-aa1b4d03215e","Type":"ContainerStarted","Data":"f886aeb8b396e21407e13e8c2c59e2c341309d8971c86022d93cbfb8487d1c5d"} Jun 10 01:03:47.765863 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.765816 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" event={"ID":"dbd1e44f-c366-4ea8-bc98-aa1b4d03215e","Type":"ContainerStarted","Data":"a2e6c96a5e5d1ef53c82b6e9e243f9140c403ca0060f3841de6f4611d9672003"} Jun 10 01:03:47.766854 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.766819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k5sjt" event={"ID":"56ee282c-0a32-4e92-853e-56294527d1d2","Type":"ContainerStarted","Data":"ce5e026f9dcbce79af3b65acf17c932deab9f23e6ef9573414deb2cf011ca6ca"} Jun 10 01:03:47.767850 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.767824 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" event={"ID":"c612b621-d8b7-4a0c-b10a-2b0804778825","Type":"ContainerStarted","Data":"94ef56f8c8c8f272b49ac89bf87c6efd352726ff590d7c3d43646a213073f2de"} Jun 10 01:03:47.768907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.768881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" event={"ID":"9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2","Type":"ContainerStarted","Data":"42af7204b8d778ab4f7a015873d096fdda5fbe09fe61a8eb6764f801e2b2ae2b"} Jun 10 01:03:47.769928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.769909 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" event={"ID":"10b9d554-7435-4079-a806-b6f8fee6eaf3","Type":"ContainerStarted","Data":"bb0290c971f71cc30135e9bfab362b43254e4210c613091cc3609a4ee56c91c9"} Jun 10 01:03:47.779963 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:47.779921 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-45r2t" podStartSLOduration=0.779898735 podStartE2EDuration="779.898735ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:47.779395149 +0000 UTC m=+212.208276681" watchObservedRunningTime="2026-06-10 01:03:47.779898735 +0000 UTC m=+212.208780278" Jun 10 01:03:48.670231 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:48.669563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:48.670231 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:48.669799 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:03:48.670231 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:48.669815 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5864487bb6-2r2kl: secret "image-registry-tls" not found Jun 10 01:03:48.670231 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:48.669876 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls podName:3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:50.669856915 +0000 UTC m=+215.098738420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls") pod "image-registry-5864487bb6-2r2kl" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2") : secret "image-registry-tls" not found Jun 10 01:03:49.777739 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:49.777697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" event={"ID":"9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2","Type":"ContainerStarted","Data":"6352c683ea55717c3fda9749b707aca8c6099864d513205bd99682fa3e2fce16"} Jun 10 01:03:49.792872 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:49.792811 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xspsz" podStartSLOduration=1.234980782 podStartE2EDuration="2.792791179s" totalImagesPullingTime="1.557810397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:49.791768332 +0000 UTC m=+214.220649855" watchObservedRunningTime="2026-06-10 01:03:49.792791179 +0000 UTC m=+214.221672700" Jun 10 01:03:50.687389 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:50.687270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:50.687570 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:50.687433 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:03:50.687570 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:50.687457 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5864487bb6-2r2kl: secret "image-registry-tls" not found Jun 10 01:03:50.687570 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:50.687530 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls podName:3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:54.687508177 +0000 UTC m=+219.116389681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls") pod "image-registry-5864487bb6-2r2kl" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2") : secret "image-registry-tls" not found Jun 10 01:03:51.788010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:51.787953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" event={"ID":"10b9d554-7435-4079-a806-b6f8fee6eaf3","Type":"ContainerStarted","Data":"cac2c11fa79d06f900351bb383e2803df71fea6d1740452390abb0c1297c0913"} Jun 10 01:03:51.789529 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:51.789495 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k5sjt" event={"ID":"56ee282c-0a32-4e92-853e-56294527d1d2","Type":"ContainerStarted","Data":"7939ab18b87a0cddb855eb3eebdcf05bcf9556871132047dbe364787f9446d36"} Jun 10 01:03:51.790939 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:51.790914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" event={"ID":"c612b621-d8b7-4a0c-b10a-2b0804778825","Type":"ContainerStarted","Data":"2c3ad84d3a251170aeb81f52e4389c8b09d43ce8837c956b1d6adfbb495691f4"} Jun 10 01:03:51.804125 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:51.804073 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" podStartSLOduration=1.457699873 podStartE2EDuration="4.804056665s" totalImagesPullingTime="3.346356792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:51.803178223 +0000 UTC m=+216.232059742" watchObservedRunningTime="2026-06-10 01:03:51.804056665 +0000 UTC m=+216.232938224" Jun 10 01:03:51.835336 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:51.835240 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" podStartSLOduration=2.300033105 podStartE2EDuration="5.835216157s" totalImagesPullingTime="3.535183052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:51.818232862 +0000 UTC m=+216.247114381" watchObservedRunningTime="2026-06-10 01:03:51.835216157 +0000 UTC m=+216.264097676" Jun 10 01:03:51.835532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:51.835384 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-k5sjt" podStartSLOduration=2.363442111 podStartE2EDuration="5.835376972s" totalImagesPullingTime="3.471934861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:51.834456871 +0000 UTC m=+216.263338390" watchObservedRunningTime="2026-06-10 01:03:51.835376972 +0000 UTC m=+216.264258492" Jun 10 01:03:54.400577 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.400550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2z75_da58b347-1782-4582-a001-cf6a105aaad2/dns-node-resolver/0.log" Jun 10 01:03:54.434876 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.433272 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-kjhbd"] Jun 10 01:03:54.438437 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.438406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.440767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.440730 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 01:03:54.441509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.441481 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 01:03:54.441690 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.441529 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5x7gf\"" Jun 10 01:03:54.441690 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.441557 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 01:03:54.441690 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.441627 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 01:03:54.442762 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.442741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-kjhbd"] Jun 10 01:03:54.519982 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.519946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhpt\" (UniqueName: \"kubernetes.io/projected/d1d668fb-6166-4752-ac0f-a439aa2c3747-kube-api-access-hwhpt\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.520180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.519991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1d668fb-6166-4752-ac0f-a439aa2c3747-signing-key\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.520180 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.520081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1d668fb-6166-4752-ac0f-a439aa2c3747-signing-cabundle\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.621431 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.621388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhpt\" (UniqueName: \"kubernetes.io/projected/d1d668fb-6166-4752-ac0f-a439aa2c3747-kube-api-access-hwhpt\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.621609 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.621439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1d668fb-6166-4752-ac0f-a439aa2c3747-signing-key\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.621609 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.621490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1d668fb-6166-4752-ac0f-a439aa2c3747-signing-cabundle\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.622252 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.622230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1d668fb-6166-4752-ac0f-a439aa2c3747-signing-cabundle\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.624006 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.623980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1d668fb-6166-4752-ac0f-a439aa2c3747-signing-key\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.629635 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.629608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhpt\" (UniqueName: \"kubernetes.io/projected/d1d668fb-6166-4752-ac0f-a439aa2c3747-kube-api-access-hwhpt\") pod \"service-ca-7d74d578b8-kjhbd\" (UID: \"d1d668fb-6166-4752-ac0f-a439aa2c3747\") " pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.722814 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.722775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:03:54.723013 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:54.722956 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:03:54.723013 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:54.722979 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5864487bb6-2r2kl: secret "image-registry-tls" not found Jun 10 01:03:54.723128 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:03:54.723066 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls podName:3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:02.723040831 +0000 UTC m=+227.151922326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls") pod "image-registry-5864487bb6-2r2kl" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2") : secret "image-registry-tls" not found Jun 10 01:03:54.748682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.748642 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" Jun 10 01:03:54.873990 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:54.873966 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-kjhbd"] Jun 10 01:03:54.876354 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:03:54.876322 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d668fb_6166_4752_ac0f_a439aa2c3747.slice/crio-6640d15bcfd27d2cf8b72464afdbff8b9afea4405081fb8bf7e01395f3a43e08 WatchSource:0}: Error finding container 6640d15bcfd27d2cf8b72464afdbff8b9afea4405081fb8bf7e01395f3a43e08: Status 404 returned error can't find the container with id 6640d15bcfd27d2cf8b72464afdbff8b9afea4405081fb8bf7e01395f3a43e08 Jun 10 01:03:55.602365 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:55.602336 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sn29x_81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00/node-ca/0.log" Jun 10 01:03:55.807761 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:55.807721 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" event={"ID":"d1d668fb-6166-4752-ac0f-a439aa2c3747","Type":"ContainerStarted","Data":"d0acba21276c23b7b9280e9c14cfe76000fdc80df3b824218b98912afa0a662f"} Jun 10 01:03:55.807958 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:55.807779 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" event={"ID":"d1d668fb-6166-4752-ac0f-a439aa2c3747","Type":"ContainerStarted","Data":"6640d15bcfd27d2cf8b72464afdbff8b9afea4405081fb8bf7e01395f3a43e08"} Jun 10 01:03:55.824121 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:55.824055 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-kjhbd" podStartSLOduration=1.824032665 podStartE2EDuration="1.824032665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:55.82279142 +0000 UTC m=+220.251672933" watchObservedRunningTime="2026-06-10 01:03:55.824032665 +0000 UTC m=+220.252914182" Jun 10 01:03:56.201756 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:03:56.201722 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tsx8_deeaf967-c086-4420-8604-b16bca2c7936/serve-healthcheck-canary/0.log" Jun 10 01:04:02.785074 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:02.785029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:04:02.787638 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:02.787601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"image-registry-5864487bb6-2r2kl\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:04:02.875518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:02.875474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:04:03.008627 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:03.008593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5864487bb6-2r2kl"] Jun 10 01:04:03.011474 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:03.011441 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7d8a07_f2ca_45ad_b7c7_750a5d7125d2.slice/crio-f83d6af6041f4bad509e29e0349745c79c1f04fbf338f6044d5ecce692ec6636 WatchSource:0}: Error finding container f83d6af6041f4bad509e29e0349745c79c1f04fbf338f6044d5ecce692ec6636: Status 404 returned error can't find the container with id f83d6af6041f4bad509e29e0349745c79c1f04fbf338f6044d5ecce692ec6636 Jun 10 01:04:03.835012 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:03.834974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" event={"ID":"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2","Type":"ContainerStarted","Data":"e5a60c8bd7205146bd9a6de8329d4e61471cd5d842b7e89f580be8b7142806e1"} Jun 10 01:04:03.835439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:03.835031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" event={"ID":"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2","Type":"ContainerStarted","Data":"f83d6af6041f4bad509e29e0349745c79c1f04fbf338f6044d5ecce692ec6636"} Jun 10 01:04:03.835439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:03.835114 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:04:03.851923 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:03.851875 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" podStartSLOduration=17.851856653 podStartE2EDuration="17.851856653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:03.851530441 +0000 UTC m=+228.280411968" watchObservedRunningTime="2026-06-10 01:04:03.851856653 +0000 UTC m=+228.280738172" Jun 10 01:04:13.777259 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.777225 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5864487bb6-2r2kl"] Jun 10 01:04:13.791135 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.791081 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h"] Jun 10 01:04:13.798136 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.798103 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-hzzbn"] Jun 10 01:04:13.798750 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.798726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:13.802059 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.802040 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kf94m"] Jun 10 01:04:13.802174 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.802157 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:13.804450 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.804421 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 01:04:13.804537 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.804503 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 01:04:13.805586 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.805539 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 01:04:13.805935 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.805919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.807322 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.807288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lz2jc\"" Jun 10 01:04:13.809985 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.809968 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 01:04:13.810069 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.810045 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6l47l\"" Jun 10 01:04:13.810505 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.810489 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 01:04:13.810707 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.810686 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6ld5q\"" Jun 10 01:04:13.818765 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.818739 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h"] Jun 10 01:04:13.828273 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.828244 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hzzbn"] Jun 10 01:04:13.830576 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.830549 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kf94m"] Jun 10 01:04:13.857281 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.857244 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85c9797f77-xzt64"] Jun 10 01:04:13.861080 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.861059 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.871813 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.871776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2qj9\" (UniqueName: \"kubernetes.io/projected/0fd7393c-9c45-425d-8627-42b164c70e05-kube-api-access-t2qj9\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.871944 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.871837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9s7n\" (UniqueName: \"kubernetes.io/projected/ec801d56-280a-409a-8861-d999f87e9875-kube-api-access-f9s7n\") pod \"downloads-6657875f97-hzzbn\" (UID: \"ec801d56-280a-409a-8861-d999f87e9875\") " pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:13.871944 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.871856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2857c0fa-9b8f-42e0-863a-d8cbcd003505-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6r6h\" (UID: \"2857c0fa-9b8f-42e0-863a-d8cbcd003505\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:13.871944 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.871899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fd7393c-9c45-425d-8627-42b164c70e05-data-volume\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.871944 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.871931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fd7393c-9c45-425d-8627-42b164c70e05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.872167 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.872094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fd7393c-9c45-425d-8627-42b164c70e05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.872219 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.872164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fd7393c-9c45-425d-8627-42b164c70e05-crio-socket\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.887948 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.887902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c9797f77-xzt64"] Jun 10 01:04:13.973610 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9s7n\" (UniqueName: \"kubernetes.io/projected/ec801d56-280a-409a-8861-d999f87e9875-kube-api-access-f9s7n\") pod \"downloads-6657875f97-hzzbn\" (UID: \"ec801d56-280a-409a-8861-d999f87e9875\") " pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:13.973610 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2857c0fa-9b8f-42e0-863a-d8cbcd003505-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6r6h\" (UID: \"2857c0fa-9b8f-42e0-863a-d8cbcd003505\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fd7393c-9c45-425d-8627-42b164c70e05-data-volume\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fd7393c-9c45-425d-8627-42b164c70e05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xjww\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-kube-api-access-8xjww\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fd7393c-9c45-425d-8627-42b164c70e05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb51f020-fafe-479b-bfa7-8b6ef221db62-registry-certificates\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb51f020-fafe-479b-bfa7-8b6ef221db62-trusted-ca\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.973839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-bound-sa-token\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fd7393c-9c45-425d-8627-42b164c70e05-crio-socket\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-registry-tls\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.973969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0fd7393c-9c45-425d-8627-42b164c70e05-crio-socket\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.974037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb51f020-fafe-479b-bfa7-8b6ef221db62-installation-pull-secrets\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.974085 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fd7393c-9c45-425d-8627-42b164c70e05-data-volume\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.974092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2qj9\" (UniqueName: \"kubernetes.io/projected/0fd7393c-9c45-425d-8627-42b164c70e05-kube-api-access-t2qj9\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.974161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.974147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb51f020-fafe-479b-bfa7-8b6ef221db62-image-registry-private-configuration\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.974520 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.974175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb51f020-fafe-479b-bfa7-8b6ef221db62-ca-trust-extracted\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:13.974520 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.974476 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0fd7393c-9c45-425d-8627-42b164c70e05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.976208 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.976184 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0fd7393c-9c45-425d-8627-42b164c70e05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.976359 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.976236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2857c0fa-9b8f-42e0-863a-d8cbcd003505-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6r6h\" (UID: \"2857c0fa-9b8f-42e0-863a-d8cbcd003505\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:13.981974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.981946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2qj9\" (UniqueName: \"kubernetes.io/projected/0fd7393c-9c45-425d-8627-42b164c70e05-kube-api-access-t2qj9\") pod \"insights-runtime-extractor-kf94m\" (UID: \"0fd7393c-9c45-425d-8627-42b164c70e05\") " pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:13.981974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:13.981972 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9s7n\" (UniqueName: \"kubernetes.io/projected/ec801d56-280a-409a-8861-d999f87e9875-kube-api-access-f9s7n\") pod \"downloads-6657875f97-hzzbn\" (UID: \"ec801d56-280a-409a-8861-d999f87e9875\") " pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:14.075371 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb51f020-fafe-479b-bfa7-8b6ef221db62-ca-trust-extracted\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xjww\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-kube-api-access-8xjww\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075411 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb51f020-fafe-479b-bfa7-8b6ef221db62-registry-certificates\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb51f020-fafe-479b-bfa7-8b6ef221db62-trusted-ca\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-bound-sa-token\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-registry-tls\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075777 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb51f020-fafe-479b-bfa7-8b6ef221db62-installation-pull-secrets\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075777 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb51f020-fafe-479b-bfa7-8b6ef221db62-image-registry-private-configuration\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.075777 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.075761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb51f020-fafe-479b-bfa7-8b6ef221db62-ca-trust-extracted\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.076374 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.076347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb51f020-fafe-479b-bfa7-8b6ef221db62-registry-certificates\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.076489 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.076406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb51f020-fafe-479b-bfa7-8b6ef221db62-trusted-ca\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.078126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.078103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb51f020-fafe-479b-bfa7-8b6ef221db62-installation-pull-secrets\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.078228 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.078208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-registry-tls\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.078269 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.078234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb51f020-fafe-479b-bfa7-8b6ef221db62-image-registry-private-configuration\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.086647 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.086610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-bound-sa-token\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.086769 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.086715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xjww\" (UniqueName: \"kubernetes.io/projected/bb51f020-fafe-479b-bfa7-8b6ef221db62-kube-api-access-8xjww\") pod \"image-registry-85c9797f77-xzt64\" (UID: \"bb51f020-fafe-479b-bfa7-8b6ef221db62\") " pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.109166 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.109132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:14.115580 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.115559 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:14.121123 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.121096 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kf94m" Jun 10 01:04:14.171877 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.171630 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.303839 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.303806 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h"] Jun 10 01:04:14.305416 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.305389 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hzzbn"] Jun 10 01:04:14.306698 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:14.306607 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2857c0fa_9b8f_42e0_863a_d8cbcd003505.slice/crio-dd102506634f88a35757f36f7fa1db9c31460a3e0dbb146699c90e48fdbf1464 WatchSource:0}: Error finding container dd102506634f88a35757f36f7fa1db9c31460a3e0dbb146699c90e48fdbf1464: Status 404 returned error can't find the container with id dd102506634f88a35757f36f7fa1db9c31460a3e0dbb146699c90e48fdbf1464 Jun 10 01:04:14.309432 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:14.309399 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec801d56_280a_409a_8861_d999f87e9875.slice/crio-f85344fef16b5bd65238e7207686f3997817e45c309a120e8f60febc3bb7563e WatchSource:0}: Error finding container f85344fef16b5bd65238e7207686f3997817e45c309a120e8f60febc3bb7563e: Status 404 returned error can't find the container with id f85344fef16b5bd65238e7207686f3997817e45c309a120e8f60febc3bb7563e Jun 10 01:04:14.332926 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.332898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kf94m"] Jun 10 01:04:14.335518 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:14.335486 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd7393c_9c45_425d_8627_42b164c70e05.slice/crio-3b4f4eb18a744e4f2b985c41573d2467ec3a4f7f1974b290de7526b43b8c830e WatchSource:0}: Error finding container 3b4f4eb18a744e4f2b985c41573d2467ec3a4f7f1974b290de7526b43b8c830e: Status 404 returned error can't find the container with id 3b4f4eb18a744e4f2b985c41573d2467ec3a4f7f1974b290de7526b43b8c830e Jun 10 01:04:14.363368 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.363340 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85c9797f77-xzt64"] Jun 10 01:04:14.369309 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:14.369271 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb51f020_fafe_479b_bfa7_8b6ef221db62.slice/crio-f4d703ab046807ddf4d52430cd9bdfefa066a1ba8098d6a28e2efa43a1d4920d WatchSource:0}: Error finding container f4d703ab046807ddf4d52430cd9bdfefa066a1ba8098d6a28e2efa43a1d4920d: Status 404 returned error can't find the container with id f4d703ab046807ddf4d52430cd9bdfefa066a1ba8098d6a28e2efa43a1d4920d Jun 10 01:04:14.385338 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.384650 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8467bbf88f-bmjx2"] Jun 10 01:04:14.389649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.389630 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.391996 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.391761 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 01:04:14.391996 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.391799 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvfzk\"" Jun 10 01:04:14.391996 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.391948 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 01:04:14.392207 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.391950 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 01:04:14.392207 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.392008 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 01:04:14.392207 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.392118 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 01:04:14.398740 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.398716 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8467bbf88f-bmjx2"] Jun 10 01:04:14.480423 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.480375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-serving-cert\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.480616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.480435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-oauth-serving-cert\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.480616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.480462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwpwm\" (UniqueName: \"kubernetes.io/projected/acd6b017-9f5a-4553-9bf1-3e6df4eea555-kube-api-access-xwpwm\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.480616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.480481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-service-ca\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.480616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.480510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-oauth-config\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.480616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.480570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-config\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581029 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.580987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-oauth-serving-cert\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581230 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwpwm\" (UniqueName: \"kubernetes.io/projected/acd6b017-9f5a-4553-9bf1-3e6df4eea555-kube-api-access-xwpwm\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581230 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-service-ca\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581230 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-oauth-config\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581436 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-config\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581436 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-serving-cert\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.581970 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-oauth-serving-cert\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.582076 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.581940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-service-ca\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.582076 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.582016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-config\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.583873 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.583823 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-serving-cert\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.583873 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.583838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-oauth-config\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.588485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.588460 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwpwm\" (UniqueName: \"kubernetes.io/projected/acd6b017-9f5a-4553-9bf1-3e6df4eea555-kube-api-access-xwpwm\") pod \"console-8467bbf88f-bmjx2\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.705238 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.705179 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:14.861972 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.861775 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8467bbf88f-bmjx2"] Jun 10 01:04:14.865447 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:14.865400 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd6b017_9f5a_4553_9bf1_3e6df4eea555.slice/crio-1fb95928b577fb04643ced4de73b0d6cc26af1e1d48638e6bd863c2a7cdec4a2 WatchSource:0}: Error finding container 1fb95928b577fb04643ced4de73b0d6cc26af1e1d48638e6bd863c2a7cdec4a2: Status 404 returned error can't find the container with id 1fb95928b577fb04643ced4de73b0d6cc26af1e1d48638e6bd863c2a7cdec4a2 Jun 10 01:04:14.879823 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.879677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" event={"ID":"bb51f020-fafe-479b-bfa7-8b6ef221db62","Type":"ContainerStarted","Data":"ce7df0a428567c23bf775d743491a2677870344c8025068454472834dcb65519"} Jun 10 01:04:14.879823 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.879743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" event={"ID":"bb51f020-fafe-479b-bfa7-8b6ef221db62","Type":"ContainerStarted","Data":"f4d703ab046807ddf4d52430cd9bdfefa066a1ba8098d6a28e2efa43a1d4920d"} Jun 10 01:04:14.879823 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.879791 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:14.881918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.881798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf94m" event={"ID":"0fd7393c-9c45-425d-8627-42b164c70e05","Type":"ContainerStarted","Data":"bca7df87f32500924cb64ff0445a7be9057def170ed74a4fec71f9b1c3ed6f2e"} Jun 10 01:04:14.881918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.881860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf94m" event={"ID":"0fd7393c-9c45-425d-8627-42b164c70e05","Type":"ContainerStarted","Data":"3b4f4eb18a744e4f2b985c41573d2467ec3a4f7f1974b290de7526b43b8c830e"} Jun 10 01:04:14.884842 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.884784 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hzzbn" event={"ID":"ec801d56-280a-409a-8861-d999f87e9875","Type":"ContainerStarted","Data":"f85344fef16b5bd65238e7207686f3997817e45c309a120e8f60febc3bb7563e"} Jun 10 01:04:14.886358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.886325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" event={"ID":"2857c0fa-9b8f-42e0-863a-d8cbcd003505","Type":"ContainerStarted","Data":"dd102506634f88a35757f36f7fa1db9c31460a3e0dbb146699c90e48fdbf1464"} Jun 10 01:04:14.887729 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.887704 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8467bbf88f-bmjx2" event={"ID":"acd6b017-9f5a-4553-9bf1-3e6df4eea555","Type":"ContainerStarted","Data":"1fb95928b577fb04643ced4de73b0d6cc26af1e1d48638e6bd863c2a7cdec4a2"} Jun 10 01:04:14.898231 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:14.898139 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podStartSLOduration=1.898122226 podStartE2EDuration="1.898122226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:14.896538611 +0000 UTC m=+239.325420150" watchObservedRunningTime="2026-06-10 01:04:14.898122226 +0000 UTC m=+239.327003744" Jun 10 01:04:15.894666 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:15.894495 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf94m" event={"ID":"0fd7393c-9c45-425d-8627-42b164c70e05","Type":"ContainerStarted","Data":"029e864e26ffca822e8600b63d0e8cf3f00cc8a1bf5e2b9bedbe3260529e34ca"} Jun 10 01:04:15.896539 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:15.896472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" event={"ID":"2857c0fa-9b8f-42e0-863a-d8cbcd003505","Type":"ContainerStarted","Data":"f48eb8bce806206fe6793df9ba1fc4e1dda147fddfd2b2c2d695722f6abebc80"} Jun 10 01:04:15.911265 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:15.910690 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" podStartSLOduration=1.76107638 podStartE2EDuration="2.910666015s" totalImagesPullingTime="1.149589635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:15.909714618 +0000 UTC m=+240.338596137" watchObservedRunningTime="2026-06-10 01:04:15.910666015 +0000 UTC m=+240.339547545" Jun 10 01:04:16.901888 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:16.901816 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:16.909000 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:16.908969 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6r6h" Jun 10 01:04:17.908098 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:17.908016 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf94m" event={"ID":"0fd7393c-9c45-425d-8627-42b164c70e05","Type":"ContainerStarted","Data":"40beee56baf1b1fa56f683aec1568982a11d11f98e324c1de4b6671047942aad"} Jun 10 01:04:17.926266 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:17.926206 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kf94m" podStartSLOduration=2.028647229 podStartE2EDuration="4.926190897s" totalImagesPullingTime="2.897543668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:04:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:17.925767448 +0000 UTC m=+242.354648992" watchObservedRunningTime="2026-06-10 01:04:17.926190897 +0000 UTC m=+242.355072393" Jun 10 01:04:19.920715 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:19.920672 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8467bbf88f-bmjx2" event={"ID":"acd6b017-9f5a-4553-9bf1-3e6df4eea555","Type":"ContainerStarted","Data":"8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592"} Jun 10 01:04:19.935972 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:19.935906 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8467bbf88f-bmjx2" podStartSLOduration=1.627143417 podStartE2EDuration="5.935891098s" totalImagesPullingTime="4.308747681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:19.935728564 +0000 UTC m=+244.364610084" watchObservedRunningTime="2026-06-10 01:04:19.935891098 +0000 UTC m=+244.364772615" Jun 10 01:04:22.440719 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.440681 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb"] Jun 10 01:04:22.445143 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.445060 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.448052 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.447814 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 01:04:22.448052 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.447824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 01:04:22.448746 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.448420 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 01:04:22.448746 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.448610 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g6p85\"" Jun 10 01:04:22.448912 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.448788 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 01:04:22.449152 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.449121 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 01:04:22.453384 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.453314 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb"] Jun 10 01:04:22.471756 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.471718 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ht4j8"] Jun 10 01:04:22.481934 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.481901 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.485271 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.485243 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 01:04:22.485426 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.485279 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 01:04:22.485426 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.485243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 01:04:22.485426 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.485359 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lqwcs\"" Jun 10 01:04:22.561107 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.561073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/044a63c6-4695-4678-9033-7c6eab6cb7be-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.561314 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.561124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.561314 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.561176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.561314 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.561201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvwwb\" (UniqueName: \"kubernetes.io/projected/044a63c6-4695-4678-9033-7c6eab6cb7be-kube-api-access-pvwwb\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.662169 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrl4v\" (UniqueName: \"kubernetes.io/projected/fbb49ece-903b-479e-934f-81e8b2d0aa70-kube-api-access-hrl4v\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662169 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.662439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvwwb\" (UniqueName: \"kubernetes.io/projected/044a63c6-4695-4678-9033-7c6eab6cb7be-kube-api-access-pvwwb\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.662439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-accelerators-collector-config\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662439 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:22.662337 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 10 01:04:22.662439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-sys\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662439 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:22.662407 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-tls podName:044a63c6-4695-4678-9033-7c6eab6cb7be nodeName:}" failed. No retries permitted until 2026-06-10 01:04:23.162385524 +0000 UTC m=+247.591267026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-vz2tb" (UID: "044a63c6-4695-4678-9033-7c6eab6cb7be") : secret "openshift-state-metrics-tls" not found Jun 10 01:04:22.662618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-root\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/044a63c6-4695-4678-9033-7c6eab6cb7be-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.662618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-textfile\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662754 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.662808 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb49ece-903b-479e-934f-81e8b2d0aa70-metrics-client-ca\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662866 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-wtmp\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.662866 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.662857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-tls\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.663354 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.663332 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/044a63c6-4695-4678-9033-7c6eab6cb7be-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.665155 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.665134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.670925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.670902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvwwb\" (UniqueName: \"kubernetes.io/projected/044a63c6-4695-4678-9033-7c6eab6cb7be-kube-api-access-pvwwb\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:22.764148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-accelerators-collector-config\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-sys\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-root\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-textfile\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb49ece-903b-479e-934f-81e8b2d0aa70-metrics-client-ca\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-wtmp\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-root\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-tls\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrl4v\" (UniqueName: \"kubernetes.io/projected/fbb49ece-903b-479e-934f-81e8b2d0aa70-kube-api-access-hrl4v\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764802 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-wtmp\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764802 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbb49ece-903b-479e-934f-81e8b2d0aa70-sys\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.764802 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:22.764647 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 01:04:22.764802 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:22.764728 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-tls podName:fbb49ece-903b-479e-934f-81e8b2d0aa70 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:23.264706006 +0000 UTC m=+247.693587517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-tls") pod "node-exporter-ht4j8" (UID: "fbb49ece-903b-479e-934f-81e8b2d0aa70") : secret "node-exporter-tls" not found Jun 10 01:04:22.764802 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-accelerators-collector-config\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.765063 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.764862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb49ece-903b-479e-934f-81e8b2d0aa70-metrics-client-ca\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.765063 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.765026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-textfile\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.767845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.767817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:22.773877 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:22.773856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrl4v\" (UniqueName: \"kubernetes.io/projected/fbb49ece-903b-479e-934f-81e8b2d0aa70-kube-api-access-hrl4v\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:23.168765 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.168673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:23.171593 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.171555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/044a63c6-4695-4678-9033-7c6eab6cb7be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vz2tb\" (UID: \"044a63c6-4695-4678-9033-7c6eab6cb7be\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:23.270062 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.270019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-tls\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:23.272722 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.272696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbb49ece-903b-479e-934f-81e8b2d0aa70-node-exporter-tls\") pod \"node-exporter-ht4j8\" (UID: \"fbb49ece-903b-479e-934f-81e8b2d0aa70\") " pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:23.359412 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.359375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" Jun 10 01:04:23.395837 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.395761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ht4j8" Jun 10 01:04:23.410717 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:23.410668 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb49ece_903b_479e_934f_81e8b2d0aa70.slice/crio-de8e9056f8ee8df5335ca2dc7a93ade2ef3a51e5c71754f54e62d96c322211f5 WatchSource:0}: Error finding container de8e9056f8ee8df5335ca2dc7a93ade2ef3a51e5c71754f54e62d96c322211f5: Status 404 returned error can't find the container with id de8e9056f8ee8df5335ca2dc7a93ade2ef3a51e5c71754f54e62d96c322211f5 Jun 10 01:04:23.513544 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.513508 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:04:23.518881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.518851 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.519042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.519017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb"] Jun 10 01:04:23.521020 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.520998 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 01:04:23.521115 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521035 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 01:04:23.521264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521245 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 01:04:23.521356 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521281 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 01:04:23.521356 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 01:04:23.521466 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521422 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 01:04:23.521684 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521576 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 01:04:23.521684 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521613 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 01:04:23.521909 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521877 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lx5d9\"" Jun 10 01:04:23.521995 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.521974 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 01:04:23.523507 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:23.523413 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044a63c6_4695_4678_9033_7c6eab6cb7be.slice/crio-2cf6158b28e2027fad3fe723237f79322254ddc700c3b33626efcb69f62cfb1c WatchSource:0}: Error finding container 2cf6158b28e2027fad3fe723237f79322254ddc700c3b33626efcb69f62cfb1c: Status 404 returned error can't find the container with id 2cf6158b28e2027fad3fe723237f79322254ddc700c3b33626efcb69f62cfb1c Jun 10 01:04:23.531708 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.531683 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:04:23.674724 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2cm\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-kube-api-access-fm2cm\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.674724 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.674857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.674857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-volume\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.674857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.674950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-out\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.674950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.674925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.675036 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.675013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.675096 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.675073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-web-config\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.675143 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.675128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.675219 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.675154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.675346 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.675232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.675346 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.675267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.776625 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-out\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.776625 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.776879 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.776879 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-web-config\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.776879 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777030 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777030 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:23.776916 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 01:04:23.777030 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.776947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777030 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:23.776989 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls podName:e8e16656-e2dd-4d7a-a344-2d0b95072b02 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:24.276968112 +0000 UTC m=+248.705849609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02") : secret "alertmanager-main-tls" not found Jun 10 01:04:23.777234 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777234 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777377 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2cm\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-kube-api-access-fm2cm\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777377 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777488 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777488 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-volume\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.777488 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.778012 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.777985 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.778177 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.778151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.780194 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.780166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.780663 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.780633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.780916 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.780894 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.780978 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.780955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.781555 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.781534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.781742 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.781724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-out\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.782033 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.782012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-web-config\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.782928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.782905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-volume\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.784121 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.784097 2559 patch_prober.go:28] interesting pod/image-registry-5864487bb6-2r2kl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:23.784231 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.784148 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:23.787026 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.787001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2cm\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-kube-api-access-fm2cm\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:23.938387 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.938284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" event={"ID":"044a63c6-4695-4678-9033-7c6eab6cb7be","Type":"ContainerStarted","Data":"35da4a6d2a4d365e58dfea44ec9cabe439c6b2049f7bc42fb719a02cc03087c8"} Jun 10 01:04:23.938552 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.938408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" event={"ID":"044a63c6-4695-4678-9033-7c6eab6cb7be","Type":"ContainerStarted","Data":"d8f65ac3134761bea65789b3fb8335bde6dee7e5780f2a31cd2aa716cb43dfd6"} Jun 10 01:04:23.938552 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.938439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" event={"ID":"044a63c6-4695-4678-9033-7c6eab6cb7be","Type":"ContainerStarted","Data":"2cf6158b28e2027fad3fe723237f79322254ddc700c3b33626efcb69f62cfb1c"} Jun 10 01:04:23.939614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:23.939583 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht4j8" event={"ID":"fbb49ece-903b-479e-934f-81e8b2d0aa70","Type":"ContainerStarted","Data":"de8e9056f8ee8df5335ca2dc7a93ade2ef3a51e5c71754f54e62d96c322211f5"} Jun 10 01:04:24.283730 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.283635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:24.287006 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.286930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:24.432281 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.432227 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:04:24.705441 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.705336 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:24.706078 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.706050 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:24.707741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.707228 2559 patch_prober.go:28] interesting pod/console-8467bbf88f-bmjx2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 10 01:04:24.707741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.707275 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8467bbf88f-bmjx2" podUID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 10 01:04:24.777075 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.777041 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:04:24.811375 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:24.811332 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e16656_e2dd_4d7a_a344_2d0b95072b02.slice/crio-ef3ac50fe674f978e484d90bd85be494fb18d799b4ec5936b5b00b87de6da9ae WatchSource:0}: Error finding container ef3ac50fe674f978e484d90bd85be494fb18d799b4ec5936b5b00b87de6da9ae: Status 404 returned error can't find the container with id ef3ac50fe674f978e484d90bd85be494fb18d799b4ec5936b5b00b87de6da9ae Jun 10 01:04:24.948853 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.948808 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" event={"ID":"044a63c6-4695-4678-9033-7c6eab6cb7be","Type":"ContainerStarted","Data":"4cb541211e00f5a4208558db0ebb8399934d60dd823e2f66bff75baff20f0e35"} Jun 10 01:04:24.950184 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.950150 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"ef3ac50fe674f978e484d90bd85be494fb18d799b4ec5936b5b00b87de6da9ae"} Jun 10 01:04:24.952016 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.951979 2559 generic.go:356] "Generic (PLEG): container finished" podID="fbb49ece-903b-479e-934f-81e8b2d0aa70" containerID="58055b4668834e55c6e6c6fcd629613ffd0ce66dbdecce15e342fa004e67a3f2" exitCode=0 Jun 10 01:04:24.952126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.952074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht4j8" event={"ID":"fbb49ece-903b-479e-934f-81e8b2d0aa70","Type":"ContainerDied","Data":"58055b4668834e55c6e6c6fcd629613ffd0ce66dbdecce15e342fa004e67a3f2"} Jun 10 01:04:24.966032 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:24.965976 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vz2tb" podStartSLOduration=1.982690021 podStartE2EDuration="2.965958401s" totalImagesPullingTime="983.26838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:24.96443318 +0000 UTC m=+249.393314725" watchObservedRunningTime="2026-06-10 01:04:24.965958401 +0000 UTC m=+249.394839918" Jun 10 01:04:26.770725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.770685 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-744cfd5df7-k7hd8"] Jun 10 01:04:26.775327 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.775282 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.778718 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.778690 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 01:04:26.778890 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.778718 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wnrmv\"" Jun 10 01:04:26.778890 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.778718 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 01:04:26.778890 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.778784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 01:04:26.778890 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.778845 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dg9itddepvdt8\"" Jun 10 01:04:26.780628 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.780609 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 01:04:26.786196 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.786173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-744cfd5df7-k7hd8"] Jun 10 01:04:26.909690 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:04:26.909891 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/333deffa-ff11-4271-8a08-a99293395962-audit-log\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.909891 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/333deffa-ff11-4271-8a08-a99293395962-metrics-server-audit-profiles\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.909891 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-secret-metrics-server-tls\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.909891 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-secret-metrics-server-client-certs\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.910110 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/333deffa-ff11-4271-8a08-a99293395962-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.910110 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-client-ca-bundle\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.910110 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.909975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltnb6\" (UniqueName: \"kubernetes.io/projected/333deffa-ff11-4271-8a08-a99293395962-kube-api-access-ltnb6\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:26.912325 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.912281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a374507-c6cd-4a5a-a096-b249f92c46d6-metrics-certs\") pod \"network-metrics-daemon-fbxv2\" (UID: \"3a374507-c6cd-4a5a-a096-b249f92c46d6\") " pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:04:26.963513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.963477 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qp5n8\"" Jun 10 01:04:26.972008 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:26.971966 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxv2" Jun 10 01:04:27.011136 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-secret-metrics-server-client-certs\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011348 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/333deffa-ff11-4271-8a08-a99293395962-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011348 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-client-ca-bundle\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011348 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltnb6\" (UniqueName: \"kubernetes.io/projected/333deffa-ff11-4271-8a08-a99293395962-kube-api-access-ltnb6\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011348 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/333deffa-ff11-4271-8a08-a99293395962-audit-log\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011588 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/333deffa-ff11-4271-8a08-a99293395962-metrics-server-audit-profiles\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011588 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-secret-metrics-server-tls\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.011747 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/333deffa-ff11-4271-8a08-a99293395962-audit-log\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.012016 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.011986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/333deffa-ff11-4271-8a08-a99293395962-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.012644 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.012619 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/333deffa-ff11-4271-8a08-a99293395962-metrics-server-audit-profiles\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.014200 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.014171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-secret-metrics-server-tls\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.014439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.014412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-secret-metrics-server-client-certs\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.014544 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.014486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333deffa-ff11-4271-8a08-a99293395962-client-ca-bundle\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.018801 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.018778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltnb6\" (UniqueName: \"kubernetes.io/projected/333deffa-ff11-4271-8a08-a99293395962-kube-api-access-ltnb6\") pod \"metrics-server-744cfd5df7-k7hd8\" (UID: \"333deffa-ff11-4271-8a08-a99293395962\") " pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.087306 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.087197 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:27.231584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.231548 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr"] Jun 10 01:04:27.235246 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.235215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.237267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.237238 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 01:04:27.237432 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.237316 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rmq4x\"" Jun 10 01:04:27.241816 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.241788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr"] Jun 10 01:04:27.314096 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.314051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4d5f505-d01f-4ab0-8661-6042103fe289-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.314317 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.314122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fdvh\" (UniqueName: \"kubernetes.io/projected/c4d5f505-d01f-4ab0-8661-6042103fe289-kube-api-access-4fdvh\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.414746 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.414647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4d5f505-d01f-4ab0-8661-6042103fe289-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.414746 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.414728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fdvh\" (UniqueName: \"kubernetes.io/projected/c4d5f505-d01f-4ab0-8661-6042103fe289-kube-api-access-4fdvh\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.414984 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:27.414815 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 01:04:27.414984 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:27.414898 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d5f505-d01f-4ab0-8661-6042103fe289-monitoring-plugin-cert podName:c4d5f505-d01f-4ab0-8661-6042103fe289 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:27.914876331 +0000 UTC m=+252.343757830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c4d5f505-d01f-4ab0-8661-6042103fe289-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-kv4rr" (UID: "c4d5f505-d01f-4ab0-8661-6042103fe289") : secret "monitoring-plugin-cert" not found Jun 10 01:04:27.425198 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.425167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fdvh\" (UniqueName: \"kubernetes.io/projected/c4d5f505-d01f-4ab0-8661-6042103fe289-kube-api-access-4fdvh\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.918628 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.918583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4d5f505-d01f-4ab0-8661-6042103fe289-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:27.922439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:27.921232 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4d5f505-d01f-4ab0-8661-6042103fe289-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kv4rr\" (UID: \"c4d5f505-d01f-4ab0-8661-6042103fe289\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:28.148369 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:28.148329 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:31.778440 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.778404 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8467bbf88f-bmjx2"] Jun 10 01:04:31.804743 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.804710 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-868b967d6d-bkchg"] Jun 10 01:04:31.808644 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.808618 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.822693 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.822654 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 01:04:31.823522 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.823472 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868b967d6d-bkchg"] Jun 10 01:04:31.847116 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-serving-cert\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.847257 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-config\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.847257 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-oauth-config\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.847419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-oauth-serving-cert\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.847467 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-service-ca\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.847520 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-trusted-ca-bundle\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.847520 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.847503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2zz\" (UniqueName: \"kubernetes.io/projected/818a4802-04cd-4056-a8b0-7c6466c88e4f-kube-api-access-fk2zz\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-service-ca\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-trusted-ca-bundle\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2zz\" (UniqueName: \"kubernetes.io/projected/818a4802-04cd-4056-a8b0-7c6466c88e4f-kube-api-access-fk2zz\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-serving-cert\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-config\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-oauth-config\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.949548 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.948908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-oauth-serving-cert\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.950061 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.949673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-oauth-serving-cert\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.951503 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.951268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-service-ca\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.953235 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.952352 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-config\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.953235 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.953187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-trusted-ca-bundle\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.955799 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.955768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-oauth-config\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.956365 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.956284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-serving-cert\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.959619 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.959587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2zz\" (UniqueName: \"kubernetes.io/projected/818a4802-04cd-4056-a8b0-7c6466c88e4f-kube-api-access-fk2zz\") pod \"console-868b967d6d-bkchg\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:31.985696 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:31.985617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht4j8" event={"ID":"fbb49ece-903b-479e-934f-81e8b2d0aa70","Type":"ContainerStarted","Data":"8b4c14a9c7c596ab14a41b9d9eea877bcdf2aae45f41228d4325941962208fec"} Jun 10 01:04:32.012651 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.012400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbxv2"] Jun 10 01:04:32.015668 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:32.015637 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a374507_c6cd_4a5a_a096_b249f92c46d6.slice/crio-087522384ef29078e8b3d6fd0de5f39629bb95c4b14c89f0e6bf270e33154ce8 WatchSource:0}: Error finding container 087522384ef29078e8b3d6fd0de5f39629bb95c4b14c89f0e6bf270e33154ce8: Status 404 returned error can't find the container with id 087522384ef29078e8b3d6fd0de5f39629bb95c4b14c89f0e6bf270e33154ce8 Jun 10 01:04:32.032971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.032935 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-744cfd5df7-k7hd8"] Jun 10 01:04:32.035990 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:32.035900 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333deffa_ff11_4271_8a08_a99293395962.slice/crio-c4b27020d0b7895d4378f12712bfd0d1a65336b0e3264266e1c80516f9568d0c WatchSource:0}: Error finding container c4b27020d0b7895d4378f12712bfd0d1a65336b0e3264266e1c80516f9568d0c: Status 404 returned error can't find the container with id c4b27020d0b7895d4378f12712bfd0d1a65336b0e3264266e1c80516f9568d0c Jun 10 01:04:32.123681 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.123645 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:32.234647 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.234346 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr"] Jun 10 01:04:32.297042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.296958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868b967d6d-bkchg"] Jun 10 01:04:32.301373 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:32.301280 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818a4802_04cd_4056_a8b0_7c6466c88e4f.slice/crio-a8024e336f3bd4623403faca9d8847856f1d1f531faa27ef8b9e5b919265fa10 WatchSource:0}: Error finding container a8024e336f3bd4623403faca9d8847856f1d1f531faa27ef8b9e5b919265fa10: Status 404 returned error can't find the container with id a8024e336f3bd4623403faca9d8847856f1d1f531faa27ef8b9e5b919265fa10 Jun 10 01:04:32.995804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.995758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" event={"ID":"333deffa-ff11-4271-8a08-a99293395962","Type":"ContainerStarted","Data":"c4b27020d0b7895d4378f12712bfd0d1a65336b0e3264266e1c80516f9568d0c"} Jun 10 01:04:32.998444 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:32.998367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" event={"ID":"c4d5f505-d01f-4ab0-8661-6042103fe289","Type":"ContainerStarted","Data":"03eaff7990a3318c81fc18fb4c6a388636695790a7ddc4237490320b25afde7f"} Jun 10 01:04:33.004554 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.001537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hzzbn" event={"ID":"ec801d56-280a-409a-8861-d999f87e9875","Type":"ContainerStarted","Data":"836384d539cd4439421a175754ad1427f23825da99f346ac0b393bbcb8c10e68"} Jun 10 01:04:33.004554 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.002785 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:33.006021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.005920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbxv2" event={"ID":"3a374507-c6cd-4a5a-a096-b249f92c46d6","Type":"ContainerStarted","Data":"087522384ef29078e8b3d6fd0de5f39629bb95c4b14c89f0e6bf270e33154ce8"} Jun 10 01:04:33.009214 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.009147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ht4j8" event={"ID":"fbb49ece-903b-479e-934f-81e8b2d0aa70","Type":"ContainerStarted","Data":"d19b07f267df99abc5027b2b162cb58cdaf535736d3f40f3fcdf8deb49caead6"} Jun 10 01:04:33.012286 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.012177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868b967d6d-bkchg" event={"ID":"818a4802-04cd-4056-a8b0-7c6466c88e4f","Type":"ContainerStarted","Data":"498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a"} Jun 10 01:04:33.012286 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.012221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868b967d6d-bkchg" event={"ID":"818a4802-04cd-4056-a8b0-7c6466c88e4f","Type":"ContainerStarted","Data":"a8024e336f3bd4623403faca9d8847856f1d1f531faa27ef8b9e5b919265fa10"} Jun 10 01:04:33.013825 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.013658 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-hzzbn" Jun 10 01:04:33.018641 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.018418 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-hzzbn" podStartSLOduration=2.352298509 podStartE2EDuration="20.01839937s" totalImagesPullingTime="17.666100861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:33.01704147 +0000 UTC m=+257.445922990" watchObservedRunningTime="2026-06-10 01:04:33.01839937 +0000 UTC m=+257.447280889" Jun 10 01:04:33.034653 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.034588 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ht4j8" podStartSLOduration=10.015665613 podStartE2EDuration="11.034571102s" totalImagesPullingTime="937.629271ms" totalInitContainerRuntime="81.276218ms" isStatefulPod=true podCreationTimestamp="2026-06-10 01:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:33.033024562 +0000 UTC m=+257.461906082" watchObservedRunningTime="2026-06-10 01:04:33.034571102 +0000 UTC m=+257.463452621" Jun 10 01:04:33.066200 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.065663 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-868b967d6d-bkchg" podStartSLOduration=2.065640938 podStartE2EDuration="2.065640938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:33.05101997 +0000 UTC m=+257.479901489" watchObservedRunningTime="2026-06-10 01:04:33.065640938 +0000 UTC m=+257.494522457" Jun 10 01:04:33.784323 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.784097 2559 patch_prober.go:28] interesting pod/image-registry-5864487bb6-2r2kl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:33.784323 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:33.784210 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:34.022907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:34.022773 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d" exitCode=0 Jun 10 01:04:34.022907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:34.022818 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d"} Jun 10 01:04:34.026918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:34.026799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbxv2" event={"ID":"3a374507-c6cd-4a5a-a096-b249f92c46d6","Type":"ContainerStarted","Data":"5bdb1768880a78c59bcbb7da185ca9b2204e5991e046f5dcaf9ec91a95390642"} Jun 10 01:04:34.026918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:34.026865 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbxv2" event={"ID":"3a374507-c6cd-4a5a-a096-b249f92c46d6","Type":"ContainerStarted","Data":"ad64e851b495a35965567a3c1fd9ffcd45659323c952c4e95c38f57b2a872ecb"} Jun 10 01:04:34.179492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:34.179445 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:34.179693 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:34.179518 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:35.902977 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:35.902928 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:35.903509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:35.903010 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:36.037253 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.037206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" event={"ID":"333deffa-ff11-4271-8a08-a99293395962","Type":"ContainerStarted","Data":"ad9eeef54ecf007967267fd17ffcb67d7c92ed1e0d815c3614babdf3d73304bf"} Jun 10 01:04:36.039365 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.039329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" event={"ID":"c4d5f505-d01f-4ab0-8661-6042103fe289","Type":"ContainerStarted","Data":"c17eca0421488529ded15d5677ed73a11124bc0bc25af8a81a578e8781618c58"} Jun 10 01:04:36.039509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.039491 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:36.045854 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.045828 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" Jun 10 01:04:36.053179 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.053072 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" podStartSLOduration=6.80135005 podStartE2EDuration="10.053051858s" totalImagesPullingTime="3.251701808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:36.052545265 +0000 UTC m=+260.481426783" watchObservedRunningTime="2026-06-10 01:04:36.053051858 +0000 UTC m=+260.481933377" Jun 10 01:04:36.053551 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.053516 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbxv2" podStartSLOduration=258.761165006 podStartE2EDuration="4m20.05350164s" totalImagesPullingTime="1.292336634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:34.06541353 +0000 UTC m=+258.494295071" watchObservedRunningTime="2026-06-10 01:04:36.05350164 +0000 UTC m=+260.482383158" Jun 10 01:04:36.069806 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:36.069749 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kv4rr" podStartSLOduration=6.025628766 podStartE2EDuration="9.069727295s" totalImagesPullingTime="3.044098529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:36.067518979 +0000 UTC m=+260.496400499" watchObservedRunningTime="2026-06-10 01:04:36.069727295 +0000 UTC m=+260.498608817" Jun 10 01:04:38.054052 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:38.053949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488"} Jun 10 01:04:38.054656 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:38.054084 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac"} Jun 10 01:04:38.054656 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:38.054127 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164"} Jun 10 01:04:38.054656 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:38.054166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb"} Jun 10 01:04:38.054656 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:38.054210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add"} Jun 10 01:04:38.800767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:38.800717 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerName="registry" containerID="cri-o://e5a60c8bd7205146bd9a6de8329d4e61471cd5d842b7e89f580be8b7142806e1" gracePeriod=30 Jun 10 01:04:39.063518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.063488 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerStarted","Data":"dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb"} Jun 10 01:04:39.065323 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.065276 2559 generic.go:356] "Generic (PLEG): container finished" podID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerID="e5a60c8bd7205146bd9a6de8329d4e61471cd5d842b7e89f580be8b7142806e1" exitCode=0 Jun 10 01:04:39.065448 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.065326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" event={"ID":"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2","Type":"ContainerDied","Data":"e5a60c8bd7205146bd9a6de8329d4e61471cd5d842b7e89f580be8b7142806e1"} Jun 10 01:04:39.094318 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.094233 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.389371015 podStartE2EDuration="16.094209007s" totalImagesPullingTime="12.67037652s" totalInitContainerRuntime="34.461472ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:04:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:04:39.092438653 +0000 UTC m=+263.521320201" watchObservedRunningTime="2026-06-10 01:04:39.094209007 +0000 UTC m=+263.523090526" Jun 10 01:04:39.097758 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.097724 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:04:39.128418 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128325 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-image-registry-private-configuration\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128418 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128384 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-trusted-ca\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128432 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkmk9\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-kube-api-access-fkmk9\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128471 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-ca-trust-extracted\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128536 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-installation-pull-secrets\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128567 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-bound-sa-token\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128599 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.128652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.128642 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-certificates\") pod \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\" (UID: \"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2\") " Jun 10 01:04:39.130669 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.130639 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:04:39.131361 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.131334 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:04:39.133900 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.133842 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:04:39.134776 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.134468 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:04:39.135131 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.134990 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:04:39.135923 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.135884 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-kube-api-access-fkmk9" (OuterVolumeSpecName: "kube-api-access-fkmk9") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "kube-api-access-fkmk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:04:39.136162 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.136141 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:04:39.142396 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.142270 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" (UID: "3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:04:39.229867 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229819 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkmk9\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-kube-api-access-fkmk9\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.229867 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229860 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-ca-trust-extracted\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.229867 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229871 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-installation-pull-secrets\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.230149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229883 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-bound-sa-token\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.230149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229898 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-tls\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.230149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229909 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-registry-certificates\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.230149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229918 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-image-registry-private-configuration\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:39.230149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:39.229934 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2-trusted-ca\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:40.071123 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:40.071086 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" Jun 10 01:04:40.071123 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:40.071104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5864487bb6-2r2kl" event={"ID":"3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2","Type":"ContainerDied","Data":"f83d6af6041f4bad509e29e0349745c79c1f04fbf338f6044d5ecce692ec6636"} Jun 10 01:04:40.071668 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:40.071187 2559 scope.go:117] "RemoveContainer" containerID="e5a60c8bd7205146bd9a6de8329d4e61471cd5d842b7e89f580be8b7142806e1" Jun 10 01:04:40.092573 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:40.092539 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5864487bb6-2r2kl"] Jun 10 01:04:40.095971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:40.095939 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5864487bb6-2r2kl"] Jun 10 01:04:42.064735 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:42.064703 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" path="/var/lib/kubelet/pods/3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2/volumes" Jun 10 01:04:42.124337 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:42.124275 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:42.124524 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:42.124365 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:04:42.125781 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:42.125755 2559 patch_prober.go:28] interesting pod/console-868b967d6d-bkchg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jun 10 01:04:42.125878 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:42.125821 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-868b967d6d-bkchg" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jun 10 01:04:44.176333 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:44.176275 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:44.176811 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:44.176355 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:45.901097 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:45.901062 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:45.901597 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:45.901114 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:47.088059 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:47.088019 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:47.088493 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:47.088083 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:04:52.125115 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:52.125082 2559 patch_prober.go:28] interesting pod/console-868b967d6d-bkchg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jun 10 01:04:52.125631 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:52.125140 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-868b967d6d-bkchg" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jun 10 01:04:54.176061 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:54.176025 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:54.176507 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:54.176093 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:54.176507 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:54.176138 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:04:54.176673 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:54.176639 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"ce7df0a428567c23bf775d743491a2677870344c8025068454472834dcb65519"} pod="openshift-image-registry/image-registry-85c9797f77-xzt64" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 01:04:54.180312 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:54.180255 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:04:54.180432 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:54.180342 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:04:55.633483 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:04:55.633433 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtqw4" podUID="d3853474-e016-40cd-a700-d65cc29d3a7f" Jun 10 01:04:56.135873 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:56.135840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtqw4" Jun 10 01:04:56.801308 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:56.801244 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8467bbf88f-bmjx2" podUID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" containerName="console" containerID="cri-o://8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592" gracePeriod=15 Jun 10 01:04:57.141521 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:57.141434 2559 generic.go:356] "Generic (PLEG): container finished" podID="10b9d554-7435-4079-a806-b6f8fee6eaf3" containerID="cac2c11fa79d06f900351bb383e2803df71fea6d1740452390abb0c1297c0913" exitCode=0 Jun 10 01:04:57.141521 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:57.141505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" event={"ID":"10b9d554-7435-4079-a806-b6f8fee6eaf3","Type":"ContainerDied","Data":"cac2c11fa79d06f900351bb383e2803df71fea6d1740452390abb0c1297c0913"} Jun 10 01:04:57.141863 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:57.141850 2559 scope.go:117] "RemoveContainer" containerID="cac2c11fa79d06f900351bb383e2803df71fea6d1740452390abb0c1297c0913" Jun 10 01:04:58.148028 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:58.147993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wq5md" event={"ID":"10b9d554-7435-4079-a806-b6f8fee6eaf3","Type":"ContainerStarted","Data":"4bb87669299685001dd486b98fe24a59e5c958c99493309c967c2386dac755ff"} Jun 10 01:04:58.915086 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:58.915046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:04:58.917400 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:58.917369 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3853474-e016-40cd-a700-d65cc29d3a7f-metrics-tls\") pod \"dns-default-jtqw4\" (UID: \"d3853474-e016-40cd-a700-d65cc29d3a7f\") " pod="openshift-dns/dns-default-jtqw4" Jun 10 01:04:59.139070 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.139035 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vqpqf\"" Jun 10 01:04:59.147925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.147896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtqw4" Jun 10 01:04:59.282935 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.282899 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtqw4"] Jun 10 01:04:59.286419 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:04:59.286392 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3853474_e016_40cd_a700_d65cc29d3a7f.slice/crio-490b239ddd929aecabff0f24ddfc5af81278c5ee6307c752fdca7a4be986510d WatchSource:0}: Error finding container 490b239ddd929aecabff0f24ddfc5af81278c5ee6307c752fdca7a4be986510d: Status 404 returned error can't find the container with id 490b239ddd929aecabff0f24ddfc5af81278c5ee6307c752fdca7a4be986510d Jun 10 01:04:59.639649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.639623 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:04:59.722126 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722088 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-serving-cert\") pod \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " Jun 10 01:04:59.722322 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722137 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwpwm\" (UniqueName: \"kubernetes.io/projected/acd6b017-9f5a-4553-9bf1-3e6df4eea555-kube-api-access-xwpwm\") pod \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " Jun 10 01:04:59.722322 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722201 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-service-ca\") pod \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " Jun 10 01:04:59.722322 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722240 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-oauth-config\") pod \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " Jun 10 01:04:59.722489 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722427 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-oauth-serving-cert\") pod \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " Jun 10 01:04:59.722566 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722510 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-config\") pod \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\" (UID: \"acd6b017-9f5a-4553-9bf1-3e6df4eea555\") " Jun 10 01:04:59.722886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722683 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-service-ca" (OuterVolumeSpecName: "service-ca") pod "acd6b017-9f5a-4553-9bf1-3e6df4eea555" (UID: "acd6b017-9f5a-4553-9bf1-3e6df4eea555"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:04:59.723018 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722792 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "acd6b017-9f5a-4553-9bf1-3e6df4eea555" (UID: "acd6b017-9f5a-4553-9bf1-3e6df4eea555"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:04:59.723018 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.722971 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-config" (OuterVolumeSpecName: "console-config") pod "acd6b017-9f5a-4553-9bf1-3e6df4eea555" (UID: "acd6b017-9f5a-4553-9bf1-3e6df4eea555"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:04:59.723233 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.723191 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-service-ca\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:59.724884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.724855 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "acd6b017-9f5a-4553-9bf1-3e6df4eea555" (UID: "acd6b017-9f5a-4553-9bf1-3e6df4eea555"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:04:59.725285 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.725263 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "acd6b017-9f5a-4553-9bf1-3e6df4eea555" (UID: "acd6b017-9f5a-4553-9bf1-3e6df4eea555"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:04:59.725402 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.725286 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd6b017-9f5a-4553-9bf1-3e6df4eea555-kube-api-access-xwpwm" (OuterVolumeSpecName: "kube-api-access-xwpwm") pod "acd6b017-9f5a-4553-9bf1-3e6df4eea555" (UID: "acd6b017-9f5a-4553-9bf1-3e6df4eea555"). InnerVolumeSpecName "kube-api-access-xwpwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:04:59.823731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.823653 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:59.823731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.823684 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwpwm\" (UniqueName: \"kubernetes.io/projected/acd6b017-9f5a-4553-9bf1-3e6df4eea555-kube-api-access-xwpwm\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:59.823731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.823697 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-oauth-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:59.823731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.823706 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-oauth-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:04:59.823731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:04:59.823715 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acd6b017-9f5a-4553-9bf1-3e6df4eea555-console-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:00.156645 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.156610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtqw4" event={"ID":"d3853474-e016-40cd-a700-d65cc29d3a7f","Type":"ContainerStarted","Data":"490b239ddd929aecabff0f24ddfc5af81278c5ee6307c752fdca7a4be986510d"} Jun 10 01:05:00.157868 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.157839 2559 generic.go:356] "Generic (PLEG): container finished" podID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" containerID="8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592" exitCode=0 Jun 10 01:05:00.158010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.157879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8467bbf88f-bmjx2" event={"ID":"acd6b017-9f5a-4553-9bf1-3e6df4eea555","Type":"ContainerDied","Data":"8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592"} Jun 10 01:05:00.158010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.157916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8467bbf88f-bmjx2" event={"ID":"acd6b017-9f5a-4553-9bf1-3e6df4eea555","Type":"ContainerDied","Data":"1fb95928b577fb04643ced4de73b0d6cc26af1e1d48638e6bd863c2a7cdec4a2"} Jun 10 01:05:00.158010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.157943 2559 scope.go:117] "RemoveContainer" containerID="8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592" Jun 10 01:05:00.158010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.157882 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8467bbf88f-bmjx2" Jun 10 01:05:00.166402 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.166380 2559 scope.go:117] "RemoveContainer" containerID="8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592" Jun 10 01:05:00.166696 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:00.166675 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592\": container with ID starting with 8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592 not found: ID does not exist" containerID="8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592" Jun 10 01:05:00.166763 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.166709 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592"} err="failed to get container status \"8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592\": rpc error: code = NotFound desc = could not find container \"8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592\": container with ID starting with 8753ec7b2bb7a000408ee08385941bba52b6ab6a0de87f924e1f8b54ba5f2592 not found: ID does not exist" Jun 10 01:05:00.173413 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.173388 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8467bbf88f-bmjx2"] Jun 10 01:05:00.178779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:00.178756 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8467bbf88f-bmjx2"] Jun 10 01:05:02.066072 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.066040 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" path="/var/lib/kubelet/pods/acd6b017-9f5a-4553-9bf1-3e6df4eea555/volumes" Jun 10 01:05:02.124244 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.124217 2559 patch_prober.go:28] interesting pod/console-868b967d6d-bkchg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jun 10 01:05:02.124408 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.124261 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-868b967d6d-bkchg" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jun 10 01:05:02.168777 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.168748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtqw4" event={"ID":"d3853474-e016-40cd-a700-d65cc29d3a7f","Type":"ContainerStarted","Data":"d7be9648c3831271728342f0add459037066b29f85a4aa40e1f29bbb9f70dc16"} Jun 10 01:05:02.170277 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.170251 2559 generic.go:356] "Generic (PLEG): container finished" podID="56ee282c-0a32-4e92-853e-56294527d1d2" containerID="7939ab18b87a0cddb855eb3eebdcf05bcf9556871132047dbe364787f9446d36" exitCode=0 Jun 10 01:05:02.170424 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.170327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k5sjt" event={"ID":"56ee282c-0a32-4e92-853e-56294527d1d2","Type":"ContainerDied","Data":"7939ab18b87a0cddb855eb3eebdcf05bcf9556871132047dbe364787f9446d36"} Jun 10 01:05:02.170743 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.170724 2559 scope.go:117] "RemoveContainer" containerID="7939ab18b87a0cddb855eb3eebdcf05bcf9556871132047dbe364787f9446d36" Jun 10 01:05:02.172135 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.172113 2559 generic.go:356] "Generic (PLEG): container finished" podID="c612b621-d8b7-4a0c-b10a-2b0804778825" containerID="2c3ad84d3a251170aeb81f52e4389c8b09d43ce8837c956b1d6adfbb495691f4" exitCode=0 Jun 10 01:05:02.172228 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.172163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" event={"ID":"c612b621-d8b7-4a0c-b10a-2b0804778825","Type":"ContainerDied","Data":"2c3ad84d3a251170aeb81f52e4389c8b09d43ce8837c956b1d6adfbb495691f4"} Jun 10 01:05:02.172479 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:02.172463 2559 scope.go:117] "RemoveContainer" containerID="2c3ad84d3a251170aeb81f52e4389c8b09d43ce8837c956b1d6adfbb495691f4" Jun 10 01:05:03.182001 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:03.181964 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtqw4" event={"ID":"d3853474-e016-40cd-a700-d65cc29d3a7f","Type":"ContainerStarted","Data":"97897178151e5a7709eb967e2f49bb9acabbfb0abf5820f696cd575a9f826529"} Jun 10 01:05:03.182470 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:03.182077 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jtqw4" Jun 10 01:05:03.184015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:03.183993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k5sjt" event={"ID":"56ee282c-0a32-4e92-853e-56294527d1d2","Type":"ContainerStarted","Data":"6f68f3a1971a465e75f0946f8e87b7b8cef9b151efa58ea565a3e2f6c9acba78"} Jun 10 01:05:03.185782 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:03.185761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fnxsr" event={"ID":"c612b621-d8b7-4a0c-b10a-2b0804778825","Type":"ContainerStarted","Data":"bc2fbf73dd37d3666617c3167da00bcf54a66c36a3ff49c51c66dab9acdf3d8c"} Jun 10 01:05:03.200791 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:03.200748 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jtqw4" podStartSLOduration=252.627740088 podStartE2EDuration="4m15.200734375s" totalImagesPullingTime="2.572994287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:03.199470925 +0000 UTC m=+287.628352456" watchObservedRunningTime="2026-06-10 01:05:03.200734375 +0000 UTC m=+287.629615892" Jun 10 01:05:04.181072 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:04.181035 2559 patch_prober.go:28] interesting pod/image-registry-85c9797f77-xzt64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:05:04.181361 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:04.181095 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:05:05.334533 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:05.334500 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/init-config-reloader/0.log" Jun 10 01:05:05.532464 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:05.532438 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/alertmanager/0.log" Jun 10 01:05:05.733656 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:05.733626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/config-reloader/0.log" Jun 10 01:05:05.934502 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:05.934463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/kube-rbac-proxy-web/0.log" Jun 10 01:05:06.132226 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:06.132140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/kube-rbac-proxy/0.log" Jun 10 01:05:06.332505 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:06.332472 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/kube-rbac-proxy-metric/0.log" Jun 10 01:05:06.532581 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:06.532552 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e8e16656-e2dd-4d7a-a344-2d0b95072b02/prom-label-proxy/0.log" Jun 10 01:05:07.092802 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:07.092770 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:05:07.096864 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:07.096834 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-744cfd5df7-k7hd8" Jun 10 01:05:07.532786 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:07.532757 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-744cfd5df7-k7hd8_333deffa-ff11-4271-8a08-a99293395962/metrics-server/0.log" Jun 10 01:05:07.732722 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:07.732691 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kv4rr_c4d5f505-d01f-4ab0-8661-6042103fe289/monitoring-plugin/0.log" Jun 10 01:05:07.936335 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:07.936289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht4j8_fbb49ece-903b-479e-934f-81e8b2d0aa70/init-textfile/0.log" Jun 10 01:05:08.132754 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:08.132723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht4j8_fbb49ece-903b-479e-934f-81e8b2d0aa70/node-exporter/0.log" Jun 10 01:05:08.332434 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:08.332361 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht4j8_fbb49ece-903b-479e-934f-81e8b2d0aa70/kube-rbac-proxy/0.log" Jun 10 01:05:09.732102 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:09.732072 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vz2tb_044a63c6-4695-4678-9033-7c6eab6cb7be/kube-rbac-proxy-main/0.log" Jun 10 01:05:09.932070 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:09.932045 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vz2tb_044a63c6-4695-4678-9033-7c6eab6cb7be/kube-rbac-proxy-self/0.log" Jun 10 01:05:10.133093 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:10.133018 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vz2tb_044a63c6-4695-4678-9033-7c6eab6cb7be/openshift-state-metrics/0.log" Jun 10 01:05:12.128309 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:12.128271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:05:12.132138 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:12.132119 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:05:12.134875 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:12.134851 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-t6r6h_2857c0fa-9b8f-42e0-863a-d8cbcd003505/prometheus-operator-admission-webhook/0.log" Jun 10 01:05:13.192032 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:13.192004 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jtqw4" Jun 10 01:05:14.180904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:14.180871 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:05:14.336249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:14.336222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-868b967d6d-bkchg_818a4802-04cd-4056-a8b0-7c6466c88e4f/console/0.log" Jun 10 01:05:14.537968 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:14.537888 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hzzbn_ec801d56-280a-409a-8861-d999f87e9875/download-server/0.log" Jun 10 01:05:15.133546 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:15.133516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtqw4_d3853474-e016-40cd-a700-d65cc29d3a7f/dns/0.log" Jun 10 01:05:15.333121 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:15.333087 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtqw4_d3853474-e016-40cd-a700-d65cc29d3a7f/kube-rbac-proxy/0.log" Jun 10 01:05:16.013182 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:16.013160 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 01:05:16.132776 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:16.132632 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2z75_da58b347-1782-4582-a001-cf6a105aaad2/dns-node-resolver/0.log" Jun 10 01:05:16.733712 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:16.733666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85c9797f77-xzt64_bb51f020-fafe-479b-bfa7-8b6ef221db62/registry/0.log" Jun 10 01:05:17.333213 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:17.333174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sn29x_81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00/node-ca/0.log" Jun 10 01:05:17.935611 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:17.935580 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tsx8_deeaf967-c086-4420-8604-b16bca2c7936/serve-healthcheck-canary/0.log" Jun 10 01:05:19.196170 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:19.196120 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" podUID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerName="registry" containerID="cri-o://ce7df0a428567c23bf775d743491a2677870344c8025068454472834dcb65519" gracePeriod=30 Jun 10 01:05:21.265768 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:21.265728 2559 generic.go:356] "Generic (PLEG): container finished" podID="bb51f020-fafe-479b-bfa7-8b6ef221db62" containerID="ce7df0a428567c23bf775d743491a2677870344c8025068454472834dcb65519" exitCode=0 Jun 10 01:05:21.266196 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:21.265804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" event={"ID":"bb51f020-fafe-479b-bfa7-8b6ef221db62","Type":"ContainerDied","Data":"ce7df0a428567c23bf775d743491a2677870344c8025068454472834dcb65519"} Jun 10 01:05:21.266196 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:21.265866 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" event={"ID":"bb51f020-fafe-479b-bfa7-8b6ef221db62","Type":"ContainerStarted","Data":"291861564d686abe1d4fa8e0d5cc6d9568e9c54983a8b94f812e7f34b5d8c7e5"} Jun 10 01:05:21.266196 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:21.265890 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:05:42.278077 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.278047 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85c9797f77-xzt64" Jun 10 01:05:42.672193 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672164 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:05:42.672513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672488 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="alertmanager" containerID="cri-o://3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add" gracePeriod=120 Jun 10 01:05:42.672602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672558 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-web" containerID="cri-o://20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164" gracePeriod=120 Jun 10 01:05:42.672669 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672598 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="prom-label-proxy" containerID="cri-o://dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb" gracePeriod=120 Jun 10 01:05:42.672669 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672592 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="config-reloader" containerID="cri-o://31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb" gracePeriod=120 Jun 10 01:05:42.672669 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672543 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-metric" containerID="cri-o://912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488" gracePeriod=120 Jun 10 01:05:42.672832 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:42.672616 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy" containerID="cri-o://601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac" gracePeriod=120 Jun 10 01:05:43.358904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.358864 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb" exitCode=0 Jun 10 01:05:43.358904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.358892 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488" exitCode=0 Jun 10 01:05:43.358904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.358899 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac" exitCode=0 Jun 10 01:05:43.358904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.358904 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb" exitCode=0 Jun 10 01:05:43.358904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.358912 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add" exitCode=0 Jun 10 01:05:43.359435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.358935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb"} Jun 10 01:05:43.359435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.359029 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488"} Jun 10 01:05:43.359435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.359054 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac"} Jun 10 01:05:43.359435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.359081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb"} Jun 10 01:05:43.359435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.359103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add"} Jun 10 01:05:43.927368 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:43.927337 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.019518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019427 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019470 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-out\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019498 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-main-db\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019513 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-cluster-tls-config\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019536 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm2cm\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-kube-api-access-fm2cm\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019552 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-web-config\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019576 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-web\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019617 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019656 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-trusted-ca-bundle\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019697 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-volume\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019739 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019782 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-metrics-client-ca\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019811 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-tls-assets\") pod \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\" (UID: \"e8e16656-e2dd-4d7a-a344-2d0b95072b02\") " Jun 10 01:05:44.019860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.019846 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:05:44.020396 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.020063 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-main-db\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.020655 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.020595 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:44.020915 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.020888 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:05:44.022455 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.022417 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.022847 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.022810 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-out" (OuterVolumeSpecName: "config-out") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:05:44.022942 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.022871 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:05:44.023123 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.023093 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-kube-api-access-fm2cm" (OuterVolumeSpecName: "kube-api-access-fm2cm") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "kube-api-access-fm2cm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:05:44.023428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.023397 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.023825 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.023797 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-volume" (OuterVolumeSpecName: "config-volume") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.024200 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.024149 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.024364 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.024245 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.026951 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.026924 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.034664 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.034635 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-web-config" (OuterVolumeSpecName: "web-config") pod "e8e16656-e2dd-4d7a-a344-2d0b95072b02" (UID: "e8e16656-e2dd-4d7a-a344-2d0b95072b02"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:05:44.120783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120750 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-metrics-client-ca\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.120783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120778 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-tls-assets\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.120783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120789 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120798 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-out\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120807 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-cluster-tls-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120815 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm2cm\" (UniqueName: \"kubernetes.io/projected/e8e16656-e2dd-4d7a-a344-2d0b95072b02-kube-api-access-fm2cm\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120843 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-web-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120853 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120862 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-main-tls\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120870 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e16656-e2dd-4d7a-a344-2d0b95072b02-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120878 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-config-volume\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.121021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.120886 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e8e16656-e2dd-4d7a-a344-2d0b95072b02-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:05:44.366779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.366683 2559 generic.go:356] "Generic (PLEG): container finished" podID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerID="20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164" exitCode=0 Jun 10 01:05:44.366779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.366728 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164"} Jun 10 01:05:44.367320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.366779 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.367320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.366796 2559 scope.go:117] "RemoveContainer" containerID="dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb" Jun 10 01:05:44.367320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.366786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e8e16656-e2dd-4d7a-a344-2d0b95072b02","Type":"ContainerDied","Data":"ef3ac50fe674f978e484d90bd85be494fb18d799b4ec5936b5b00b87de6da9ae"} Jun 10 01:05:44.375439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.375416 2559 scope.go:117] "RemoveContainer" containerID="912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488" Jun 10 01:05:44.383248 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.383226 2559 scope.go:117] "RemoveContainer" containerID="601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac" Jun 10 01:05:44.386862 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.386839 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:05:44.390525 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.390499 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:05:44.391514 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.391497 2559 scope.go:117] "RemoveContainer" containerID="20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164" Jun 10 01:05:44.399008 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.398988 2559 scope.go:117] "RemoveContainer" containerID="31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb" Jun 10 01:05:44.406963 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.406942 2559 scope.go:117] "RemoveContainer" containerID="3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add" Jun 10 01:05:44.414460 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414435 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:05:44.414725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414713 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="config-reloader" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414726 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="config-reloader" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414734 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414740 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414746 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-metric" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414751 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-metric" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414760 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="prom-label-proxy" Jun 10 01:05:44.414767 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414766 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="prom-label-proxy" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414778 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" containerName="console" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414783 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" containerName="console" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414790 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerName="registry" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414795 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerName="registry" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414802 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-web" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414807 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-web" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414813 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="alertmanager" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414818 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="alertmanager" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414825 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="init-config-reloader" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414829 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="init-config-reloader" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414880 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="alertmanager" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414888 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="config-reloader" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414893 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-metric" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414901 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414909 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd6b017-9f5a-4553-9bf1-3e6df4eea555" containerName="console" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414915 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="kube-rbac-proxy-web" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414921 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" containerName="prom-label-proxy" Jun 10 01:05:44.414971 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.414927 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7d8a07-f2ca-45ad-b7c7-750a5d7125d2" containerName="registry" Jun 10 01:05:44.415619 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.415599 2559 scope.go:117] "RemoveContainer" containerID="90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d" Jun 10 01:05:44.420595 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.420576 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.422798 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.422767 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 01:05:44.422937 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.422850 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 01:05:44.422937 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.422911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 01:05:44.423234 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.422928 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 01:05:44.423234 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.423048 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lx5d9\"" Jun 10 01:05:44.423234 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.423178 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 01:05:44.423485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.423247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 01:05:44.423485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.423205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 01:05:44.423485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.423392 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 01:05:44.424018 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.423996 2559 scope.go:117] "RemoveContainer" containerID="dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb" Jun 10 01:05:44.424511 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.424473 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb\": container with ID starting with dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb not found: ID does not exist" containerID="dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb" Jun 10 01:05:44.424623 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.424512 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb"} err="failed to get container status \"dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb\": rpc error: code = NotFound desc = could not find container \"dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb\": container with ID starting with dd63cc11d4eee6ebc5d2c589695d576309e6248dbeea21f3b2716964b14f37fb not found: ID does not exist" Jun 10 01:05:44.424623 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.424538 2559 scope.go:117] "RemoveContainer" containerID="912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488" Jun 10 01:05:44.424846 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.424823 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488\": container with ID starting with 912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488 not found: ID does not exist" containerID="912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488" Jun 10 01:05:44.424927 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.424854 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488"} err="failed to get container status \"912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488\": rpc error: code = NotFound desc = could not find container \"912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488\": container with ID starting with 912073c8efba3d7050d90b5962c217db443684d97dbb8dc2b942bfed3df54488 not found: ID does not exist" Jun 10 01:05:44.424927 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.424878 2559 scope.go:117] "RemoveContainer" containerID="601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac" Jun 10 01:05:44.425135 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.425117 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac\": container with ID starting with 601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac not found: ID does not exist" containerID="601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac" Jun 10 01:05:44.425211 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.425138 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac"} err="failed to get container status \"601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac\": rpc error: code = NotFound desc = could not find container \"601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac\": container with ID starting with 601d31ff7e9c3fe83dc6a9da9820006a87eed46695919661f82ba763cd2a96ac not found: ID does not exist" Jun 10 01:05:44.425211 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.425152 2559 scope.go:117] "RemoveContainer" containerID="20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164" Jun 10 01:05:44.425451 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.425418 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164\": container with ID starting with 20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164 not found: ID does not exist" containerID="20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164" Jun 10 01:05:44.425519 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.425452 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164"} err="failed to get container status \"20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164\": rpc error: code = NotFound desc = could not find container \"20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164\": container with ID starting with 20bb57f7755f853bb0686b988dd24a91d26cb5faef44cff16ead8874c2f75164 not found: ID does not exist" Jun 10 01:05:44.425519 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.425470 2559 scope.go:117] "RemoveContainer" containerID="31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb" Jun 10 01:05:44.425750 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.425731 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb\": container with ID starting with 31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb not found: ID does not exist" containerID="31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb" Jun 10 01:05:44.425803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.425753 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb"} err="failed to get container status \"31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb\": rpc error: code = NotFound desc = could not find container \"31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb\": container with ID starting with 31d61a75ece177b8c4c10ce1fef3b44205a4c4b2474f176c4a63c3a3f13474bb not found: ID does not exist" Jun 10 01:05:44.425803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.425775 2559 scope.go:117] "RemoveContainer" containerID="3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add" Jun 10 01:05:44.426045 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.426023 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add\": container with ID starting with 3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add not found: ID does not exist" containerID="3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add" Jun 10 01:05:44.426104 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.426051 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add"} err="failed to get container status \"3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add\": rpc error: code = NotFound desc = could not find container \"3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add\": container with ID starting with 3e0b5759f53b886c833fb17f864eafc0fae94b060eb741de4a67eb193c9b2add not found: ID does not exist" Jun 10 01:05:44.426104 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.426072 2559 scope.go:117] "RemoveContainer" containerID="90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d" Jun 10 01:05:44.426342 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:05:44.426317 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d\": container with ID starting with 90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d not found: ID does not exist" containerID="90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d" Jun 10 01:05:44.426429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.426347 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d"} err="failed to get container status \"90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d\": rpc error: code = NotFound desc = could not find container \"90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d\": container with ID starting with 90dd878d6f229b3db20be06099572769dcc95a2a8521d5f152020e41fdd11f9d not found: ID does not exist" Jun 10 01:05:44.436526 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.430951 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 01:05:44.436526 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.435858 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:05:44.524254 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5pb\" (UniqueName: \"kubernetes.io/projected/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-kube-api-access-lg5pb\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524702 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524702 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524702 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524702 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-web-config\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524702 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.524851 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.524703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-config-out\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-web-config\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-config-out\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.625845 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.625759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5pb\" (UniqueName: \"kubernetes.io/projected/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-kube-api-access-lg5pb\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.626458 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.626432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.626692 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.626662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.627659 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.627280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.628743 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.628717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.628743 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.628734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-web-config\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.628907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.628779 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.628907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.628838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-config-out\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.628907 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.628873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.629020 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.628907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.629532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.629510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.629786 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.629769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.630696 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.630680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.632842 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.632822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5pb\" (UniqueName: \"kubernetes.io/projected/9cf13f2f-ccb7-4ddf-88d0-952c863162c2-kube-api-access-lg5pb\") pod \"alertmanager-main-0\" (UID: \"9cf13f2f-ccb7-4ddf-88d0-952c863162c2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.737958 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.737914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 01:05:44.878369 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:44.878121 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 01:05:44.880932 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:05:44.880900 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf13f2f_ccb7_4ddf_88d0_952c863162c2.slice/crio-f6291b56b5ba15838cae060480febf5fb3bbdebfbb589e0b70d3d22af2da0645 WatchSource:0}: Error finding container f6291b56b5ba15838cae060480febf5fb3bbdebfbb589e0b70d3d22af2da0645: Status 404 returned error can't find the container with id f6291b56b5ba15838cae060480febf5fb3bbdebfbb589e0b70d3d22af2da0645 Jun 10 01:05:45.375506 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:45.375470 2559 generic.go:356] "Generic (PLEG): container finished" podID="9cf13f2f-ccb7-4ddf-88d0-952c863162c2" containerID="0597ffe05a558dedba761aa065f87343023636981a06d78ed93b27014b015cfa" exitCode=0 Jun 10 01:05:45.375976 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:45.375525 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerDied","Data":"0597ffe05a558dedba761aa065f87343023636981a06d78ed93b27014b015cfa"} Jun 10 01:05:45.375976 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:45.375623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"f6291b56b5ba15838cae060480febf5fb3bbdebfbb589e0b70d3d22af2da0645"} Jun 10 01:05:46.064870 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.064837 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e16656-e2dd-4d7a-a344-2d0b95072b02" path="/var/lib/kubelet/pods/e8e16656-e2dd-4d7a-a344-2d0b95072b02/volumes" Jun 10 01:05:46.383550 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.383455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"3cc27e00b3817718589bb9061dd273653991bcd68e921a7e42b7a984190ca639"} Jun 10 01:05:46.383550 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.383530 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"5969e429232f22ab987436fec77cb5395a94356a90df68f07daf4fa423794730"} Jun 10 01:05:46.384067 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.383560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"1552b78bb27fb9cae814a67e9d14fc8f0889fa6cd5dad99a8ad160a635fd9dd3"} Jun 10 01:05:46.384067 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.383589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"0ecf7158cd96fe15068c093f4afc2f03760546f349910f86f525452f3e11d88f"} Jun 10 01:05:46.384067 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.383617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"ca9ae304dab2086e1e34107126ea40c2749b882597e4fabbc0bfc6f0d942a561"} Jun 10 01:05:46.384067 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.383642 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9cf13f2f-ccb7-4ddf-88d0-952c863162c2","Type":"ContainerStarted","Data":"43333d9547695f89af6c0045ebb5dba61a8cca5c10c917bab3ae006b0f57af2c"} Jun 10 01:05:46.407212 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.407153 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.390604877 podStartE2EDuration="2.407137498s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.532621ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:46.405794974 +0000 UTC m=+330.834676544" watchObservedRunningTime="2026-06-10 01:05:46.407137498 +0000 UTC m=+330.836019015" Jun 10 01:05:46.702875 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.702837 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85b7d568b6-frw7f"] Jun 10 01:05:46.707273 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.707253 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.710010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.709981 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4d9wr\"" Jun 10 01:05:46.710254 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.710226 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 01:05:46.710402 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.710379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 01:05:46.711622 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.711602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 01:05:46.712007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.711989 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 01:05:46.713863 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.713837 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 01:05:46.717631 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.717432 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 01:05:46.719085 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.719064 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b7d568b6-frw7f"] Jun 10 01:05:46.846566 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-serving-certs-ca-bundle\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846566 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m6xm\" (UniqueName: \"kubernetes.io/projected/dc547ca5-5463-4f76-bb51-bdf2365514f0-kube-api-access-4m6xm\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-secret-telemeter-client\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-metrics-client-ca\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-federate-client-tls\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846906 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.846906 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.846839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-telemeter-client-tls\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948272 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m6xm\" (UniqueName: \"kubernetes.io/projected/dc547ca5-5463-4f76-bb51-bdf2365514f0-kube-api-access-4m6xm\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948272 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948281 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-secret-telemeter-client\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-metrics-client-ca\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-federate-client-tls\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-telemeter-client-tls\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-serving-certs-ca-bundle\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.948583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.948566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.949206 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.949177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-metrics-client-ca\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.949364 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.949343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.949420 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.949381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc547ca5-5463-4f76-bb51-bdf2365514f0-serving-certs-ca-bundle\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.950916 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.950867 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-secret-telemeter-client\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.951011 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.950999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-federate-client-tls\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.951251 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.951228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.951356 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.951336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dc547ca5-5463-4f76-bb51-bdf2365514f0-telemeter-client-tls\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:46.955780 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:46.955730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m6xm\" (UniqueName: \"kubernetes.io/projected/dc547ca5-5463-4f76-bb51-bdf2365514f0-kube-api-access-4m6xm\") pod \"telemeter-client-85b7d568b6-frw7f\" (UID: \"dc547ca5-5463-4f76-bb51-bdf2365514f0\") " pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:47.023458 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:47.023415 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" Jun 10 01:05:47.160477 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:47.160357 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b7d568b6-frw7f"] Jun 10 01:05:47.164144 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:05:47.164113 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc547ca5_5463_4f76_bb51_bdf2365514f0.slice/crio-e48c15bb3922626bfd70dc5f40caba2b1b90c138ce9ec0cdd8ae4beae83b2677 WatchSource:0}: Error finding container e48c15bb3922626bfd70dc5f40caba2b1b90c138ce9ec0cdd8ae4beae83b2677: Status 404 returned error can't find the container with id e48c15bb3922626bfd70dc5f40caba2b1b90c138ce9ec0cdd8ae4beae83b2677 Jun 10 01:05:47.166146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:47.166130 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:05:47.389719 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:47.389626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" event={"ID":"dc547ca5-5463-4f76-bb51-bdf2365514f0","Type":"ContainerStarted","Data":"e48c15bb3922626bfd70dc5f40caba2b1b90c138ce9ec0cdd8ae4beae83b2677"} Jun 10 01:05:50.403979 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:50.403883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" event={"ID":"dc547ca5-5463-4f76-bb51-bdf2365514f0","Type":"ContainerStarted","Data":"2480e2cf77afe0c06e5c6e2a0f0d62d1b978a9bbfc3cf9026383e642fd4bdc9f"} Jun 10 01:05:50.403979 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:50.403952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" event={"ID":"dc547ca5-5463-4f76-bb51-bdf2365514f0","Type":"ContainerStarted","Data":"8d3cd70f78c19eb483d4a2fa68322a3f5ca15882b0e1f0611dfc20f2a3231aa2"} Jun 10 01:05:50.404461 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:50.403982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" event={"ID":"dc547ca5-5463-4f76-bb51-bdf2365514f0","Type":"ContainerStarted","Data":"af4559a16515a08734f9b20378026d291419d4f727c2cdb08c607be16c00cb92"} Jun 10 01:05:50.425379 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:50.425328 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85b7d568b6-frw7f" podStartSLOduration=1.465069752 podStartE2EDuration="4.425310312s" totalImagesPullingTime="2.96024056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:50.423385155 +0000 UTC m=+334.852266673" watchObservedRunningTime="2026-06-10 01:05:50.425310312 +0000 UTC m=+334.854192194" Jun 10 01:05:51.147931 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.147892 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b5f8d69f8-mxjjl"] Jun 10 01:05:51.151343 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.151323 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.160318 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.160280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5f8d69f8-mxjjl"] Jun 10 01:05:51.187530 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-oauth-config\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.187682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7k2b\" (UniqueName: \"kubernetes.io/projected/8a062046-7f62-49ef-bd87-95dc4897cb51-kube-api-access-l7k2b\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.187682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-service-ca\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.187682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-oauth-serving-cert\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.187682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-serving-cert\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.187682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-console-config\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.187853 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.187686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-trusted-ca-bundle\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288106 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-oauth-config\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288106 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7k2b\" (UniqueName: \"kubernetes.io/projected/8a062046-7f62-49ef-bd87-95dc4897cb51-kube-api-access-l7k2b\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-service-ca\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-oauth-serving-cert\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-serving-cert\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-console-config\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-trusted-ca-bundle\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.288985 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-console-config\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.289071 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.288985 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-oauth-serving-cert\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.289147 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.289123 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-service-ca\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.289231 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.289210 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-trusted-ca-bundle\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.290803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.290777 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-oauth-config\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.290881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.290846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-serving-cert\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.295226 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.295208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7k2b\" (UniqueName: \"kubernetes.io/projected/8a062046-7f62-49ef-bd87-95dc4897cb51-kube-api-access-l7k2b\") pod \"console-5b5f8d69f8-mxjjl\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.460498 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.460460 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:05:51.622489 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:51.622413 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5f8d69f8-mxjjl"] Jun 10 01:05:51.627594 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:05:51.627565 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a062046_7f62_49ef_bd87_95dc4897cb51.slice/crio-346543c9437e91708dd61cc9f25cef966473c98d39410128f68ca93800374321 WatchSource:0}: Error finding container 346543c9437e91708dd61cc9f25cef966473c98d39410128f68ca93800374321: Status 404 returned error can't find the container with id 346543c9437e91708dd61cc9f25cef966473c98d39410128f68ca93800374321 Jun 10 01:05:52.413773 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:52.413735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f8d69f8-mxjjl" event={"ID":"8a062046-7f62-49ef-bd87-95dc4897cb51","Type":"ContainerStarted","Data":"00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1"} Jun 10 01:05:52.413966 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:52.413784 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f8d69f8-mxjjl" event={"ID":"8a062046-7f62-49ef-bd87-95dc4897cb51","Type":"ContainerStarted","Data":"346543c9437e91708dd61cc9f25cef966473c98d39410128f68ca93800374321"} Jun 10 01:05:52.430616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:05:52.430570 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b5f8d69f8-mxjjl" podStartSLOduration=1.430554318 podStartE2EDuration="1.430554318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:52.429155271 +0000 UTC m=+336.858036789" watchObservedRunningTime="2026-06-10 01:05:52.430554318 +0000 UTC m=+336.859435836" Jun 10 01:06:01.460747 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:01.460712 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:06:01.461208 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:01.460764 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:06:01.465803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:01.465777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:06:02.462716 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:02.462687 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:06:02.509761 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:02.509723 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868b967d6d-bkchg"] Jun 10 01:06:27.530664 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.530620 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-868b967d6d-bkchg" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" containerID="cri-o://498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a" gracePeriod=15 Jun 10 01:06:27.781710 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.781638 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:06:27.905502 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905463 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-config\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.905712 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905555 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-oauth-serving-cert\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.905712 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905604 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-trusted-ca-bundle\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.905836 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905723 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-oauth-config\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.905836 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905788 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk2zz\" (UniqueName: \"kubernetes.io/projected/818a4802-04cd-4056-a8b0-7c6466c88e4f-kube-api-access-fk2zz\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.905836 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905833 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-serving-cert\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.906001 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905862 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-service-ca\") pod \"818a4802-04cd-4056-a8b0-7c6466c88e4f\" (UID: \"818a4802-04cd-4056-a8b0-7c6466c88e4f\") " Jun 10 01:06:27.906001 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905890 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-config" (OuterVolumeSpecName: "console-config") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:06:27.906001 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.905962 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:06:27.906139 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.906019 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:06:27.906189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.906136 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-trusted-ca-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:27.906189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.906152 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:27.906189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.906166 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-oauth-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:27.906443 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.906421 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-service-ca" (OuterVolumeSpecName: "service-ca") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:06:27.907953 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.907925 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:06:27.908058 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.907971 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818a4802-04cd-4056-a8b0-7c6466c88e4f-kube-api-access-fk2zz" (OuterVolumeSpecName: "kube-api-access-fk2zz") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "kube-api-access-fk2zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:06:27.908058 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:27.908014 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "818a4802-04cd-4056-a8b0-7c6466c88e4f" (UID: "818a4802-04cd-4056-a8b0-7c6466c88e4f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:06:28.007254 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.007215 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-oauth-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:28.007254 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.007248 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk2zz\" (UniqueName: \"kubernetes.io/projected/818a4802-04cd-4056-a8b0-7c6466c88e4f-kube-api-access-fk2zz\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:28.007254 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.007258 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/818a4802-04cd-4056-a8b0-7c6466c88e4f-console-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:28.007501 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.007267 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/818a4802-04cd-4056-a8b0-7c6466c88e4f-service-ca\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:06:28.569947 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.569905 2559 generic.go:356] "Generic (PLEG): container finished" podID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerID="498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a" exitCode=0 Jun 10 01:06:28.569947 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.569952 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868b967d6d-bkchg" Jun 10 01:06:28.570427 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.569994 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868b967d6d-bkchg" event={"ID":"818a4802-04cd-4056-a8b0-7c6466c88e4f","Type":"ContainerDied","Data":"498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a"} Jun 10 01:06:28.570427 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.570047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868b967d6d-bkchg" event={"ID":"818a4802-04cd-4056-a8b0-7c6466c88e4f","Type":"ContainerDied","Data":"a8024e336f3bd4623403faca9d8847856f1d1f531faa27ef8b9e5b919265fa10"} Jun 10 01:06:28.570427 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.570071 2559 scope.go:117] "RemoveContainer" containerID="498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a" Jun 10 01:06:28.580544 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.580521 2559 scope.go:117] "RemoveContainer" containerID="498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a" Jun 10 01:06:28.581040 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:06:28.581018 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a\": container with ID starting with 498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a not found: ID does not exist" containerID="498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a" Jun 10 01:06:28.581133 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.581051 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a"} err="failed to get container status \"498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a\": rpc error: code = NotFound desc = could not find container \"498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a\": container with ID starting with 498417a9f4643adf0ae86961c832aa14478d4868385d33c32d5fabe90c68159a not found: ID does not exist" Jun 10 01:06:28.585499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.585444 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868b967d6d-bkchg"] Jun 10 01:06:28.587340 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:28.587318 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868b967d6d-bkchg"] Jun 10 01:06:30.064883 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:06:30.064848 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" path="/var/lib/kubelet/pods/818a4802-04cd-4056-a8b0-7c6466c88e4f/volumes" Jun 10 01:07:08.689276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.689240 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677d446ddc-bj7ft"] Jun 10 01:07:08.689886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.689727 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" Jun 10 01:07:08.689886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.689748 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" Jun 10 01:07:08.689886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.689843 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="818a4802-04cd-4056-a8b0-7c6466c88e4f" containerName="console" Jun 10 01:07:08.692803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.692781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.702560 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.702537 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d446ddc-bj7ft"] Jun 10 01:07:08.744429 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-oauth-config\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.744651 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-trusted-ca-bundle\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.744651 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-oauth-serving-cert\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.744651 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-serving-cert\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.744651 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-service-ca\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.744651 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mrdt\" (UniqueName: \"kubernetes.io/projected/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-kube-api-access-8mrdt\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.744851 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.744696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-config\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845447 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-oauth-config\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-trusted-ca-bundle\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-oauth-serving-cert\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-serving-cert\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-service-ca\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mrdt\" (UniqueName: \"kubernetes.io/projected/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-kube-api-access-8mrdt\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.845657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.845633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-config\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.846384 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.846355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-service-ca\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.846507 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.846403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-config\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.846507 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.846452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-oauth-serving-cert\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.846638 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.846545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-trusted-ca-bundle\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.847985 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.847959 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-oauth-config\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.848127 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.848107 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-serving-cert\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:08.853692 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:08.853670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mrdt\" (UniqueName: \"kubernetes.io/projected/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-kube-api-access-8mrdt\") pod \"console-677d446ddc-bj7ft\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:09.002399 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:09.002284 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:09.150317 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:09.150278 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d446ddc-bj7ft"] Jun 10 01:07:09.153183 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:07:09.153156 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac3f969_7ece_4563_856a_3f2dbcdcaa43.slice/crio-fbb3699204e4ac5359375a67f8d5bcf3c6c356c3301a34a37f6f779c6c9fbd85 WatchSource:0}: Error finding container fbb3699204e4ac5359375a67f8d5bcf3c6c356c3301a34a37f6f779c6c9fbd85: Status 404 returned error can't find the container with id fbb3699204e4ac5359375a67f8d5bcf3c6c356c3301a34a37f6f779c6c9fbd85 Jun 10 01:07:09.740629 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:09.740589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d446ddc-bj7ft" event={"ID":"2ac3f969-7ece-4563-856a-3f2dbcdcaa43","Type":"ContainerStarted","Data":"8e268ed82a5bb21a40e7e5405cf54823b6f7d4073ebc18be942223e2905d84ea"} Jun 10 01:07:09.741042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:09.740649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d446ddc-bj7ft" event={"ID":"2ac3f969-7ece-4563-856a-3f2dbcdcaa43","Type":"ContainerStarted","Data":"fbb3699204e4ac5359375a67f8d5bcf3c6c356c3301a34a37f6f779c6c9fbd85"} Jun 10 01:07:09.756768 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:09.756707 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677d446ddc-bj7ft" podStartSLOduration=1.7566900159999999 podStartE2EDuration="1.756690016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:09.755587237 +0000 UTC m=+414.184468752" watchObservedRunningTime="2026-06-10 01:07:09.756690016 +0000 UTC m=+414.185571533" Jun 10 01:07:19.002729 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:19.002681 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:19.003210 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:19.002752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:19.007700 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:19.007677 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:19.786806 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:19.786777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:07:19.828236 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:19.828200 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5f8d69f8-mxjjl"] Jun 10 01:07:35.579732 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.579647 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4"] Jun 10 01:07:35.583176 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.583158 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.585547 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.585520 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:07:35.585547 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.585533 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:07:35.585748 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.585601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z785z\"" Jun 10 01:07:35.590649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.590405 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4"] Jun 10 01:07:35.674207 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.674166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfwb7\" (UniqueName: \"kubernetes.io/projected/6251975a-0fd0-4b86-921a-eb3069b4afca-kube-api-access-nfwb7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.674462 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.674227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.674462 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.674383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.775532 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.775488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfwb7\" (UniqueName: \"kubernetes.io/projected/6251975a-0fd0-4b86-921a-eb3069b4afca-kube-api-access-nfwb7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.775746 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.775547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.775746 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.775594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.775939 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.775923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.775993 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.775963 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.783437 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.783400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfwb7\" (UniqueName: \"kubernetes.io/projected/6251975a-0fd0-4b86-921a-eb3069b4afca-kube-api-access-nfwb7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:35.893380 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:35.893248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:07:36.026319 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:36.026227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4"] Jun 10 01:07:36.028586 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:07:36.028556 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6251975a_0fd0_4b86_921a_eb3069b4afca.slice/crio-cca2cd94bdbce76858c9b1b03146627e2e43037ba3d02417d6027df90fd108b8 WatchSource:0}: Error finding container cca2cd94bdbce76858c9b1b03146627e2e43037ba3d02417d6027df90fd108b8: Status 404 returned error can't find the container with id cca2cd94bdbce76858c9b1b03146627e2e43037ba3d02417d6027df90fd108b8 Jun 10 01:07:36.854194 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:36.854156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerStarted","Data":"cca2cd94bdbce76858c9b1b03146627e2e43037ba3d02417d6027df90fd108b8"} Jun 10 01:07:44.848434 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:44.848369 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b5f8d69f8-mxjjl" podUID="8a062046-7f62-49ef-bd87-95dc4897cb51" containerName="console" containerID="cri-o://00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1" gracePeriod=15 Jun 10 01:07:44.900237 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:44.900202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerStarted","Data":"25d334c2518e31c4887a61f69625e479edf34efd458459cced99109ed9d05a79"} Jun 10 01:07:45.091692 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.091665 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:07:45.154015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.153979 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-trusted-ca-bundle\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154204 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154025 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-oauth-serving-cert\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154204 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154064 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-console-config\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154204 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154084 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-oauth-config\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154204 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154121 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-serving-cert\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154204 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154147 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-service-ca\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154204 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154178 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7k2b\" (UniqueName: \"kubernetes.io/projected/8a062046-7f62-49ef-bd87-95dc4897cb51-kube-api-access-l7k2b\") pod \"8a062046-7f62-49ef-bd87-95dc4897cb51\" (UID: \"8a062046-7f62-49ef-bd87-95dc4897cb51\") " Jun 10 01:07:45.154534 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154475 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:45.154607 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154581 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-console-config" (OuterVolumeSpecName: "console-config") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:45.154665 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154609 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-trusted-ca-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.154665 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154638 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:45.154906 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.154878 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:45.156484 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.156449 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:45.156484 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.156466 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a062046-7f62-49ef-bd87-95dc4897cb51-kube-api-access-l7k2b" (OuterVolumeSpecName: "kube-api-access-l7k2b") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "kube-api-access-l7k2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:45.156630 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.156485 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a062046-7f62-49ef-bd87-95dc4897cb51" (UID: "8a062046-7f62-49ef-bd87-95dc4897cb51"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:45.255961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.255909 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-service-ca\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.255961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.255954 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7k2b\" (UniqueName: \"kubernetes.io/projected/8a062046-7f62-49ef-bd87-95dc4897cb51-kube-api-access-l7k2b\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.255961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.255964 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-oauth-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.255961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.255973 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a062046-7f62-49ef-bd87-95dc4897cb51-console-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.255961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.255981 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-oauth-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.256243 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.255989 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a062046-7f62-49ef-bd87-95dc4897cb51-console-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:07:45.906628 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.906590 2559 generic.go:356] "Generic (PLEG): container finished" podID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerID="25d334c2518e31c4887a61f69625e479edf34efd458459cced99109ed9d05a79" exitCode=0 Jun 10 01:07:45.907099 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.906670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerDied","Data":"25d334c2518e31c4887a61f69625e479edf34efd458459cced99109ed9d05a79"} Jun 10 01:07:45.907967 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.907942 2559 generic.go:356] "Generic (PLEG): container finished" podID="8a062046-7f62-49ef-bd87-95dc4897cb51" containerID="00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1" exitCode=0 Jun 10 01:07:45.908092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.907982 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5f8d69f8-mxjjl" Jun 10 01:07:45.908092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.907992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f8d69f8-mxjjl" event={"ID":"8a062046-7f62-49ef-bd87-95dc4897cb51","Type":"ContainerDied","Data":"00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1"} Jun 10 01:07:45.908092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.908031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5f8d69f8-mxjjl" event={"ID":"8a062046-7f62-49ef-bd87-95dc4897cb51","Type":"ContainerDied","Data":"346543c9437e91708dd61cc9f25cef966473c98d39410128f68ca93800374321"} Jun 10 01:07:45.908092 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.908061 2559 scope.go:117] "RemoveContainer" containerID="00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1" Jun 10 01:07:45.924610 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.924585 2559 scope.go:117] "RemoveContainer" containerID="00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1" Jun 10 01:07:45.924942 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:07:45.924920 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1\": container with ID starting with 00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1 not found: ID does not exist" containerID="00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1" Jun 10 01:07:45.924990 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.924952 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1"} err="failed to get container status \"00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1\": rpc error: code = NotFound desc = could not find container \"00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1\": container with ID starting with 00d8f283b64a67ec6a9a517a9c8b4f531d4f07854b3b054fde393ea2999924f1 not found: ID does not exist" Jun 10 01:07:45.939188 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.939159 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5f8d69f8-mxjjl"] Jun 10 01:07:45.942725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:45.942696 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b5f8d69f8-mxjjl"] Jun 10 01:07:46.065106 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:46.065020 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a062046-7f62-49ef-bd87-95dc4897cb51" path="/var/lib/kubelet/pods/8a062046-7f62-49ef-bd87-95dc4897cb51/volumes" Jun 10 01:07:48.924602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:48.924557 2559 generic.go:356] "Generic (PLEG): container finished" podID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerID="064c8780158374e9ba42cee70374e69ed725ea393861e1b525cd78d5bd626525" exitCode=0 Jun 10 01:07:48.924992 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:48.924625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerDied","Data":"064c8780158374e9ba42cee70374e69ed725ea393861e1b525cd78d5bd626525"} Jun 10 01:07:58.977741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:58.977697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerStarted","Data":"1a477bac2dc23e3f821237a676358fc174fd234c2b55887cd4453ac720be2b19"} Jun 10 01:07:58.994599 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:58.994395 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" podStartSLOduration=2.9286203 podStartE2EDuration="23.994377785s" totalImagesPullingTime="21.065757485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:07:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:58.993610136 +0000 UTC m=+463.422491655" watchObservedRunningTime="2026-06-10 01:07:58.994377785 +0000 UTC m=+463.423259304" Jun 10 01:07:59.984396 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:59.984359 2559 generic.go:356] "Generic (PLEG): container finished" podID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerID="1a477bac2dc23e3f821237a676358fc174fd234c2b55887cd4453ac720be2b19" exitCode=0 Jun 10 01:07:59.984786 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:07:59.984448 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerDied","Data":"1a477bac2dc23e3f821237a676358fc174fd234c2b55887cd4453ac720be2b19"} Jun 10 01:08:01.163727 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.163685 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:08:01.202240 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.202209 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-util\") pod \"6251975a-0fd0-4b86-921a-eb3069b4afca\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " Jun 10 01:08:01.202453 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.202263 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfwb7\" (UniqueName: \"kubernetes.io/projected/6251975a-0fd0-4b86-921a-eb3069b4afca-kube-api-access-nfwb7\") pod \"6251975a-0fd0-4b86-921a-eb3069b4afca\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " Jun 10 01:08:01.202453 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.202323 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-bundle\") pod \"6251975a-0fd0-4b86-921a-eb3069b4afca\" (UID: \"6251975a-0fd0-4b86-921a-eb3069b4afca\") " Jun 10 01:08:01.203338 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.203308 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-bundle" (OuterVolumeSpecName: "bundle") pod "6251975a-0fd0-4b86-921a-eb3069b4afca" (UID: "6251975a-0fd0-4b86-921a-eb3069b4afca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:01.204676 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.204642 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6251975a-0fd0-4b86-921a-eb3069b4afca-kube-api-access-nfwb7" (OuterVolumeSpecName: "kube-api-access-nfwb7") pod "6251975a-0fd0-4b86-921a-eb3069b4afca" (UID: "6251975a-0fd0-4b86-921a-eb3069b4afca"). InnerVolumeSpecName "kube-api-access-nfwb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:08:01.208057 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.208033 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-util" (OuterVolumeSpecName: "util") pod "6251975a-0fd0-4b86-921a-eb3069b4afca" (UID: "6251975a-0fd0-4b86-921a-eb3069b4afca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:01.303361 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.303261 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfwb7\" (UniqueName: \"kubernetes.io/projected/6251975a-0fd0-4b86-921a-eb3069b4afca-kube-api-access-nfwb7\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:01.303361 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.303311 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:01.303361 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.303322 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6251975a-0fd0-4b86-921a-eb3069b4afca-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:01.994870 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.994835 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" event={"ID":"6251975a-0fd0-4b86-921a-eb3069b4afca","Type":"ContainerDied","Data":"cca2cd94bdbce76858c9b1b03146627e2e43037ba3d02417d6027df90fd108b8"} Jun 10 01:08:01.995051 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.994880 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhjmx4" Jun 10 01:08:01.995051 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:01.994883 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cca2cd94bdbce76858c9b1b03146627e2e43037ba3d02417d6027df90fd108b8" Jun 10 01:08:08.504988 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.504950 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272"] Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505274 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a062046-7f62-49ef-bd87-95dc4897cb51" containerName="console" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505284 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a062046-7f62-49ef-bd87-95dc4897cb51" containerName="console" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505313 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="util" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505319 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="util" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505325 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="pull" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505330 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="pull" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505337 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="extract" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505344 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="extract" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505403 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6251975a-0fd0-4b86-921a-eb3069b4afca" containerName="extract" Jun 10 01:08:08.505492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.505412 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a062046-7f62-49ef-bd87-95dc4897cb51" containerName="console" Jun 10 01:08:08.508316 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.508286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.510734 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.510708 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-22k86\"" Jun 10 01:08:08.510881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.510745 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 01:08:08.510881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.510757 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:08:08.523172 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.523141 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272"] Jun 10 01:08:08.565289 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.565248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsxdj\" (UniqueName: \"kubernetes.io/projected/f1513b94-400b-49da-8673-697a347ed947-kube-api-access-zsxdj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l9272\" (UID: \"f1513b94-400b-49da-8673-697a347ed947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.565487 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.565341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1513b94-400b-49da-8673-697a347ed947-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l9272\" (UID: \"f1513b94-400b-49da-8673-697a347ed947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.666766 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.666722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsxdj\" (UniqueName: \"kubernetes.io/projected/f1513b94-400b-49da-8673-697a347ed947-kube-api-access-zsxdj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l9272\" (UID: \"f1513b94-400b-49da-8673-697a347ed947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.666942 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.666779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1513b94-400b-49da-8673-697a347ed947-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l9272\" (UID: \"f1513b94-400b-49da-8673-697a347ed947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.667101 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.667086 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1513b94-400b-49da-8673-697a347ed947-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l9272\" (UID: \"f1513b94-400b-49da-8673-697a347ed947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.674955 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.674923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsxdj\" (UniqueName: \"kubernetes.io/projected/f1513b94-400b-49da-8673-697a347ed947-kube-api-access-zsxdj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l9272\" (UID: \"f1513b94-400b-49da-8673-697a347ed947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.817398 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.817268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" Jun 10 01:08:08.955955 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:08.955918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272"] Jun 10 01:08:08.959504 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:08.959475 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1513b94_400b_49da_8673_697a347ed947.slice/crio-2c22a7021a0ed9d56894e6ccc97017382dbf129dd29f57353b85b1d0d0875360 WatchSource:0}: Error finding container 2c22a7021a0ed9d56894e6ccc97017382dbf129dd29f57353b85b1d0d0875360: Status 404 returned error can't find the container with id 2c22a7021a0ed9d56894e6ccc97017382dbf129dd29f57353b85b1d0d0875360 Jun 10 01:08:09.027137 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:09.027098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" event={"ID":"f1513b94-400b-49da-8673-697a347ed947","Type":"ContainerStarted","Data":"2c22a7021a0ed9d56894e6ccc97017382dbf129dd29f57353b85b1d0d0875360"} Jun 10 01:08:12.042590 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.042552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" event={"ID":"f1513b94-400b-49da-8673-697a347ed947","Type":"ContainerStarted","Data":"a944ddd1a075ba93fa88ada0f6d2df9b1e2e9c11e0a34dff11646f544934d684"} Jun 10 01:08:12.062280 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.062096 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l9272" podStartSLOduration=1.479597207 podStartE2EDuration="4.062075026s" totalImagesPullingTime="2.582477819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:12.061021864 +0000 UTC m=+476.489903383" watchObservedRunningTime="2026-06-10 01:08:12.062075026 +0000 UTC m=+476.490956545" Jun 10 01:08:12.727366 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.727326 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb"] Jun 10 01:08:12.730993 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.730972 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.733241 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.733217 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z785z\"" Jun 10 01:08:12.733353 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.733225 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:08:12.733945 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.733931 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:08:12.742037 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.742013 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb"] Jun 10 01:08:12.802192 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.802146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.802432 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.802271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.802432 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.802367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vtf\" (UniqueName: \"kubernetes.io/projected/a96b949a-0604-4d26-b3bc-60d245968aab-kube-api-access-62vtf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.903308 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.903263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.903513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.903342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vtf\" (UniqueName: \"kubernetes.io/projected/a96b949a-0604-4d26-b3bc-60d245968aab-kube-api-access-62vtf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.903513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.903374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.903752 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.903727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.903813 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.903753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:12.911949 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:12.911926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vtf\" (UniqueName: \"kubernetes.io/projected/a96b949a-0604-4d26-b3bc-60d245968aab-kube-api-access-62vtf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:13.040711 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.040625 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:13.183924 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.183894 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb"] Jun 10 01:08:13.186875 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:13.186847 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96b949a_0604_4d26_b3bc_60d245968aab.slice/crio-54c47214a84e7128f662c4ff22023be65fd9eb7099a5e3fe2a706bd383013ea3 WatchSource:0}: Error finding container 54c47214a84e7128f662c4ff22023be65fd9eb7099a5e3fe2a706bd383013ea3: Status 404 returned error can't find the container with id 54c47214a84e7128f662c4ff22023be65fd9eb7099a5e3fe2a706bd383013ea3 Jun 10 01:08:13.834316 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.834263 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh"] Jun 10 01:08:13.837585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.837562 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:13.839609 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.839582 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 01:08:13.840490 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.840471 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 01:08:13.840490 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.840479 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ljbww\"" Jun 10 01:08:13.845075 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.845049 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh"] Jun 10 01:08:13.912339 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.912272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8f074d8-4df5-4024-a7c8-6646787e36d1-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-dvbdh\" (UID: \"b8f074d8-4df5-4024-a7c8-6646787e36d1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:13.912540 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:13.912421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qstw4\" (UniqueName: \"kubernetes.io/projected/b8f074d8-4df5-4024-a7c8-6646787e36d1-kube-api-access-qstw4\") pod \"cert-manager-webhook-7dc76cbb94-dvbdh\" (UID: \"b8f074d8-4df5-4024-a7c8-6646787e36d1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:14.014023 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.013979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qstw4\" (UniqueName: \"kubernetes.io/projected/b8f074d8-4df5-4024-a7c8-6646787e36d1-kube-api-access-qstw4\") pod \"cert-manager-webhook-7dc76cbb94-dvbdh\" (UID: \"b8f074d8-4df5-4024-a7c8-6646787e36d1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:14.014206 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.014118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8f074d8-4df5-4024-a7c8-6646787e36d1-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-dvbdh\" (UID: \"b8f074d8-4df5-4024-a7c8-6646787e36d1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:14.022283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.022245 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8f074d8-4df5-4024-a7c8-6646787e36d1-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-dvbdh\" (UID: \"b8f074d8-4df5-4024-a7c8-6646787e36d1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:14.022421 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.022367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qstw4\" (UniqueName: \"kubernetes.io/projected/b8f074d8-4df5-4024-a7c8-6646787e36d1-kube-api-access-qstw4\") pod \"cert-manager-webhook-7dc76cbb94-dvbdh\" (UID: \"b8f074d8-4df5-4024-a7c8-6646787e36d1\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:14.059049 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.059016 2559 generic.go:356] "Generic (PLEG): container finished" podID="a96b949a-0604-4d26-b3bc-60d245968aab" containerID="9bd33514ed32ce35aa942fb19283f9e299b3d61e903a118bbf43d4ee68f012cb" exitCode=0 Jun 10 01:08:14.059228 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.059098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" event={"ID":"a96b949a-0604-4d26-b3bc-60d245968aab","Type":"ContainerDied","Data":"9bd33514ed32ce35aa942fb19283f9e299b3d61e903a118bbf43d4ee68f012cb"} Jun 10 01:08:14.059228 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.059172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" event={"ID":"a96b949a-0604-4d26-b3bc-60d245968aab","Type":"ContainerStarted","Data":"54c47214a84e7128f662c4ff22023be65fd9eb7099a5e3fe2a706bd383013ea3"} Jun 10 01:08:14.155560 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.155463 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:14.285989 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:14.285957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh"] Jun 10 01:08:14.289410 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:14.289382 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8f074d8_4df5_4024_a7c8_6646787e36d1.slice/crio-c5b96312633211b9d145ca121bfae62d240ee8620b1831e52046515302ea3a00 WatchSource:0}: Error finding container c5b96312633211b9d145ca121bfae62d240ee8620b1831e52046515302ea3a00: Status 404 returned error can't find the container with id c5b96312633211b9d145ca121bfae62d240ee8620b1831e52046515302ea3a00 Jun 10 01:08:15.065452 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:15.065418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" event={"ID":"b8f074d8-4df5-4024-a7c8-6646787e36d1","Type":"ContainerStarted","Data":"c5b96312633211b9d145ca121bfae62d240ee8620b1831e52046515302ea3a00"} Jun 10 01:08:19.086817 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.086772 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" event={"ID":"b8f074d8-4df5-4024-a7c8-6646787e36d1","Type":"ContainerStarted","Data":"a3755ac13fa4974f975f2a7415ac663b3e90a629539695c440e6179ce4a6c6a7"} Jun 10 01:08:19.087289 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.086906 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:19.100901 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.100846 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" podStartSLOduration=2.051275915 podStartE2EDuration="6.100830291s" totalImagesPullingTime="4.049554376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:19.100741783 +0000 UTC m=+483.529623297" watchObservedRunningTime="2026-06-10 01:08:19.100830291 +0000 UTC m=+483.529711809" Jun 10 01:08:19.765335 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.765278 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2"] Jun 10 01:08:19.769572 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.769553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:19.771693 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.771669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2v9bs\"" Jun 10 01:08:19.777547 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.777519 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2"] Jun 10 01:08:19.868614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.868568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-cjzl2\" (UID: \"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:19.868806 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.868624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxptr\" (UniqueName: \"kubernetes.io/projected/58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03-kube-api-access-rxptr\") pod \"cert-manager-cainjector-5d99449ffd-cjzl2\" (UID: \"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:19.969155 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.969107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-cjzl2\" (UID: \"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:19.969155 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.969164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxptr\" (UniqueName: \"kubernetes.io/projected/58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03-kube-api-access-rxptr\") pod \"cert-manager-cainjector-5d99449ffd-cjzl2\" (UID: \"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:19.976867 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.976840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-cjzl2\" (UID: \"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:19.977007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:19.976933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxptr\" (UniqueName: \"kubernetes.io/projected/58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03-kube-api-access-rxptr\") pod \"cert-manager-cainjector-5d99449ffd-cjzl2\" (UID: \"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:20.079814 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:20.079728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" Jun 10 01:08:20.217055 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:20.217018 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2"] Jun 10 01:08:20.220373 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:20.220341 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58ea7f69_2de8_4c6c_8a7d_35f36e7e7d03.slice/crio-509408626a98cdf65a7196e5fa8217f8d343626aa5349d3a4cd623dfa0d5adf7 WatchSource:0}: Error finding container 509408626a98cdf65a7196e5fa8217f8d343626aa5349d3a4cd623dfa0d5adf7: Status 404 returned error can't find the container with id 509408626a98cdf65a7196e5fa8217f8d343626aa5349d3a4cd623dfa0d5adf7 Jun 10 01:08:21.098167 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:21.098125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" event={"ID":"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03","Type":"ContainerStarted","Data":"af80f7c022df4e7478906039cba3cdfd2b4a7ee24628635bb138e60a9486e67d"} Jun 10 01:08:21.098167 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:21.098174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" event={"ID":"58ea7f69-2de8-4c6c-8a7d-35f36e7e7d03","Type":"ContainerStarted","Data":"509408626a98cdf65a7196e5fa8217f8d343626aa5349d3a4cd623dfa0d5adf7"} Jun 10 01:08:21.114697 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:21.114641 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cjzl2" podStartSLOduration=2.11462363 podStartE2EDuration="2.11462363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:21.112796546 +0000 UTC m=+485.541678075" watchObservedRunningTime="2026-06-10 01:08:21.11462363 +0000 UTC m=+485.543505149" Jun 10 01:08:25.094138 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:25.094099 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-dvbdh" Jun 10 01:08:27.129597 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:27.129505 2559 generic.go:356] "Generic (PLEG): container finished" podID="a96b949a-0604-4d26-b3bc-60d245968aab" containerID="16670b339ccc603c5a1d54f9ac6193b431b2847cf38407d6d7b5b7ebf24de883" exitCode=0 Jun 10 01:08:27.129597 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:27.129560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" event={"ID":"a96b949a-0604-4d26-b3bc-60d245968aab","Type":"ContainerDied","Data":"16670b339ccc603c5a1d54f9ac6193b431b2847cf38407d6d7b5b7ebf24de883"} Jun 10 01:08:28.136086 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:28.136048 2559 generic.go:356] "Generic (PLEG): container finished" podID="a96b949a-0604-4d26-b3bc-60d245968aab" containerID="33cccae859104b2f7c9843d6351b4b17d57c546b5baa1ed586f862168852a1fb" exitCode=0 Jun 10 01:08:28.136570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:28.136115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" event={"ID":"a96b949a-0604-4d26-b3bc-60d245968aab","Type":"ContainerDied","Data":"33cccae859104b2f7c9843d6351b4b17d57c546b5baa1ed586f862168852a1fb"} Jun 10 01:08:29.282633 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.282603 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:29.456923 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.456878 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-util\") pod \"a96b949a-0604-4d26-b3bc-60d245968aab\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " Jun 10 01:08:29.457146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.456938 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-bundle\") pod \"a96b949a-0604-4d26-b3bc-60d245968aab\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " Jun 10 01:08:29.457146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.456982 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62vtf\" (UniqueName: \"kubernetes.io/projected/a96b949a-0604-4d26-b3bc-60d245968aab-kube-api-access-62vtf\") pod \"a96b949a-0604-4d26-b3bc-60d245968aab\" (UID: \"a96b949a-0604-4d26-b3bc-60d245968aab\") " Jun 10 01:08:29.457449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.457414 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-bundle" (OuterVolumeSpecName: "bundle") pod "a96b949a-0604-4d26-b3bc-60d245968aab" (UID: "a96b949a-0604-4d26-b3bc-60d245968aab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:29.459088 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.459067 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96b949a-0604-4d26-b3bc-60d245968aab-kube-api-access-62vtf" (OuterVolumeSpecName: "kube-api-access-62vtf") pod "a96b949a-0604-4d26-b3bc-60d245968aab" (UID: "a96b949a-0604-4d26-b3bc-60d245968aab"). InnerVolumeSpecName "kube-api-access-62vtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:08:29.461616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.461589 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-util" (OuterVolumeSpecName: "util") pod "a96b949a-0604-4d26-b3bc-60d245968aab" (UID: "a96b949a-0604-4d26-b3bc-60d245968aab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:29.558087 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.558045 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:29.558087 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.558081 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96b949a-0604-4d26-b3bc-60d245968aab-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:29.558087 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:29.558092 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62vtf\" (UniqueName: \"kubernetes.io/projected/a96b949a-0604-4d26-b3bc-60d245968aab-kube-api-access-62vtf\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:30.146758 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:30.146716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" event={"ID":"a96b949a-0604-4d26-b3bc-60d245968aab","Type":"ContainerDied","Data":"54c47214a84e7128f662c4ff22023be65fd9eb7099a5e3fe2a706bd383013ea3"} Jun 10 01:08:30.146758 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:30.146758 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsltlb" Jun 10 01:08:30.147007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:30.146765 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54c47214a84e7128f662c4ff22023be65fd9eb7099a5e3fe2a706bd383013ea3" Jun 10 01:08:36.788770 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.788723 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b"] Jun 10 01:08:36.789267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789197 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="extract" Jun 10 01:08:36.789267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789215 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="extract" Jun 10 01:08:36.789267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789247 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="pull" Jun 10 01:08:36.789267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789255 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="pull" Jun 10 01:08:36.789509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789272 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="util" Jun 10 01:08:36.789509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789280 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="util" Jun 10 01:08:36.789509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.789391 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96b949a-0604-4d26-b3bc-60d245968aab" containerName="extract" Jun 10 01:08:36.792427 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.792406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:36.795179 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.795153 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:08:36.795795 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.795780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 01:08:36.795848 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.795806 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5898n\"" Jun 10 01:08:36.800004 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.799669 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b"] Jun 10 01:08:36.816854 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.816828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5ade506-87cd-4282-9858-aaaf5cf6bdc3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dpz5b\" (UID: \"f5ade506-87cd-4282-9858-aaaf5cf6bdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:36.817009 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.816859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6hb5\" (UniqueName: \"kubernetes.io/projected/f5ade506-87cd-4282-9858-aaaf5cf6bdc3-kube-api-access-p6hb5\") pod \"openshift-lws-operator-fd8ccff4c-dpz5b\" (UID: \"f5ade506-87cd-4282-9858-aaaf5cf6bdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:36.917779 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.917744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5ade506-87cd-4282-9858-aaaf5cf6bdc3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dpz5b\" (UID: \"f5ade506-87cd-4282-9858-aaaf5cf6bdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:36.917968 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.917785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6hb5\" (UniqueName: \"kubernetes.io/projected/f5ade506-87cd-4282-9858-aaaf5cf6bdc3-kube-api-access-p6hb5\") pod \"openshift-lws-operator-fd8ccff4c-dpz5b\" (UID: \"f5ade506-87cd-4282-9858-aaaf5cf6bdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:36.918133 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.918115 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5ade506-87cd-4282-9858-aaaf5cf6bdc3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dpz5b\" (UID: \"f5ade506-87cd-4282-9858-aaaf5cf6bdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:36.925501 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:36.925474 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6hb5\" (UniqueName: \"kubernetes.io/projected/f5ade506-87cd-4282-9858-aaaf5cf6bdc3-kube-api-access-p6hb5\") pod \"openshift-lws-operator-fd8ccff4c-dpz5b\" (UID: \"f5ade506-87cd-4282-9858-aaaf5cf6bdc3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:37.102393 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:37.102284 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" Jun 10 01:08:37.240575 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:37.240546 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b"] Jun 10 01:08:37.242665 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:37.242636 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5ade506_87cd_4282_9858_aaaf5cf6bdc3.slice/crio-97c37c2fc3bd90186ad631021028a75e3ca80bf1b1eae418b745ef19fba82962 WatchSource:0}: Error finding container 97c37c2fc3bd90186ad631021028a75e3ca80bf1b1eae418b745ef19fba82962: Status 404 returned error can't find the container with id 97c37c2fc3bd90186ad631021028a75e3ca80bf1b1eae418b745ef19fba82962 Jun 10 01:08:38.183549 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:38.183514 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" event={"ID":"f5ade506-87cd-4282-9858-aaaf5cf6bdc3","Type":"ContainerStarted","Data":"97c37c2fc3bd90186ad631021028a75e3ca80bf1b1eae418b745ef19fba82962"} Jun 10 01:08:41.198689 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:41.198640 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" event={"ID":"f5ade506-87cd-4282-9858-aaaf5cf6bdc3","Type":"ContainerStarted","Data":"515fc76327de7940ae8e92fe2e36ba1363cbe13eb78cb3e7985123e1804f142a"} Jun 10 01:08:41.214069 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:41.214012 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpz5b" podStartSLOduration=1.5516339160000001 podStartE2EDuration="5.21399743s" totalImagesPullingTime="3.662363514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:41.212752706 +0000 UTC m=+505.641634223" watchObservedRunningTime="2026-06-10 01:08:41.21399743 +0000 UTC m=+505.642878947" Jun 10 01:08:43.333663 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.333625 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w"] Jun 10 01:08:43.337495 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.337471 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.339694 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.339674 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:08:43.339819 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.339764 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:08:43.340511 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.340496 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z785z\"" Jun 10 01:08:43.344477 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.344451 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w"] Jun 10 01:08:43.374997 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.374954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvwlw\" (UniqueName: \"kubernetes.io/projected/04b5e6a9-514e-4b08-b05e-eb3bccd29244-kube-api-access-hvwlw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.375184 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.375084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.375184 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.375115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.476137 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.476088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.476137 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.476137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.476387 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.476191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvwlw\" (UniqueName: \"kubernetes.io/projected/04b5e6a9-514e-4b08-b05e-eb3bccd29244-kube-api-access-hvwlw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.476620 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.476600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.476661 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.476609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.484130 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.484097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvwlw\" (UniqueName: \"kubernetes.io/projected/04b5e6a9-514e-4b08-b05e-eb3bccd29244-kube-api-access-hvwlw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.649986 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.649888 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:43.783627 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:43.783569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w"] Jun 10 01:08:43.785806 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:43.785778 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b5e6a9_514e_4b08_b05e_eb3bccd29244.slice/crio-2e552b1f0bf03227eaf149de65e84b322129a869334aef8b1e755106d62ad2d9 WatchSource:0}: Error finding container 2e552b1f0bf03227eaf149de65e84b322129a869334aef8b1e755106d62ad2d9: Status 404 returned error can't find the container with id 2e552b1f0bf03227eaf149de65e84b322129a869334aef8b1e755106d62ad2d9 Jun 10 01:08:44.214013 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:44.213970 2559 generic.go:356] "Generic (PLEG): container finished" podID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerID="008881d9d4d4445458a0ecd38d04791fb9023095010b64a597690f3f25805fa9" exitCode=0 Jun 10 01:08:44.214202 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:44.214059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" event={"ID":"04b5e6a9-514e-4b08-b05e-eb3bccd29244","Type":"ContainerDied","Data":"008881d9d4d4445458a0ecd38d04791fb9023095010b64a597690f3f25805fa9"} Jun 10 01:08:44.214202 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:44.214117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" event={"ID":"04b5e6a9-514e-4b08-b05e-eb3bccd29244","Type":"ContainerStarted","Data":"2e552b1f0bf03227eaf149de65e84b322129a869334aef8b1e755106d62ad2d9"} Jun 10 01:08:45.221288 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:45.221192 2559 generic.go:356] "Generic (PLEG): container finished" podID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerID="d9ba7646ef21f0a7e4191e1767aea611955eb9020b0c8e023404caaaabec13f3" exitCode=0 Jun 10 01:08:45.221288 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:45.221222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" event={"ID":"04b5e6a9-514e-4b08-b05e-eb3bccd29244","Type":"ContainerDied","Data":"d9ba7646ef21f0a7e4191e1767aea611955eb9020b0c8e023404caaaabec13f3"} Jun 10 01:08:46.227834 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:46.227795 2559 generic.go:356] "Generic (PLEG): container finished" podID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerID="41b1319221c691b348d87927782ac2bbc73b9b86bf77758e264fccf8e8db9357" exitCode=0 Jun 10 01:08:46.228328 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:46.227879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" event={"ID":"04b5e6a9-514e-4b08-b05e-eb3bccd29244","Type":"ContainerDied","Data":"41b1319221c691b348d87927782ac2bbc73b9b86bf77758e264fccf8e8db9357"} Jun 10 01:08:47.368151 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.368123 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:47.422477 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.422438 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-bundle\") pod \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " Jun 10 01:08:47.422676 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.422487 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvwlw\" (UniqueName: \"kubernetes.io/projected/04b5e6a9-514e-4b08-b05e-eb3bccd29244-kube-api-access-hvwlw\") pod \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " Jun 10 01:08:47.422676 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.422508 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-util\") pod \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\" (UID: \"04b5e6a9-514e-4b08-b05e-eb3bccd29244\") " Jun 10 01:08:47.423130 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.423099 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-bundle" (OuterVolumeSpecName: "bundle") pod "04b5e6a9-514e-4b08-b05e-eb3bccd29244" (UID: "04b5e6a9-514e-4b08-b05e-eb3bccd29244"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:47.424673 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.424649 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b5e6a9-514e-4b08-b05e-eb3bccd29244-kube-api-access-hvwlw" (OuterVolumeSpecName: "kube-api-access-hvwlw") pod "04b5e6a9-514e-4b08-b05e-eb3bccd29244" (UID: "04b5e6a9-514e-4b08-b05e-eb3bccd29244"). InnerVolumeSpecName "kube-api-access-hvwlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:08:47.427862 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.427834 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-util" (OuterVolumeSpecName: "util") pod "04b5e6a9-514e-4b08-b05e-eb3bccd29244" (UID: "04b5e6a9-514e-4b08-b05e-eb3bccd29244"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:47.523570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.523480 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:47.523570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.523514 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvwlw\" (UniqueName: \"kubernetes.io/projected/04b5e6a9-514e-4b08-b05e-eb3bccd29244-kube-api-access-hvwlw\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:47.523570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:47.523527 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b5e6a9-514e-4b08-b05e-eb3bccd29244-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:08:48.142826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.142784 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4"] Jun 10 01:08:48.143146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143133 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="extract" Jun 10 01:08:48.143198 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143149 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="extract" Jun 10 01:08:48.143198 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143170 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="util" Jun 10 01:08:48.143198 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143176 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="util" Jun 10 01:08:48.143198 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143183 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="pull" Jun 10 01:08:48.143198 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143189 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="pull" Jun 10 01:08:48.143396 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.143243 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="04b5e6a9-514e-4b08-b05e-eb3bccd29244" containerName="extract" Jun 10 01:08:48.146497 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.146479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.149612 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.149588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xz7ws\"" Jun 10 01:08:48.149916 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.149901 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 01:08:48.150789 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.150773 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 01:08:48.151583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.151565 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 01:08:48.160253 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.160225 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4"] Jun 10 01:08:48.230886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.230844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d9cac9a-9ef4-40dd-8234-65aecf41c715-cert\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.230886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.230896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d9cac9a-9ef4-40dd-8234-65aecf41c715-manager-config\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.231161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.230916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d9cac9a-9ef4-40dd-8234-65aecf41c715-metrics-cert\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.231161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.230973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds7ns\" (UniqueName: \"kubernetes.io/projected/1d9cac9a-9ef4-40dd-8234-65aecf41c715-kube-api-access-ds7ns\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.238636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.238609 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" Jun 10 01:08:48.238805 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.238643 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdb6w" event={"ID":"04b5e6a9-514e-4b08-b05e-eb3bccd29244","Type":"ContainerDied","Data":"2e552b1f0bf03227eaf149de65e84b322129a869334aef8b1e755106d62ad2d9"} Jun 10 01:08:48.238805 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.238688 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e552b1f0bf03227eaf149de65e84b322129a869334aef8b1e755106d62ad2d9" Jun 10 01:08:48.332508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.332403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d9cac9a-9ef4-40dd-8234-65aecf41c715-cert\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.332508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.332461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d9cac9a-9ef4-40dd-8234-65aecf41c715-manager-config\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.332508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.332482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d9cac9a-9ef4-40dd-8234-65aecf41c715-metrics-cert\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.332805 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.332517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds7ns\" (UniqueName: \"kubernetes.io/projected/1d9cac9a-9ef4-40dd-8234-65aecf41c715-kube-api-access-ds7ns\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.333197 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.333173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d9cac9a-9ef4-40dd-8234-65aecf41c715-manager-config\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.335336 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.335313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d9cac9a-9ef4-40dd-8234-65aecf41c715-metrics-cert\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.335387 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.335322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d9cac9a-9ef4-40dd-8234-65aecf41c715-cert\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.344928 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.344899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds7ns\" (UniqueName: \"kubernetes.io/projected/1d9cac9a-9ef4-40dd-8234-65aecf41c715-kube-api-access-ds7ns\") pod \"lws-controller-manager-dcf7bd6dd-qhjj4\" (UID: \"1d9cac9a-9ef4-40dd-8234-65aecf41c715\") " pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.456342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.456284 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:48.592649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:48.592623 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4"] Jun 10 01:08:48.594673 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:08:48.594646 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9cac9a_9ef4_40dd_8234_65aecf41c715.slice/crio-9afbd5e790070fde92ba7d5b4c928c1f5d9a8c533563172fab3bfbc53206f750 WatchSource:0}: Error finding container 9afbd5e790070fde92ba7d5b4c928c1f5d9a8c533563172fab3bfbc53206f750: Status 404 returned error can't find the container with id 9afbd5e790070fde92ba7d5b4c928c1f5d9a8c533563172fab3bfbc53206f750 Jun 10 01:08:49.244752 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:49.244709 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" event={"ID":"1d9cac9a-9ef4-40dd-8234-65aecf41c715","Type":"ContainerStarted","Data":"9afbd5e790070fde92ba7d5b4c928c1f5d9a8c533563172fab3bfbc53206f750"} Jun 10 01:08:52.260232 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:52.260191 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" event={"ID":"1d9cac9a-9ef4-40dd-8234-65aecf41c715","Type":"ContainerStarted","Data":"bfd50fe2d40ea2aa99c17a30250374573ce28fb2772df4478938c03118c132d3"} Jun 10 01:08:52.260671 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:52.260429 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:08:52.277048 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:52.276983 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" podStartSLOduration=1.174667852 podStartE2EDuration="4.276963311s" totalImagesPullingTime="3.102295459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:52.275030982 +0000 UTC m=+516.703912502" watchObservedRunningTime="2026-06-10 01:08:52.276963311 +0000 UTC m=+516.705844831" Jun 10 01:08:57.119151 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.119111 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp"] Jun 10 01:08:57.127980 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.127953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.130380 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.130351 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 01:08:57.130577 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.130406 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 01:08:57.130760 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.130738 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 01:08:57.130872 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.130787 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 01:08:57.131190 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.131173 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hm9zf\"" Jun 10 01:08:57.149790 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.149762 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp"] Jun 10 01:08:57.217168 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.217133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-tmp\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.217373 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.217183 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.217373 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.217242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-manifests\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.217373 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.217276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gv5h\" (UniqueName: \"kubernetes.io/projected/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-kube-api-access-6gv5h\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.217525 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.217381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.318364 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.318249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.318364 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.318340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-tmp\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.318668 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.318376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.318668 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.318412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-manifests\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.318668 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.318453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gv5h\" (UniqueName: \"kubernetes.io/projected/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-kube-api-access-6gv5h\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.318889 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.318858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-manifests\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.320734 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.320701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-tmp\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.320941 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.320920 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.321024 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.321004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.331018 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.330992 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gv5h\" (UniqueName: \"kubernetes.io/projected/0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7-kube-api-access-6gv5h\") pod \"opendatahub-operator-controller-manager-858fd5d86-rgtnp\" (UID: \"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7\") " pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.439824 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.439788 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:08:57.589634 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:57.589587 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp"] Jun 10 01:08:58.292739 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:08:58.292656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" event={"ID":"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7","Type":"ContainerStarted","Data":"23aed328f320e639a6f09534a523d56b1971cbafc12d2ea0a410f1baaf94fb05"} Jun 10 01:09:01.312589 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:01.312549 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" event={"ID":"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7","Type":"ContainerStarted","Data":"266ee09468bce7cb794adba5fda60d549085a0f10e7da56f86221a3f8cecabe8"} Jun 10 01:09:02.319107 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:02.319071 2559 generic.go:356] "Generic (PLEG): container finished" podID="0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7" containerID="266ee09468bce7cb794adba5fda60d549085a0f10e7da56f86221a3f8cecabe8" exitCode=0 Jun 10 01:09:02.319526 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:02.319165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" event={"ID":"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7","Type":"ContainerDied","Data":"266ee09468bce7cb794adba5fda60d549085a0f10e7da56f86221a3f8cecabe8"} Jun 10 01:09:03.267468 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:03.267371 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dcf7bd6dd-qhjj4" Jun 10 01:09:03.328031 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:03.327991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" event={"ID":"0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7","Type":"ContainerStarted","Data":"3f2193a3efc7a7c24f67ba84f1228132ee5d26335755b0fba3d0f9973f0edfc1"} Jun 10 01:09:03.328535 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:03.328084 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:09:03.348218 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:03.348158 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" podStartSLOduration=1.7445155799999998 podStartE2EDuration="6.348131289s" totalImagesPullingTime="3.649393619s" totalInitContainerRuntime="954.22209ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:08:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:03.34650253 +0000 UTC m=+527.775384047" watchObservedRunningTime="2026-06-10 01:09:03.348131289 +0000 UTC m=+527.777012806" Jun 10 01:09:14.335063 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:14.335033 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-858fd5d86-rgtnp" Jun 10 01:09:20.087121 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.087076 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2"] Jun 10 01:09:20.101536 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.101502 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2"] Jun 10 01:09:20.101695 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.101623 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.104000 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.103978 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:09:20.104164 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.104024 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:09:20.104778 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.104754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z785z\"" Jun 10 01:09:20.127372 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.127336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgvg\" (UniqueName: \"kubernetes.io/projected/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-kube-api-access-6bgvg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.127549 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.127434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.127549 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.127532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.228452 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.228414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.228659 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.228568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.228659 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.228598 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgvg\" (UniqueName: \"kubernetes.io/projected/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-kube-api-access-6bgvg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.228886 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.228861 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.228947 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.228925 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.236805 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.236767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgvg\" (UniqueName: \"kubernetes.io/projected/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-kube-api-access-6bgvg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.411828 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.411744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:20.555773 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:20.555745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2"] Jun 10 01:09:20.557944 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:09:20.557915 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda236f74b_b086_4bbd_ab48_7929cbe9ce6a.slice/crio-e7f995df58f795de0aaa261f014d41a553d28c3202b9c8598a2b38197cdb3965 WatchSource:0}: Error finding container e7f995df58f795de0aaa261f014d41a553d28c3202b9c8598a2b38197cdb3965: Status 404 returned error can't find the container with id e7f995df58f795de0aaa261f014d41a553d28c3202b9c8598a2b38197cdb3965 Jun 10 01:09:21.420309 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:21.420241 2559 generic.go:356] "Generic (PLEG): container finished" podID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerID="c26f364709bd34d11fd27e96d3db3e54abaa2d19685cde1a5b8dd1dfa6703235" exitCode=0 Jun 10 01:09:21.420948 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:21.420336 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" event={"ID":"a236f74b-b086-4bbd-ab48-7929cbe9ce6a","Type":"ContainerDied","Data":"c26f364709bd34d11fd27e96d3db3e54abaa2d19685cde1a5b8dd1dfa6703235"} Jun 10 01:09:21.420948 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:21.420392 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" event={"ID":"a236f74b-b086-4bbd-ab48-7929cbe9ce6a","Type":"ContainerStarted","Data":"e7f995df58f795de0aaa261f014d41a553d28c3202b9c8598a2b38197cdb3965"} Jun 10 01:09:23.434739 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:23.434705 2559 generic.go:356] "Generic (PLEG): container finished" podID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerID="917252e24cfd4be8d356f0953eb8be739aee975faf3fa81533b085b5b53f1d21" exitCode=0 Jun 10 01:09:23.434739 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:23.434744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" event={"ID":"a236f74b-b086-4bbd-ab48-7929cbe9ce6a","Type":"ContainerDied","Data":"917252e24cfd4be8d356f0953eb8be739aee975faf3fa81533b085b5b53f1d21"} Jun 10 01:09:24.448116 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:24.448081 2559 generic.go:356] "Generic (PLEG): container finished" podID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerID="1aff073d007391d457f7521da3b29b7fb61549d6603e1b844b033d17d3c81b3c" exitCode=0 Jun 10 01:09:24.448766 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:24.448265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" event={"ID":"a236f74b-b086-4bbd-ab48-7929cbe9ce6a","Type":"ContainerDied","Data":"1aff073d007391d457f7521da3b29b7fb61549d6603e1b844b033d17d3c81b3c"} Jun 10 01:09:25.591392 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.591364 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:25.685582 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.685542 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bgvg\" (UniqueName: \"kubernetes.io/projected/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-kube-api-access-6bgvg\") pod \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " Jun 10 01:09:25.685582 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.685581 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-util\") pod \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " Jun 10 01:09:25.685803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.685614 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-bundle\") pod \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\" (UID: \"a236f74b-b086-4bbd-ab48-7929cbe9ce6a\") " Jun 10 01:09:25.686555 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.686523 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-bundle" (OuterVolumeSpecName: "bundle") pod "a236f74b-b086-4bbd-ab48-7929cbe9ce6a" (UID: "a236f74b-b086-4bbd-ab48-7929cbe9ce6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:09:25.687744 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.687721 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-kube-api-access-6bgvg" (OuterVolumeSpecName: "kube-api-access-6bgvg") pod "a236f74b-b086-4bbd-ab48-7929cbe9ce6a" (UID: "a236f74b-b086-4bbd-ab48-7929cbe9ce6a"). InnerVolumeSpecName "kube-api-access-6bgvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:09:25.692546 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.692509 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-util" (OuterVolumeSpecName: "util") pod "a236f74b-b086-4bbd-ab48-7929cbe9ce6a" (UID: "a236f74b-b086-4bbd-ab48-7929cbe9ce6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:09:25.786442 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.786346 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bgvg\" (UniqueName: \"kubernetes.io/projected/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-kube-api-access-6bgvg\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:09:25.786442 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.786381 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:09:25.786442 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:25.786392 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a236f74b-b086-4bbd-ab48-7929cbe9ce6a-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:09:26.460908 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:26.460875 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" Jun 10 01:09:26.460908 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:26.460896 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sbhb2" event={"ID":"a236f74b-b086-4bbd-ab48-7929cbe9ce6a","Type":"ContainerDied","Data":"e7f995df58f795de0aaa261f014d41a553d28c3202b9c8598a2b38197cdb3965"} Jun 10 01:09:26.461168 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:26.460941 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7f995df58f795de0aaa261f014d41a553d28c3202b9c8598a2b38197cdb3965" Jun 10 01:09:34.890508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.890466 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x"] Jun 10 01:09:34.891015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.890949 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="pull" Jun 10 01:09:34.891015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.890964 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="pull" Jun 10 01:09:34.891015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.890994 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="extract" Jun 10 01:09:34.891015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.891003 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="extract" Jun 10 01:09:34.891148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.891019 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="util" Jun 10 01:09:34.891148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.891028 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="util" Jun 10 01:09:34.891148 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.891106 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a236f74b-b086-4bbd-ab48-7929cbe9ce6a" containerName="extract" Jun 10 01:09:34.894755 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.894730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:34.897272 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.897248 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:09:34.897966 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.897938 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z785z\"" Jun 10 01:09:34.898063 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.897990 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:09:34.909102 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.909074 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x"] Jun 10 01:09:34.967349 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.967288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:34.967527 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.967422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:34.967527 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:34.967471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/acc8832c-56b5-458c-8461-ca1dded8db77-kube-api-access-4pwvr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.068918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.068880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.069107 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.068978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.069107 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.069015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/acc8832c-56b5-458c-8461-ca1dded8db77-kube-api-access-4pwvr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.069432 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.069410 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.069477 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.069413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.078439 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.078406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/acc8832c-56b5-458c-8461-ca1dded8db77-kube-api-access-4pwvr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.204982 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.204941 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:35.350110 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.350079 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x"] Jun 10 01:09:35.352278 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:09:35.352250 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc8832c_56b5_458c_8461_ca1dded8db77.slice/crio-44e5628cb650d961fed189bf48c05eb96f5da4fbe9a04d172d9492e558b68180 WatchSource:0}: Error finding container 44e5628cb650d961fed189bf48c05eb96f5da4fbe9a04d172d9492e558b68180: Status 404 returned error can't find the container with id 44e5628cb650d961fed189bf48c05eb96f5da4fbe9a04d172d9492e558b68180 Jun 10 01:09:35.506034 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.505996 2559 generic.go:356] "Generic (PLEG): container finished" podID="acc8832c-56b5-458c-8461-ca1dded8db77" containerID="194131d261618069ad31d0db5e85b9cea28144d620459696609035c8750e863a" exitCode=0 Jun 10 01:09:35.506227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.506096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" event={"ID":"acc8832c-56b5-458c-8461-ca1dded8db77","Type":"ContainerDied","Data":"194131d261618069ad31d0db5e85b9cea28144d620459696609035c8750e863a"} Jun 10 01:09:35.506227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:35.506170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" event={"ID":"acc8832c-56b5-458c-8461-ca1dded8db77","Type":"ContainerStarted","Data":"44e5628cb650d961fed189bf48c05eb96f5da4fbe9a04d172d9492e558b68180"} Jun 10 01:09:37.520941 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:37.520902 2559 generic.go:356] "Generic (PLEG): container finished" podID="acc8832c-56b5-458c-8461-ca1dded8db77" containerID="05a90512b06c2807699d66f1374511c8294207d9dbb4426b0b8044ba6d176028" exitCode=0 Jun 10 01:09:37.521454 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:37.520949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" event={"ID":"acc8832c-56b5-458c-8461-ca1dded8db77","Type":"ContainerDied","Data":"05a90512b06c2807699d66f1374511c8294207d9dbb4426b0b8044ba6d176028"} Jun 10 01:09:38.527606 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:38.527571 2559 generic.go:356] "Generic (PLEG): container finished" podID="acc8832c-56b5-458c-8461-ca1dded8db77" containerID="1850bfec0d4e77b189a5bcced2151c5c9a68cf075991df78c68914082478bc72" exitCode=0 Jun 10 01:09:38.528045 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:38.527703 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" event={"ID":"acc8832c-56b5-458c-8461-ca1dded8db77","Type":"ContainerDied","Data":"1850bfec0d4e77b189a5bcced2151c5c9a68cf075991df78c68914082478bc72"} Jun 10 01:09:39.677759 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.677729 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:39.815330 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.815206 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-bundle\") pod \"acc8832c-56b5-458c-8461-ca1dded8db77\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " Jun 10 01:09:39.815330 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.815281 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/acc8832c-56b5-458c-8461-ca1dded8db77-kube-api-access-4pwvr\") pod \"acc8832c-56b5-458c-8461-ca1dded8db77\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " Jun 10 01:09:39.815591 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.815365 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-util\") pod \"acc8832c-56b5-458c-8461-ca1dded8db77\" (UID: \"acc8832c-56b5-458c-8461-ca1dded8db77\") " Jun 10 01:09:39.816215 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.816184 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-bundle" (OuterVolumeSpecName: "bundle") pod "acc8832c-56b5-458c-8461-ca1dded8db77" (UID: "acc8832c-56b5-458c-8461-ca1dded8db77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:09:39.817553 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.817532 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acc8832c-56b5-458c-8461-ca1dded8db77-kube-api-access-4pwvr" (OuterVolumeSpecName: "kube-api-access-4pwvr") pod "acc8832c-56b5-458c-8461-ca1dded8db77" (UID: "acc8832c-56b5-458c-8461-ca1dded8db77"). InnerVolumeSpecName "kube-api-access-4pwvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:09:39.822965 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.822937 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-util" (OuterVolumeSpecName: "util") pod "acc8832c-56b5-458c-8461-ca1dded8db77" (UID: "acc8832c-56b5-458c-8461-ca1dded8db77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:09:39.916215 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.916176 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pwvr\" (UniqueName: \"kubernetes.io/projected/acc8832c-56b5-458c-8461-ca1dded8db77-kube-api-access-4pwvr\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:09:39.916215 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.916208 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:09:39.916215 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:39.916220 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc8832c-56b5-458c-8461-ca1dded8db77-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:09:40.539985 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:40.539951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" event={"ID":"acc8832c-56b5-458c-8461-ca1dded8db77","Type":"ContainerDied","Data":"44e5628cb650d961fed189bf48c05eb96f5da4fbe9a04d172d9492e558b68180"} Jun 10 01:09:40.540173 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:40.539996 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvx9x" Jun 10 01:09:40.540173 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:40.540009 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44e5628cb650d961fed189bf48c05eb96f5da4fbe9a04d172d9492e558b68180" Jun 10 01:09:50.576150 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576112 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5"] Jun 10 01:09:50.576584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576500 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="extract" Jun 10 01:09:50.576584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576513 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="extract" Jun 10 01:09:50.576584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576522 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="pull" Jun 10 01:09:50.576584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576528 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="pull" Jun 10 01:09:50.576584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576537 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="util" Jun 10 01:09:50.576584 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576542 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="util" Jun 10 01:09:50.576802 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.576600 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="acc8832c-56b5-458c-8461-ca1dded8db77" containerName="extract" Jun 10 01:09:50.580217 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.580198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.582805 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.582780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 01:09:50.583187 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.583165 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 01:09:50.583304 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.583266 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-q986c\"" Jun 10 01:09:50.583655 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.583639 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 01:09:50.590320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.590263 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5"] Jun 10 01:09:50.716984 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.716940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.716984 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.716983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.717453 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.717323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg4gx\" (UniqueName: \"kubernetes.io/projected/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-kube-api-access-lg4gx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818366 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4gx\" (UniqueName: \"kubernetes.io/projected/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-kube-api-access-lg4gx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818694 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.818804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818760 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.819000 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.818899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.819431 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.819402 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.819626 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.819463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.819756 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.819562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.819756 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.819744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.821623 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.821600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.821974 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.821952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.826622 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.826558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.826920 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.826895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg4gx\" (UniqueName: \"kubernetes.io/projected/5f36dbe5-c05c-472d-8944-6bb58f2a8a24-kube-api-access-lg4gx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcnfzt5\" (UID: \"5f36dbe5-c05c-472d-8944-6bb58f2a8a24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:50.892676 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:50.892642 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:51.042349 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:51.042321 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5"] Jun 10 01:09:51.044367 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:09:51.044337 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f36dbe5_c05c_472d_8944_6bb58f2a8a24.slice/crio-cb5cf0e472f2131cd0bb6515b7b922b6ed105ffff12b9307e969df7b4fb1ace8 WatchSource:0}: Error finding container cb5cf0e472f2131cd0bb6515b7b922b6ed105ffff12b9307e969df7b4fb1ace8: Status 404 returned error can't find the container with id cb5cf0e472f2131cd0bb6515b7b922b6ed105ffff12b9307e969df7b4fb1ace8 Jun 10 01:09:51.600363 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:51.600324 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" event={"ID":"5f36dbe5-c05c-472d-8944-6bb58f2a8a24","Type":"ContainerStarted","Data":"cb5cf0e472f2131cd0bb6515b7b922b6ed105ffff12b9307e969df7b4fb1ace8"} Jun 10 01:09:54.867205 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:54.867154 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:09:54.867596 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:54.867263 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:09:54.867596 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:54.867358 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:09:55.625203 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:55.625160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" event={"ID":"5f36dbe5-c05c-472d-8944-6bb58f2a8a24","Type":"ContainerStarted","Data":"90e558355eb397b431c1766d3fafadaa2c3a3db8f7db022880aeece44ec9489f"} Jun 10 01:09:55.646897 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:55.646837 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" podStartSLOduration=1.826581232 podStartE2EDuration="5.646820158s" totalImagesPullingTime="3.820238926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:55.644508937 +0000 UTC m=+580.073390457" watchObservedRunningTime="2026-06-10 01:09:55.646820158 +0000 UTC m=+580.075701677" Jun 10 01:09:55.893618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:55.893510 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:55.898323 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:55.898277 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:56.005086 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.005042 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6c9bfb4667-pwphh"] Jun 10 01:09:56.011120 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.011086 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.014319 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.014269 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d44h2\"" Jun 10 01:09:56.014496 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.014337 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 01:09:56.014496 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.014346 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6c9bfb4667-pwphh"] Jun 10 01:09:56.069573 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.069534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np7ft\" (UniqueName: \"kubernetes.io/projected/5de3dba1-68bc-45fc-857a-71572e633382-kube-api-access-np7ft\") pod \"dashboard-redirect-6c9bfb4667-pwphh\" (UID: \"5de3dba1-68bc-45fc-857a-71572e633382\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.069751 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.069620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5de3dba1-68bc-45fc-857a-71572e633382-redirect-config\") pod \"dashboard-redirect-6c9bfb4667-pwphh\" (UID: \"5de3dba1-68bc-45fc-857a-71572e633382\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.170329 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.170206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np7ft\" (UniqueName: \"kubernetes.io/projected/5de3dba1-68bc-45fc-857a-71572e633382-kube-api-access-np7ft\") pod \"dashboard-redirect-6c9bfb4667-pwphh\" (UID: \"5de3dba1-68bc-45fc-857a-71572e633382\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.170329 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.170262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5de3dba1-68bc-45fc-857a-71572e633382-redirect-config\") pod \"dashboard-redirect-6c9bfb4667-pwphh\" (UID: \"5de3dba1-68bc-45fc-857a-71572e633382\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.171018 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.170997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5de3dba1-68bc-45fc-857a-71572e633382-redirect-config\") pod \"dashboard-redirect-6c9bfb4667-pwphh\" (UID: \"5de3dba1-68bc-45fc-857a-71572e633382\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.178164 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.178133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np7ft\" (UniqueName: \"kubernetes.io/projected/5de3dba1-68bc-45fc-857a-71572e633382-kube-api-access-np7ft\") pod \"dashboard-redirect-6c9bfb4667-pwphh\" (UID: \"5de3dba1-68bc-45fc-857a-71572e633382\") " pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.325131 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.325087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" Jun 10 01:09:56.464363 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.464332 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6c9bfb4667-pwphh"] Jun 10 01:09:56.466441 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:09:56.466413 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de3dba1_68bc_45fc_857a_71572e633382.slice/crio-6d3733e22f391cdbd12c897a4d8030c3d2df4fd43a71ac45d5f7395e9a2f9364 WatchSource:0}: Error finding container 6d3733e22f391cdbd12c897a4d8030c3d2df4fd43a71ac45d5f7395e9a2f9364: Status 404 returned error can't find the container with id 6d3733e22f391cdbd12c897a4d8030c3d2df4fd43a71ac45d5f7395e9a2f9364 Jun 10 01:09:56.631525 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.631492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" event={"ID":"5de3dba1-68bc-45fc-857a-71572e633382","Type":"ContainerStarted","Data":"6d3733e22f391cdbd12c897a4d8030c3d2df4fd43a71ac45d5f7395e9a2f9364"} Jun 10 01:09:56.631766 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.631747 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:56.632744 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:56.632728 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcnfzt5" Jun 10 01:09:59.648585 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:59.648547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" event={"ID":"5de3dba1-68bc-45fc-857a-71572e633382","Type":"ContainerStarted","Data":"e18a17601c9f64b71bca0c0b87444a6e196954c8f76fcdebd2c1d0f0b07c3637"} Jun 10 01:09:59.664560 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:09:59.664498 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6c9bfb4667-pwphh" podStartSLOduration=2.213162792 podStartE2EDuration="4.664480366s" totalImagesPullingTime="2.451317574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:59.662119826 +0000 UTC m=+584.091001344" watchObservedRunningTime="2026-06-10 01:09:59.664480366 +0000 UTC m=+584.093361883" Jun 10 01:10:18.054586 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.054549 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4gk"] Jun 10 01:10:18.058343 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.058324 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:18.061031 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.060996 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:10:18.061765 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.061741 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-npk8b\"" Jun 10 01:10:18.061904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.061769 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:10:18.068662 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.068497 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4gk"] Jun 10 01:10:18.182524 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.182490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4964\" (UniqueName: \"kubernetes.io/projected/26846746-3b73-4988-b6e9-b90f18423013-kube-api-access-s4964\") pod \"kuadrant-operator-catalog-8q4gk\" (UID: \"26846746-3b73-4988-b6e9-b90f18423013\") " pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:18.283589 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.283552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4964\" (UniqueName: \"kubernetes.io/projected/26846746-3b73-4988-b6e9-b90f18423013-kube-api-access-s4964\") pod \"kuadrant-operator-catalog-8q4gk\" (UID: \"26846746-3b73-4988-b6e9-b90f18423013\") " pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:18.291632 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.291603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4964\" (UniqueName: \"kubernetes.io/projected/26846746-3b73-4988-b6e9-b90f18423013-kube-api-access-s4964\") pod \"kuadrant-operator-catalog-8q4gk\" (UID: \"26846746-3b73-4988-b6e9-b90f18423013\") " pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:18.371485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.371384 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:18.421400 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.421365 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4gk"] Jun 10 01:10:18.521229 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.521200 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4gk"] Jun 10 01:10:18.523068 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:18.523039 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26846746_3b73_4988_b6e9_b90f18423013.slice/crio-a77f9bab4f9f3e7c074e0ab2c4dc6b663a4c19300df19cee4d2b1a0e7039b8f2 WatchSource:0}: Error finding container a77f9bab4f9f3e7c074e0ab2c4dc6b663a4c19300df19cee4d2b1a0e7039b8f2: Status 404 returned error can't find the container with id a77f9bab4f9f3e7c074e0ab2c4dc6b663a4c19300df19cee4d2b1a0e7039b8f2 Jun 10 01:10:18.629219 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.629131 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txvwd"] Jun 10 01:10:18.634044 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.634026 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:18.638765 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.638731 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txvwd"] Jun 10 01:10:18.748219 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.748179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" event={"ID":"26846746-3b73-4988-b6e9-b90f18423013","Type":"ContainerStarted","Data":"a77f9bab4f9f3e7c074e0ab2c4dc6b663a4c19300df19cee4d2b1a0e7039b8f2"} Jun 10 01:10:18.787200 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.787163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bznn7\" (UniqueName: \"kubernetes.io/projected/43c1beef-4f7e-4248-8660-0f68b6752fca-kube-api-access-bznn7\") pod \"kuadrant-operator-catalog-txvwd\" (UID: \"43c1beef-4f7e-4248-8660-0f68b6752fca\") " pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:18.888047 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.887943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bznn7\" (UniqueName: \"kubernetes.io/projected/43c1beef-4f7e-4248-8660-0f68b6752fca-kube-api-access-bznn7\") pod \"kuadrant-operator-catalog-txvwd\" (UID: \"43c1beef-4f7e-4248-8660-0f68b6752fca\") " pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:18.895626 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.895594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bznn7\" (UniqueName: \"kubernetes.io/projected/43c1beef-4f7e-4248-8660-0f68b6752fca-kube-api-access-bznn7\") pod \"kuadrant-operator-catalog-txvwd\" (UID: \"43c1beef-4f7e-4248-8660-0f68b6752fca\") " pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:18.944653 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:18.944613 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:19.095444 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:19.095414 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txvwd"] Jun 10 01:10:19.112104 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:19.112072 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c1beef_4f7e_4248_8660_0f68b6752fca.slice/crio-8b5c2377ce3e0e4402597f78efe31a421dac8a354e14ad8aafda0de2a5e5dfb9 WatchSource:0}: Error finding container 8b5c2377ce3e0e4402597f78efe31a421dac8a354e14ad8aafda0de2a5e5dfb9: Status 404 returned error can't find the container with id 8b5c2377ce3e0e4402597f78efe31a421dac8a354e14ad8aafda0de2a5e5dfb9 Jun 10 01:10:19.755884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:19.755841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" event={"ID":"43c1beef-4f7e-4248-8660-0f68b6752fca","Type":"ContainerStarted","Data":"8b5c2377ce3e0e4402597f78efe31a421dac8a354e14ad8aafda0de2a5e5dfb9"} Jun 10 01:10:21.770781 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:21.770740 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" event={"ID":"43c1beef-4f7e-4248-8660-0f68b6752fca","Type":"ContainerStarted","Data":"cfe2eba38f2371caebd2e276ec3a0dbfc847240d1fe2491ee82a4ab80a0bf58f"} Jun 10 01:10:21.772320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:21.772278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" event={"ID":"26846746-3b73-4988-b6e9-b90f18423013","Type":"ContainerStarted","Data":"04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3"} Jun 10 01:10:21.772458 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:21.772351 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" podUID="26846746-3b73-4988-b6e9-b90f18423013" containerName="registry-server" containerID="cri-o://04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3" gracePeriod=2 Jun 10 01:10:21.786448 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:21.786389 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" podStartSLOduration=1.831502112 podStartE2EDuration="3.786372355s" totalImagesPullingTime="1.954870243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:21.784205909 +0000 UTC m=+606.213087426" watchObservedRunningTime="2026-06-10 01:10:21.786372355 +0000 UTC m=+606.215253872" Jun 10 01:10:21.797688 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:21.797625 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" podStartSLOduration=1.046384879 podStartE2EDuration="3.797608596s" totalImagesPullingTime="2.751223717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:21.796778603 +0000 UTC m=+606.225660121" watchObservedRunningTime="2026-06-10 01:10:21.797608596 +0000 UTC m=+606.226490115" Jun 10 01:10:22.036534 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.036504 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:22.120464 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.120428 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4964\" (UniqueName: \"kubernetes.io/projected/26846746-3b73-4988-b6e9-b90f18423013-kube-api-access-s4964\") pod \"26846746-3b73-4988-b6e9-b90f18423013\" (UID: \"26846746-3b73-4988-b6e9-b90f18423013\") " Jun 10 01:10:22.122647 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.122615 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26846746-3b73-4988-b6e9-b90f18423013-kube-api-access-s4964" (OuterVolumeSpecName: "kube-api-access-s4964") pod "26846746-3b73-4988-b6e9-b90f18423013" (UID: "26846746-3b73-4988-b6e9-b90f18423013"). InnerVolumeSpecName "kube-api-access-s4964". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:22.221366 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.221327 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4964\" (UniqueName: \"kubernetes.io/projected/26846746-3b73-4988-b6e9-b90f18423013-kube-api-access-s4964\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:22.779507 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.779466 2559 generic.go:356] "Generic (PLEG): container finished" podID="26846746-3b73-4988-b6e9-b90f18423013" containerID="04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3" exitCode=0 Jun 10 01:10:22.779930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.779518 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" Jun 10 01:10:22.779930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.779556 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" event={"ID":"26846746-3b73-4988-b6e9-b90f18423013","Type":"ContainerDied","Data":"04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3"} Jun 10 01:10:22.779930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.779608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8q4gk" event={"ID":"26846746-3b73-4988-b6e9-b90f18423013","Type":"ContainerDied","Data":"a77f9bab4f9f3e7c074e0ab2c4dc6b663a4c19300df19cee4d2b1a0e7039b8f2"} Jun 10 01:10:22.779930 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.779629 2559 scope.go:117] "RemoveContainer" containerID="04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3" Jun 10 01:10:22.789455 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.789432 2559 scope.go:117] "RemoveContainer" containerID="04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3" Jun 10 01:10:22.789750 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:10:22.789731 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3\": container with ID starting with 04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3 not found: ID does not exist" containerID="04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3" Jun 10 01:10:22.789809 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.789759 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3"} err="failed to get container status \"04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3\": rpc error: code = NotFound desc = could not find container \"04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3\": container with ID starting with 04c621fff983c74235339b82292540e0c90db6dc1faa4c06b9d094db50ca3bf3 not found: ID does not exist" Jun 10 01:10:22.800614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.800582 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4gk"] Jun 10 01:10:22.802674 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:22.802654 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4gk"] Jun 10 01:10:24.066711 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:24.066676 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26846746-3b73-4988-b6e9-b90f18423013" path="/var/lib/kubelet/pods/26846746-3b73-4988-b6e9-b90f18423013/volumes" Jun 10 01:10:28.944793 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:28.944752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:28.945206 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:28.944826 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:28.969352 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:28.969317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:29.838615 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:29.838587 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-txvwd" Jun 10 01:10:33.865089 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.864998 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk"] Jun 10 01:10:33.865482 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.865434 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26846746-3b73-4988-b6e9-b90f18423013" containerName="registry-server" Jun 10 01:10:33.865482 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.865447 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26846746-3b73-4988-b6e9-b90f18423013" containerName="registry-server" Jun 10 01:10:33.865558 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.865507 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26846746-3b73-4988-b6e9-b90f18423013" containerName="registry-server" Jun 10 01:10:33.882488 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.882459 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk"] Jun 10 01:10:33.882649 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.882578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:33.884916 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:33.884891 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8dkp5\"" Jun 10 01:10:34.038327 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.038267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.038506 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.038386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.038506 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.038408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4qlj\" (UniqueName: \"kubernetes.io/projected/65290a14-f279-44ab-b2e0-2ff799fdec85-kube-api-access-s4qlj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.139359 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.139246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.139539 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.139356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.139539 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.139391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qlj\" (UniqueName: \"kubernetes.io/projected/65290a14-f279-44ab-b2e0-2ff799fdec85-kube-api-access-s4qlj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.139710 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.139688 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.139766 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.139715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.148521 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.148493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4qlj\" (UniqueName: \"kubernetes.io/projected/65290a14-f279-44ab-b2e0-2ff799fdec85-kube-api-access-s4qlj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.192780 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.192741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:34.352231 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.352194 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk"] Jun 10 01:10:34.352953 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:34.352927 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65290a14_f279_44ab_b2e0_2ff799fdec85.slice/crio-3da9d18ffbcef4f8eb38cb5579120af39fd76ba8e121b10f181c803b943c3bcd WatchSource:0}: Error finding container 3da9d18ffbcef4f8eb38cb5579120af39fd76ba8e121b10f181c803b943c3bcd: Status 404 returned error can't find the container with id 3da9d18ffbcef4f8eb38cb5579120af39fd76ba8e121b10f181c803b943c3bcd Jun 10 01:10:34.661979 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.661899 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j"] Jun 10 01:10:34.665663 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.665641 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.672030 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.672003 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j"] Jun 10 01:10:34.844630 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.844594 2559 generic.go:356] "Generic (PLEG): container finished" podID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerID="b245503479ac681e301fcc3a25f0ac3c86a5bd5fe06858e5643e5e64091c6422" exitCode=0 Jun 10 01:10:34.844817 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.844680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" event={"ID":"65290a14-f279-44ab-b2e0-2ff799fdec85","Type":"ContainerDied","Data":"b245503479ac681e301fcc3a25f0ac3c86a5bd5fe06858e5643e5e64091c6422"} Jun 10 01:10:34.844817 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.844741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" event={"ID":"65290a14-f279-44ab-b2e0-2ff799fdec85","Type":"ContainerStarted","Data":"3da9d18ffbcef4f8eb38cb5579120af39fd76ba8e121b10f181c803b943c3bcd"} Jun 10 01:10:34.845654 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.845636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.845755 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.845681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.845836 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.845815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29pn\" (UniqueName: \"kubernetes.io/projected/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-kube-api-access-g29pn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.946884 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.946848 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.947287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.946927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29pn\" (UniqueName: \"kubernetes.io/projected/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-kube-api-access-g29pn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.947287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.946989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.947287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.947242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.947492 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.947350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.954789 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.954764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29pn\" (UniqueName: \"kubernetes.io/projected/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-kube-api-access-g29pn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:34.975741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:34.975711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:35.114802 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.114772 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j"] Jun 10 01:10:35.116544 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:35.116518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95aa7a2f_d9c8_4b9b_a600_094dacdabd21.slice/crio-3a58e45b50eed4aac814969d80a293ae8fe6a7ae65ecdc8d6608e40b6e72dda6 WatchSource:0}: Error finding container 3a58e45b50eed4aac814969d80a293ae8fe6a7ae65ecdc8d6608e40b6e72dda6: Status 404 returned error can't find the container with id 3a58e45b50eed4aac814969d80a293ae8fe6a7ae65ecdc8d6608e40b6e72dda6 Jun 10 01:10:35.466717 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.466671 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j"] Jun 10 01:10:35.470345 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.470321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.478246 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.478217 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j"] Jun 10 01:10:35.654178 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.654138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx59l\" (UniqueName: \"kubernetes.io/projected/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-kube-api-access-mx59l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.654405 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.654197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.654405 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.654289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.755269 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.755242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.755419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.755314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.755419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.755379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx59l\" (UniqueName: \"kubernetes.io/projected/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-kube-api-access-mx59l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.755652 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.755632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.755725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.755670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.763662 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.763637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx59l\" (UniqueName: \"kubernetes.io/projected/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-kube-api-access-mx59l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.780925 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.780905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:35.852121 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.852091 2559 generic.go:356] "Generic (PLEG): container finished" podID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerID="74c19e4b2d97d33b17b1ec3b8683b92c8549af201a40ad05b8299a5539362c8f" exitCode=0 Jun 10 01:10:35.852287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.852180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" event={"ID":"95aa7a2f-d9c8-4b9b-a600-094dacdabd21","Type":"ContainerDied","Data":"74c19e4b2d97d33b17b1ec3b8683b92c8549af201a40ad05b8299a5539362c8f"} Jun 10 01:10:35.852287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.852234 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" event={"ID":"95aa7a2f-d9c8-4b9b-a600-094dacdabd21","Type":"ContainerStarted","Data":"3a58e45b50eed4aac814969d80a293ae8fe6a7ae65ecdc8d6608e40b6e72dda6"} Jun 10 01:10:35.854471 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.854436 2559 generic.go:356] "Generic (PLEG): container finished" podID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerID="5756ccbb55b114cde3ef63e73ed964c43c9fccd313fc4d995905e4e8688a9ce9" exitCode=0 Jun 10 01:10:35.854574 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.854487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" event={"ID":"65290a14-f279-44ab-b2e0-2ff799fdec85","Type":"ContainerDied","Data":"5756ccbb55b114cde3ef63e73ed964c43c9fccd313fc4d995905e4e8688a9ce9"} Jun 10 01:10:35.936009 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:35.935913 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j"] Jun 10 01:10:36.277462 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.277361 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx"] Jun 10 01:10:36.281118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.281100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.290015 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.289987 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx"] Jun 10 01:10:36.461735 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.461698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpj5\" (UniqueName: \"kubernetes.io/projected/a7e1e853-c813-4925-8f38-f64e140a3885-kube-api-access-7wpj5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.461918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.461763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.461918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.461828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.563256 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.563167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.563256 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.563237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.563523 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.563277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpj5\" (UniqueName: \"kubernetes.io/projected/a7e1e853-c813-4925-8f38-f64e140a3885-kube-api-access-7wpj5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.563666 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.563646 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.563711 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.563654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.572440 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.572370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpj5\" (UniqueName: \"kubernetes.io/projected/a7e1e853-c813-4925-8f38-f64e140a3885-kube-api-access-7wpj5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.592020 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.591987 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:36.779165 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.779134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx"] Jun 10 01:10:36.780769 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:36.780736 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e1e853_c813_4925_8f38_f64e140a3885.slice/crio-716e370c314fb06ef20ac15444d609987a020969ad64260a2675b22e9c9727c1 WatchSource:0}: Error finding container 716e370c314fb06ef20ac15444d609987a020969ad64260a2675b22e9c9727c1: Status 404 returned error can't find the container with id 716e370c314fb06ef20ac15444d609987a020969ad64260a2675b22e9c9727c1 Jun 10 01:10:36.863236 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.863201 2559 generic.go:356] "Generic (PLEG): container finished" podID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerID="7f15ef9dcd4a3608dc9c64109a29b500f6d2ed80edf9d5575476d2db8988275c" exitCode=0 Jun 10 01:10:36.863403 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.863273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" event={"ID":"95aa7a2f-d9c8-4b9b-a600-094dacdabd21","Type":"ContainerDied","Data":"7f15ef9dcd4a3608dc9c64109a29b500f6d2ed80edf9d5575476d2db8988275c"} Jun 10 01:10:36.865026 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.864838 2559 generic.go:356] "Generic (PLEG): container finished" podID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerID="672d487ce48a0bd989bc6d03277d4a9318be1ab558393e6ee7c8be375e57911c" exitCode=0 Jun 10 01:10:36.865026 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.864913 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" event={"ID":"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e","Type":"ContainerDied","Data":"672d487ce48a0bd989bc6d03277d4a9318be1ab558393e6ee7c8be375e57911c"} Jun 10 01:10:36.865026 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.864963 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" event={"ID":"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e","Type":"ContainerStarted","Data":"2a99e7e85719d31abacb34e3273d43d4751d6c29a63d91ceb037540d4a326482"} Jun 10 01:10:36.867558 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.867539 2559 generic.go:356] "Generic (PLEG): container finished" podID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerID="b7a54427e54bc9cf268b0d07ecd75a41090618f9bb2f1648895b91f0ac919e26" exitCode=0 Jun 10 01:10:36.867647 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.867630 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" event={"ID":"65290a14-f279-44ab-b2e0-2ff799fdec85","Type":"ContainerDied","Data":"b7a54427e54bc9cf268b0d07ecd75a41090618f9bb2f1648895b91f0ac919e26"} Jun 10 01:10:36.869453 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:36.869429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" event={"ID":"a7e1e853-c813-4925-8f38-f64e140a3885","Type":"ContainerStarted","Data":"716e370c314fb06ef20ac15444d609987a020969ad64260a2675b22e9c9727c1"} Jun 10 01:10:37.879791 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:37.879700 2559 generic.go:356] "Generic (PLEG): container finished" podID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerID="460aa1fb7d6bc23fc83a19b7823ecda0d89f728d3ef55f8b515860762c5f4033" exitCode=0 Jun 10 01:10:37.880201 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:37.879789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" event={"ID":"95aa7a2f-d9c8-4b9b-a600-094dacdabd21","Type":"ContainerDied","Data":"460aa1fb7d6bc23fc83a19b7823ecda0d89f728d3ef55f8b515860762c5f4033"} Jun 10 01:10:37.881660 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:37.881635 2559 generic.go:356] "Generic (PLEG): container finished" podID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerID="c8c33e2aa0a6b9ac114532f35df111caa2b4f421fff7789e92225e4e064a8eca" exitCode=0 Jun 10 01:10:37.881803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:37.881710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" event={"ID":"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e","Type":"ContainerDied","Data":"c8c33e2aa0a6b9ac114532f35df111caa2b4f421fff7789e92225e4e064a8eca"} Jun 10 01:10:37.883430 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:37.883246 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7e1e853-c813-4925-8f38-f64e140a3885" containerID="8f86a71632bb392336773ca133a0bd0b60b8a5d0005a5fef66eb654fae3c7072" exitCode=0 Jun 10 01:10:37.883430 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:37.883312 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" event={"ID":"a7e1e853-c813-4925-8f38-f64e140a3885","Type":"ContainerDied","Data":"8f86a71632bb392336773ca133a0bd0b60b8a5d0005a5fef66eb654fae3c7072"} Jun 10 01:10:38.023450 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.023424 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:38.178498 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.178449 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4qlj\" (UniqueName: \"kubernetes.io/projected/65290a14-f279-44ab-b2e0-2ff799fdec85-kube-api-access-s4qlj\") pod \"65290a14-f279-44ab-b2e0-2ff799fdec85\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " Jun 10 01:10:38.178636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.178522 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-bundle\") pod \"65290a14-f279-44ab-b2e0-2ff799fdec85\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " Jun 10 01:10:38.178636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.178620 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-util\") pod \"65290a14-f279-44ab-b2e0-2ff799fdec85\" (UID: \"65290a14-f279-44ab-b2e0-2ff799fdec85\") " Jun 10 01:10:38.179074 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.179047 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-bundle" (OuterVolumeSpecName: "bundle") pod "65290a14-f279-44ab-b2e0-2ff799fdec85" (UID: "65290a14-f279-44ab-b2e0-2ff799fdec85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:38.180663 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.180633 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65290a14-f279-44ab-b2e0-2ff799fdec85-kube-api-access-s4qlj" (OuterVolumeSpecName: "kube-api-access-s4qlj") pod "65290a14-f279-44ab-b2e0-2ff799fdec85" (UID: "65290a14-f279-44ab-b2e0-2ff799fdec85"). InnerVolumeSpecName "kube-api-access-s4qlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:38.183782 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.183740 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-util" (OuterVolumeSpecName: "util") pod "65290a14-f279-44ab-b2e0-2ff799fdec85" (UID: "65290a14-f279-44ab-b2e0-2ff799fdec85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:38.279358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.279313 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:38.279358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.279350 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4qlj\" (UniqueName: \"kubernetes.io/projected/65290a14-f279-44ab-b2e0-2ff799fdec85-kube-api-access-s4qlj\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:38.279358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.279362 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65290a14-f279-44ab-b2e0-2ff799fdec85-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:38.892110 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.892024 2559 generic.go:356] "Generic (PLEG): container finished" podID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerID="684527125ec00e7e31d1da8ee2b5c21517a6cfaf96df324c85e6f0faeec5e5e8" exitCode=0 Jun 10 01:10:38.892110 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.892061 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" event={"ID":"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e","Type":"ContainerDied","Data":"684527125ec00e7e31d1da8ee2b5c21517a6cfaf96df324c85e6f0faeec5e5e8"} Jun 10 01:10:38.894096 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.894075 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" Jun 10 01:10:38.894096 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.894080 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk" event={"ID":"65290a14-f279-44ab-b2e0-2ff799fdec85","Type":"ContainerDied","Data":"3da9d18ffbcef4f8eb38cb5579120af39fd76ba8e121b10f181c803b943c3bcd"} Jun 10 01:10:38.894247 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.894113 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3da9d18ffbcef4f8eb38cb5579120af39fd76ba8e121b10f181c803b943c3bcd" Jun 10 01:10:38.896013 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.895986 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7e1e853-c813-4925-8f38-f64e140a3885" containerID="66ca419d5f928b802652a5f6196551a0cb72417a42df194e437785fad72cc8e3" exitCode=0 Jun 10 01:10:38.896128 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:38.896027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" event={"ID":"a7e1e853-c813-4925-8f38-f64e140a3885","Type":"ContainerDied","Data":"66ca419d5f928b802652a5f6196551a0cb72417a42df194e437785fad72cc8e3"} Jun 10 01:10:39.021529 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.021500 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:39.187029 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.186991 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-bundle\") pod \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " Jun 10 01:10:39.187211 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.187043 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g29pn\" (UniqueName: \"kubernetes.io/projected/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-kube-api-access-g29pn\") pod \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " Jun 10 01:10:39.187211 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.187078 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-util\") pod \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\" (UID: \"95aa7a2f-d9c8-4b9b-a600-094dacdabd21\") " Jun 10 01:10:39.187596 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.187568 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-bundle" (OuterVolumeSpecName: "bundle") pod "95aa7a2f-d9c8-4b9b-a600-094dacdabd21" (UID: "95aa7a2f-d9c8-4b9b-a600-094dacdabd21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:39.189267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.189244 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-kube-api-access-g29pn" (OuterVolumeSpecName: "kube-api-access-g29pn") pod "95aa7a2f-d9c8-4b9b-a600-094dacdabd21" (UID: "95aa7a2f-d9c8-4b9b-a600-094dacdabd21"). InnerVolumeSpecName "kube-api-access-g29pn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:39.192524 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.192503 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-util" (OuterVolumeSpecName: "util") pod "95aa7a2f-d9c8-4b9b-a600-094dacdabd21" (UID: "95aa7a2f-d9c8-4b9b-a600-094dacdabd21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:39.287857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.287812 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:39.287857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.287848 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:39.287857 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.287857 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g29pn\" (UniqueName: \"kubernetes.io/projected/95aa7a2f-d9c8-4b9b-a600-094dacdabd21-kube-api-access-g29pn\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:39.904203 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.904166 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7e1e853-c813-4925-8f38-f64e140a3885" containerID="773cdf7ed5370de53b8da0db733c4179a180b77b76396bfbaacfb77da262bbd9" exitCode=0 Jun 10 01:10:39.904623 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.904224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" event={"ID":"a7e1e853-c813-4925-8f38-f64e140a3885","Type":"ContainerDied","Data":"773cdf7ed5370de53b8da0db733c4179a180b77b76396bfbaacfb77da262bbd9"} Jun 10 01:10:39.906270 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.906248 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" Jun 10 01:10:39.906392 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.906270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j" event={"ID":"95aa7a2f-d9c8-4b9b-a600-094dacdabd21","Type":"ContainerDied","Data":"3a58e45b50eed4aac814969d80a293ae8fe6a7ae65ecdc8d6608e40b6e72dda6"} Jun 10 01:10:39.906392 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:39.906321 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a58e45b50eed4aac814969d80a293ae8fe6a7ae65ecdc8d6608e40b6e72dda6" Jun 10 01:10:40.047897 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.047869 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:40.094707 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.094678 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-bundle\") pod \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " Jun 10 01:10:40.094707 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.094717 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx59l\" (UniqueName: \"kubernetes.io/projected/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-kube-api-access-mx59l\") pod \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " Jun 10 01:10:40.094946 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.094750 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-util\") pod \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\" (UID: \"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e\") " Jun 10 01:10:40.095285 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.095255 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-bundle" (OuterVolumeSpecName: "bundle") pod "aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" (UID: "aea4c58b-e9bc-4cd4-94dd-ae49160ea49e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:40.096915 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.096886 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-kube-api-access-mx59l" (OuterVolumeSpecName: "kube-api-access-mx59l") pod "aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" (UID: "aea4c58b-e9bc-4cd4-94dd-ae49160ea49e"). InnerVolumeSpecName "kube-api-access-mx59l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:40.100249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.100205 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-util" (OuterVolumeSpecName: "util") pod "aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" (UID: "aea4c58b-e9bc-4cd4-94dd-ae49160ea49e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:40.195358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.195325 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx59l\" (UniqueName: \"kubernetes.io/projected/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-kube-api-access-mx59l\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:40.195358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.195353 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:40.195358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.195366 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aea4c58b-e9bc-4cd4-94dd-ae49160ea49e-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:40.914230 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.914202 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" Jun 10 01:10:40.914646 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.914231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j" event={"ID":"aea4c58b-e9bc-4cd4-94dd-ae49160ea49e","Type":"ContainerDied","Data":"2a99e7e85719d31abacb34e3273d43d4751d6c29a63d91ceb037540d4a326482"} Jun 10 01:10:40.914646 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:40.914279 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a99e7e85719d31abacb34e3273d43d4751d6c29a63d91ceb037540d4a326482" Jun 10 01:10:41.047418 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.047390 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:41.101138 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.101100 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wpj5\" (UniqueName: \"kubernetes.io/projected/a7e1e853-c813-4925-8f38-f64e140a3885-kube-api-access-7wpj5\") pod \"a7e1e853-c813-4925-8f38-f64e140a3885\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " Jun 10 01:10:41.101345 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.101194 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-bundle\") pod \"a7e1e853-c813-4925-8f38-f64e140a3885\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " Jun 10 01:10:41.101345 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.101309 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-util\") pod \"a7e1e853-c813-4925-8f38-f64e140a3885\" (UID: \"a7e1e853-c813-4925-8f38-f64e140a3885\") " Jun 10 01:10:41.101692 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.101671 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-bundle" (OuterVolumeSpecName: "bundle") pod "a7e1e853-c813-4925-8f38-f64e140a3885" (UID: "a7e1e853-c813-4925-8f38-f64e140a3885"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:41.103375 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.103351 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e1e853-c813-4925-8f38-f64e140a3885-kube-api-access-7wpj5" (OuterVolumeSpecName: "kube-api-access-7wpj5") pod "a7e1e853-c813-4925-8f38-f64e140a3885" (UID: "a7e1e853-c813-4925-8f38-f64e140a3885"). InnerVolumeSpecName "kube-api-access-7wpj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:10:41.106939 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.106913 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-util" (OuterVolumeSpecName: "util") pod "a7e1e853-c813-4925-8f38-f64e140a3885" (UID: "a7e1e853-c813-4925-8f38-f64e140a3885"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:10:41.202509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.202468 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:41.202509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.202502 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7e1e853-c813-4925-8f38-f64e140a3885-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:41.202509 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.202514 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wpj5\" (UniqueName: \"kubernetes.io/projected/a7e1e853-c813-4925-8f38-f64e140a3885-kube-api-access-7wpj5\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:10:41.928450 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.928414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" event={"ID":"a7e1e853-c813-4925-8f38-f64e140a3885","Type":"ContainerDied","Data":"716e370c314fb06ef20ac15444d609987a020969ad64260a2675b22e9c9727c1"} Jun 10 01:10:41.928450 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.928454 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx" Jun 10 01:10:41.928871 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:41.928484 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="716e370c314fb06ef20ac15444d609987a020969ad64260a2675b22e9c9727c1" Jun 10 01:10:51.767260 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767224 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4"] Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767784 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="extract" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767806 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="extract" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767820 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="util" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767829 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="util" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767847 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="pull" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767856 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="pull" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767868 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="pull" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767876 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="pull" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767885 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="pull" Jun 10 01:10:51.767894 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767893 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="pull" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767908 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="pull" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767916 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="pull" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767924 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767933 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767947 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767957 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767969 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="util" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767977 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="util" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.767995 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="util" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768005 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="util" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768014 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="util" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768022 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="util" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768034 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768042 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768137 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea4c58b-e9bc-4cd4-94dd-ae49160ea49e" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768151 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="65290a14-f279-44ab-b2e0-2ff799fdec85" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768165 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95aa7a2f-d9c8-4b9b-a600-094dacdabd21" containerName="extract" Jun 10 01:10:51.768435 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.768175 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e1e853-c813-4925-8f38-f64e140a3885" containerName="extract" Jun 10 01:10:51.772021 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.772000 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:10:51.776846 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.776821 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xrnc7\"" Jun 10 01:10:51.788893 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.788861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4"] Jun 10 01:10:51.799768 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.799735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgsr\" (UniqueName: \"kubernetes.io/projected/b2543c74-bb93-42b3-8b78-884db12fbd39-kube-api-access-7jgsr\") pod \"authorino-operator-75cc8d5cb7-wn6r4\" (UID: \"b2543c74-bb93-42b3-8b78-884db12fbd39\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:10:51.901132 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.901083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgsr\" (UniqueName: \"kubernetes.io/projected/b2543c74-bb93-42b3-8b78-884db12fbd39-kube-api-access-7jgsr\") pod \"authorino-operator-75cc8d5cb7-wn6r4\" (UID: \"b2543c74-bb93-42b3-8b78-884db12fbd39\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:10:51.915216 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:51.915179 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgsr\" (UniqueName: \"kubernetes.io/projected/b2543c74-bb93-42b3-8b78-884db12fbd39-kube-api-access-7jgsr\") pod \"authorino-operator-75cc8d5cb7-wn6r4\" (UID: \"b2543c74-bb93-42b3-8b78-884db12fbd39\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:10:52.082286 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:52.082187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:10:52.222217 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:52.222190 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4"] Jun 10 01:10:52.223959 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:52.223926 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2543c74_bb93_42b3_8b78_884db12fbd39.slice/crio-4e07915457c980610765c12e0edb6adb69b3353b9cb1c1f53d410de6398b8990 WatchSource:0}: Error finding container 4e07915457c980610765c12e0edb6adb69b3353b9cb1c1f53d410de6398b8990: Status 404 returned error can't find the container with id 4e07915457c980610765c12e0edb6adb69b3353b9cb1c1f53d410de6398b8990 Jun 10 01:10:52.226146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:52.226123 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:10:52.938396 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:52.938360 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788f5ccdd7-sg7zh"] Jun 10 01:10:52.946228 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:52.946199 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:52.955046 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:52.955016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788f5ccdd7-sg7zh"] Jun 10 01:10:53.006744 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.006612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" event={"ID":"b2543c74-bb93-42b3-8b78-884db12fbd39","Type":"ContainerStarted","Data":"4e07915457c980610765c12e0edb6adb69b3353b9cb1c1f53d410de6398b8990"} Jun 10 01:10:53.011774 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.011735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-oauth-config\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.011972 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.011868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-config\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.011972 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.011936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-trusted-ca-bundle\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.012153 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.011978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-oauth-serving-cert\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.012153 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.012021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-serving-cert\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.012283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.012160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2nl\" (UniqueName: \"kubernetes.io/projected/68351c1d-d66b-4a22-aa77-4985d8f95ac6-kube-api-access-vv2nl\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.012283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.012198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-service-ca\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113217 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-serving-cert\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113438 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2nl\" (UniqueName: \"kubernetes.io/projected/68351c1d-d66b-4a22-aa77-4985d8f95ac6-kube-api-access-vv2nl\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113438 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-service-ca\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113438 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-oauth-config\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113438 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-config\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113687 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-trusted-ca-bundle\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.113687 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.113488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-oauth-serving-cert\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.114374 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.114116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-service-ca\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.114528 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.114459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-oauth-serving-cert\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.114648 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.114625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-config\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.115033 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.115008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68351c1d-d66b-4a22-aa77-4985d8f95ac6-trusted-ca-bundle\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.116033 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.116011 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-serving-cert\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.116193 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.116171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68351c1d-d66b-4a22-aa77-4985d8f95ac6-console-oauth-config\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.124844 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.124818 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2nl\" (UniqueName: \"kubernetes.io/projected/68351c1d-d66b-4a22-aa77-4985d8f95ac6-kube-api-access-vv2nl\") pod \"console-788f5ccdd7-sg7zh\" (UID: \"68351c1d-d66b-4a22-aa77-4985d8f95ac6\") " pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.262007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.261920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:10:53.444363 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:53.444333 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788f5ccdd7-sg7zh"] Jun 10 01:10:53.446772 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:10:53.446738 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68351c1d_d66b_4a22_aa77_4985d8f95ac6.slice/crio-ed09bdfc17214136bc51784117dcc1550e46598253ef623bb66c6988cd768d63 WatchSource:0}: Error finding container ed09bdfc17214136bc51784117dcc1550e46598253ef623bb66c6988cd768d63: Status 404 returned error can't find the container with id ed09bdfc17214136bc51784117dcc1550e46598253ef623bb66c6988cd768d63 Jun 10 01:10:54.020706 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:54.020663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788f5ccdd7-sg7zh" event={"ID":"68351c1d-d66b-4a22-aa77-4985d8f95ac6","Type":"ContainerStarted","Data":"dc2e66dd490c966878932a96fcec94d25ac76f7f5bf5875a2b131969ff9740a3"} Jun 10 01:10:54.021170 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:54.020774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788f5ccdd7-sg7zh" event={"ID":"68351c1d-d66b-4a22-aa77-4985d8f95ac6","Type":"ContainerStarted","Data":"ed09bdfc17214136bc51784117dcc1550e46598253ef623bb66c6988cd768d63"} Jun 10 01:10:54.039258 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:54.039206 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788f5ccdd7-sg7zh" podStartSLOduration=2.039189642 podStartE2EDuration="2.039189642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:54.037678138 +0000 UTC m=+638.466559704" watchObservedRunningTime="2026-06-10 01:10:54.039189642 +0000 UTC m=+638.468071138" Jun 10 01:10:55.028193 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:55.028155 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" event={"ID":"b2543c74-bb93-42b3-8b78-884db12fbd39","Type":"ContainerStarted","Data":"32b3838711c9cee664758c176a3625c8b7e2d8dcfe063a3c8a33942d2881197b"} Jun 10 01:10:55.067042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:55.066986 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" podStartSLOduration=1.731546096 podStartE2EDuration="4.066967398s" totalImagesPullingTime="2.335421302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:55.065766789 +0000 UTC m=+639.494648329" watchObservedRunningTime="2026-06-10 01:10:55.066967398 +0000 UTC m=+639.495849330" Jun 10 01:10:56.033709 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:10:56.033677 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:11:03.262415 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:03.262364 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:11:03.262847 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:03.262437 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:11:03.267467 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:03.267441 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:11:04.097653 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:04.097620 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788f5ccdd7-sg7zh" Jun 10 01:11:04.163737 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:04.163688 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677d446ddc-bj7ft"] Jun 10 01:11:07.043229 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.043200 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wn6r4" Jun 10 01:11:07.145077 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.145033 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7"] Jun 10 01:11:07.148515 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.148490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.151049 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.151015 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 01:11:07.151049 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.151044 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8dkp5\"" Jun 10 01:11:07.151270 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.151254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 01:11:07.160164 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.160129 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7"] Jun 10 01:11:07.252133 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.252094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/05c3750f-23e5-43f1-af23-255f968b69c8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.252354 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.252183 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwrj\" (UniqueName: \"kubernetes.io/projected/05c3750f-23e5-43f1-af23-255f968b69c8-kube-api-access-fgwrj\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.252354 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.252246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/05c3750f-23e5-43f1-af23-255f968b69c8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.353562 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.353465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/05c3750f-23e5-43f1-af23-255f968b69c8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.353562 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.353555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwrj\" (UniqueName: \"kubernetes.io/projected/05c3750f-23e5-43f1-af23-255f968b69c8-kube-api-access-fgwrj\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.353830 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.353604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/05c3750f-23e5-43f1-af23-255f968b69c8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.353830 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:07.353615 2559 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 01:11:07.353830 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:07.353688 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05c3750f-23e5-43f1-af23-255f968b69c8-plugin-serving-cert podName:05c3750f-23e5-43f1-af23-255f968b69c8 nodeName:}" failed. No retries permitted until 2026-06-10 01:11:07.853670352 +0000 UTC m=+652.282551853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/05c3750f-23e5-43f1-af23-255f968b69c8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6xcc7" (UID: "05c3750f-23e5-43f1-af23-255f968b69c8") : secret "plugin-serving-cert" not found Jun 10 01:11:07.354330 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.354285 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/05c3750f-23e5-43f1-af23-255f968b69c8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.364687 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.364661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwrj\" (UniqueName: \"kubernetes.io/projected/05c3750f-23e5-43f1-af23-255f968b69c8-kube-api-access-fgwrj\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.858120 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.858079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/05c3750f-23e5-43f1-af23-255f968b69c8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:07.860723 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:07.860691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/05c3750f-23e5-43f1-af23-255f968b69c8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6xcc7\" (UID: \"05c3750f-23e5-43f1-af23-255f968b69c8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:08.061403 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:08.061362 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" Jun 10 01:11:08.205398 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:08.205371 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7"] Jun 10 01:11:08.207080 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:11:08.207052 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05c3750f_23e5_43f1_af23_255f968b69c8.slice/crio-6a32923be6591715c0d124c90ea1d8a76537c6fd3805efd99bac1240f77f8c63 WatchSource:0}: Error finding container 6a32923be6591715c0d124c90ea1d8a76537c6fd3805efd99bac1240f77f8c63: Status 404 returned error can't find the container with id 6a32923be6591715c0d124c90ea1d8a76537c6fd3805efd99bac1240f77f8c63 Jun 10 01:11:09.130194 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:09.130151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" event={"ID":"05c3750f-23e5-43f1-af23-255f968b69c8","Type":"ContainerStarted","Data":"6a32923be6591715c0d124c90ea1d8a76537c6fd3805efd99bac1240f77f8c63"} Jun 10 01:11:17.835959 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.835921 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr"] Jun 10 01:11:17.841228 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.841196 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:17.844040 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.844013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cgzb5\"" Jun 10 01:11:17.852932 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.852907 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr"] Jun 10 01:11:17.944679 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.944644 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr"] Jun 10 01:11:17.945019 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:17.944990 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jz42x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" podUID="3bfae1ad-70cb-4d29-9591-6f2fd8f13773" Jun 10 01:11:17.963448 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.963407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" (UID: \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:17.963635 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:17.963465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz42x\" (UniqueName: \"kubernetes.io/projected/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-kube-api-access-jz42x\") pod \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" (UID: \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.019772 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.019729 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr"] Jun 10 01:11:18.032482 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.032449 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr"] Jun 10 01:11:18.064636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.064601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" (UID: \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.064822 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.064665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz42x\" (UniqueName: \"kubernetes.io/projected/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-kube-api-access-jz42x\") pod \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" (UID: \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.065101 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.065075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" (UID: \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.068136 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:18.068111 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jz42x for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-139-200.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-139-200.ec2.internal' and this object Jun 10 01:11:18.068344 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:18.068202 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-kube-api-access-jz42x podName:3bfae1ad-70cb-4d29-9591-6f2fd8f13773 nodeName:}" failed. No retries permitted until 2026-06-10 01:11:18.568178578 +0000 UTC m=+662.997060081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jz42x" (UniqueName: "kubernetes.io/projected/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-kube-api-access-jz42x") pod "kuadrant-operator-controller-manager-55467d9f7-tlbfr" (UID: "3bfae1ad-70cb-4d29-9591-6f2fd8f13773") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-139-200.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-139-200.ec2.internal' and this object Jun 10 01:11:18.085465 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.085425 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6"] Jun 10 01:11:18.089522 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.089448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.103378 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.103287 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6"] Jun 10 01:11:18.199121 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.191689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.207875 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.207843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.210628 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:18.210591 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" is forbidden: User \"system:node:ip-10-0-139-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-200.ec2.internal' and this object" podUID="3bfae1ad-70cb-4d29-9591-6f2fd8f13773" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:18.266473 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.266429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f106d980-16f9-4350-a8e7-86e09611c643-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4kv6\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.266688 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.266614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bk7b\" (UniqueName: \"kubernetes.io/projected/f106d980-16f9-4350-a8e7-86e09611c643-kube-api-access-2bk7b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4kv6\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.368149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368053 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-extensions-socket-volume\") pod \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\" (UID: \"3bfae1ad-70cb-4d29-9591-6f2fd8f13773\") " Jun 10 01:11:18.368374 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bk7b\" (UniqueName: \"kubernetes.io/projected/f106d980-16f9-4350-a8e7-86e09611c643-kube-api-access-2bk7b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4kv6\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.368456 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368392 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bfae1ad-70cb-4d29-9591-6f2fd8f13773" (UID: "3bfae1ad-70cb-4d29-9591-6f2fd8f13773"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:11:18.368456 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f106d980-16f9-4350-a8e7-86e09611c643-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4kv6\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.368573 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368558 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz42x\" (UniqueName: \"kubernetes.io/projected/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-kube-api-access-jz42x\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:18.368621 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368577 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bfae1ad-70cb-4d29-9591-6f2fd8f13773-extensions-socket-volume\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:18.368806 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.368776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f106d980-16f9-4350-a8e7-86e09611c643-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4kv6\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.377371 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.377345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bk7b\" (UniqueName: \"kubernetes.io/projected/f106d980-16f9-4350-a8e7-86e09611c643-kube-api-access-2bk7b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4kv6\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.405161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.405123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:18.563318 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:18.563224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6"] Jun 10 01:11:18.564784 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:11:18.564749 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf106d980_16f9_4350_a8e7_86e09611c643.slice/crio-fd2f4b7f2c8bde89d4d6e837bb47ccd9cff0072b96580066c7a1d595f63992ac WatchSource:0}: Error finding container fd2f4b7f2c8bde89d4d6e837bb47ccd9cff0072b96580066c7a1d595f63992ac: Status 404 returned error can't find the container with id fd2f4b7f2c8bde89d4d6e837bb47ccd9cff0072b96580066c7a1d595f63992ac Jun 10 01:11:19.199561 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:19.199528 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:19.199561 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:19.199543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" event={"ID":"f106d980-16f9-4350-a8e7-86e09611c643","Type":"ContainerStarted","Data":"fd2f4b7f2c8bde89d4d6e837bb47ccd9cff0072b96580066c7a1d595f63992ac"} Jun 10 01:11:19.201782 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:19.201753 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" is forbidden: User \"system:node:ip-10-0-139-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-200.ec2.internal' and this object" podUID="3bfae1ad-70cb-4d29-9591-6f2fd8f13773" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:19.208115 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:19.208091 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-tlbfr\" is forbidden: User \"system:node:ip-10-0-139-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-200.ec2.internal' and this object" podUID="3bfae1ad-70cb-4d29-9591-6f2fd8f13773" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tlbfr" Jun 10 01:11:20.068817 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:20.068768 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bfae1ad-70cb-4d29-9591-6f2fd8f13773" path="/var/lib/kubelet/pods/3bfae1ad-70cb-4d29-9591-6f2fd8f13773/volumes" Jun 10 01:11:29.184945 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:29.184899 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-677d446ddc-bj7ft" podUID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" containerName="console" containerID="cri-o://8e268ed82a5bb21a40e7e5405cf54823b6f7d4073ebc18be942223e2905d84ea" gracePeriod=15 Jun 10 01:11:29.783819 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:29.783783 2559 patch_prober.go:28] interesting pod/console-677d446ddc-bj7ft container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.28:8443/health\": dial tcp 10.133.0.28:8443: connect: connection refused" start-of-body= Jun 10 01:11:29.784010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:29.783841 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-677d446ddc-bj7ft" podUID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" containerName="console" probeResult="failure" output="Get \"https://10.133.0.28:8443/health\": dial tcp 10.133.0.28:8443: connect: connection refused" Jun 10 01:11:30.442440 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:30.442399 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6"] Jun 10 01:11:34.296868 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:34.296819 2559 generic.go:356] "Generic (PLEG): container finished" podID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" containerID="8e268ed82a5bb21a40e7e5405cf54823b6f7d4073ebc18be942223e2905d84ea" exitCode=0 Jun 10 01:11:34.297350 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:34.296900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d446ddc-bj7ft" event={"ID":"2ac3f969-7ece-4563-856a-3f2dbcdcaa43","Type":"ContainerDied","Data":"8e268ed82a5bb21a40e7e5405cf54823b6f7d4073ebc18be942223e2905d84ea"} Jun 10 01:11:35.432411 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.432376 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:11:35.550909 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.550883 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mrdt\" (UniqueName: \"kubernetes.io/projected/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-kube-api-access-8mrdt\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551072 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.550960 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-serving-cert\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551072 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.550992 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-trusted-ca-bundle\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551072 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551032 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-oauth-config\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551238 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551098 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-config\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551238 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551141 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-oauth-serving-cert\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551238 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551179 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-service-ca\") pod \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\" (UID: \"2ac3f969-7ece-4563-856a-3f2dbcdcaa43\") " Jun 10 01:11:35.551550 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551505 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:11:35.551550 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551533 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-config" (OuterVolumeSpecName: "console-config") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:11:35.551803 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551718 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:11:35.551870 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.551801 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:11:35.553621 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.553595 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:11:35.553734 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.553648 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-kube-api-access-8mrdt" (OuterVolumeSpecName: "kube-api-access-8mrdt") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "kube-api-access-8mrdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:11:35.553734 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.553686 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ac3f969-7ece-4563-856a-3f2dbcdcaa43" (UID: "2ac3f969-7ece-4563-856a-3f2dbcdcaa43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652219 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mrdt\" (UniqueName: \"kubernetes.io/projected/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-kube-api-access-8mrdt\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652251 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652261 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-trusted-ca-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652270 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-oauth-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652282 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-console-config\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652318 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-oauth-serving-cert\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:35.652342 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:35.652327 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac3f969-7ece-4563-856a-3f2dbcdcaa43-service-ca\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:36.311705 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.311674 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d446ddc-bj7ft" Jun 10 01:11:36.311920 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.311722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d446ddc-bj7ft" event={"ID":"2ac3f969-7ece-4563-856a-3f2dbcdcaa43","Type":"ContainerDied","Data":"fbb3699204e4ac5359375a67f8d5bcf3c6c356c3301a34a37f6f779c6c9fbd85"} Jun 10 01:11:36.311920 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.311791 2559 scope.go:117] "RemoveContainer" containerID="8e268ed82a5bb21a40e7e5405cf54823b6f7d4073ebc18be942223e2905d84ea" Jun 10 01:11:36.313515 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.313484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" event={"ID":"05c3750f-23e5-43f1-af23-255f968b69c8","Type":"ContainerStarted","Data":"b8a121845de61d1d5cb70c3173fb70db46fb2c0a15925eae547292232759f441"} Jun 10 01:11:36.315446 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.315412 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" event={"ID":"f106d980-16f9-4350-a8e7-86e09611c643","Type":"ContainerStarted","Data":"64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff"} Jun 10 01:11:36.315570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.315450 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" podUID="f106d980-16f9-4350-a8e7-86e09611c643" containerName="manager" containerID="cri-o://64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff" gracePeriod=10 Jun 10 01:11:36.315570 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.315462 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:36.331275 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.331203 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677d446ddc-bj7ft"] Jun 10 01:11:36.339352 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.338131 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677d446ddc-bj7ft"] Jun 10 01:11:36.353621 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.353569 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6xcc7" podStartSLOduration=2.09100507 podStartE2EDuration="29.353553558s" totalImagesPullingTime="27.262548488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:36.352129141 +0000 UTC m=+680.781010663" watchObservedRunningTime="2026-06-10 01:11:36.353553558 +0000 UTC m=+680.782435077" Jun 10 01:11:36.383264 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.383211 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" podStartSLOduration=1.499829541 podStartE2EDuration="18.383194245s" totalImagesPullingTime="16.883364704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:36.381790672 +0000 UTC m=+680.810672191" watchObservedRunningTime="2026-06-10 01:11:36.383194245 +0000 UTC m=+680.812075763" Jun 10 01:11:36.669466 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.669438 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:36.763250 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.763209 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f106d980-16f9-4350-a8e7-86e09611c643-extensions-socket-volume\") pod \"f106d980-16f9-4350-a8e7-86e09611c643\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " Jun 10 01:11:36.763466 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.763263 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bk7b\" (UniqueName: \"kubernetes.io/projected/f106d980-16f9-4350-a8e7-86e09611c643-kube-api-access-2bk7b\") pod \"f106d980-16f9-4350-a8e7-86e09611c643\" (UID: \"f106d980-16f9-4350-a8e7-86e09611c643\") " Jun 10 01:11:36.763842 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.763817 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f106d980-16f9-4350-a8e7-86e09611c643-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f106d980-16f9-4350-a8e7-86e09611c643" (UID: "f106d980-16f9-4350-a8e7-86e09611c643"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:11:36.765472 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.765450 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f106d980-16f9-4350-a8e7-86e09611c643-kube-api-access-2bk7b" (OuterVolumeSpecName: "kube-api-access-2bk7b") pod "f106d980-16f9-4350-a8e7-86e09611c643" (UID: "f106d980-16f9-4350-a8e7-86e09611c643"). InnerVolumeSpecName "kube-api-access-2bk7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:11:36.864236 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.864136 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bk7b\" (UniqueName: \"kubernetes.io/projected/f106d980-16f9-4350-a8e7-86e09611c643-kube-api-access-2bk7b\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:36.864236 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:36.864181 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f106d980-16f9-4350-a8e7-86e09611c643-extensions-socket-volume\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:11:37.324070 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.324035 2559 generic.go:356] "Generic (PLEG): container finished" podID="f106d980-16f9-4350-a8e7-86e09611c643" containerID="64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff" exitCode=0 Jun 10 01:11:37.324320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.324094 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" Jun 10 01:11:37.324320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.324122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" event={"ID":"f106d980-16f9-4350-a8e7-86e09611c643","Type":"ContainerDied","Data":"64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff"} Jun 10 01:11:37.324320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.324189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6" event={"ID":"f106d980-16f9-4350-a8e7-86e09611c643","Type":"ContainerDied","Data":"fd2f4b7f2c8bde89d4d6e837bb47ccd9cff0072b96580066c7a1d595f63992ac"} Jun 10 01:11:37.324320 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.324218 2559 scope.go:117] "RemoveContainer" containerID="64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff" Jun 10 01:11:37.334410 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.334390 2559 scope.go:117] "RemoveContainer" containerID="64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff" Jun 10 01:11:37.334716 ip-10-0-139-200 kubenswrapper[2559]: E0610 01:11:37.334699 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff\": container with ID starting with 64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff not found: ID does not exist" containerID="64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff" Jun 10 01:11:37.334783 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.334729 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff"} err="failed to get container status \"64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff\": rpc error: code = NotFound desc = could not find container \"64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff\": container with ID starting with 64fa2391250f2600c1d1ef16081d6cea7240891be7b806797b956d7b373ae6ff not found: ID does not exist" Jun 10 01:11:37.347849 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.347815 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6"] Jun 10 01:11:37.351947 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:37.351920 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4kv6"] Jun 10 01:11:38.066209 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:38.066172 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" path="/var/lib/kubelet/pods/2ac3f969-7ece-4563-856a-3f2dbcdcaa43/volumes" Jun 10 01:11:38.066777 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:38.066753 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f106d980-16f9-4350-a8e7-86e09611c643" path="/var/lib/kubelet/pods/f106d980-16f9-4350-a8e7-86e09611c643/volumes" Jun 10 01:11:46.921161 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921125 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv"] Jun 10 01:11:46.921682 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921664 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" containerName="console" Jun 10 01:11:46.921764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921684 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" containerName="console" Jun 10 01:11:46.921764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921696 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f106d980-16f9-4350-a8e7-86e09611c643" containerName="manager" Jun 10 01:11:46.921764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921702 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f106d980-16f9-4350-a8e7-86e09611c643" containerName="manager" Jun 10 01:11:46.921921 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921773 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac3f969-7ece-4563-856a-3f2dbcdcaa43" containerName="console" Jun 10 01:11:46.921921 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.921781 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f106d980-16f9-4350-a8e7-86e09611c643" containerName="manager" Jun 10 01:11:46.941675 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.941649 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:46.944107 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.944075 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jjt55\"" Jun 10 01:11:46.953722 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:46.953693 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv"] Jun 10 01:11:47.060219 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381706bb-27e4-41bf-bf00-37d222c31460-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381706bb-27e4-41bf-bf00-37d222c31460-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060428 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060537 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060537 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381706bb-27e4-41bf-bf00-37d222c31460-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjxr9\" (UniqueName: \"kubernetes.io/projected/381706bb-27e4-41bf-bf00-37d222c31460-kube-api-access-cjxr9\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.060614 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.060609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162167 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162167 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381706bb-27e4-41bf-bf00-37d222c31460-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjxr9\" (UniqueName: \"kubernetes.io/projected/381706bb-27e4-41bf-bf00-37d222c31460-kube-api-access-cjxr9\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162449 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162705 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381706bb-27e4-41bf-bf00-37d222c31460-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162705 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381706bb-27e4-41bf-bf00-37d222c31460-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162705 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.162860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.162743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.163052 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.163023 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.163191 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.163072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.163380 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.163359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/381706bb-27e4-41bf-bf00-37d222c31460-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.164638 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.164618 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/381706bb-27e4-41bf-bf00-37d222c31460-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.164955 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.164939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/381706bb-27e4-41bf-bf00-37d222c31460-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.184912 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.184837 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/381706bb-27e4-41bf-bf00-37d222c31460-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.186118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.186092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjxr9\" (UniqueName: \"kubernetes.io/projected/381706bb-27e4-41bf-bf00-37d222c31460-kube-api-access-cjxr9\") pod \"maas-default-gateway-openshift-default-8559cd5744-9hhzv\" (UID: \"381706bb-27e4-41bf-bf00-37d222c31460\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.254134 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.254084 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:47.410280 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.410248 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv"] Jun 10 01:11:47.411672 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:11:47.411650 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381706bb_27e4_41bf_bf00_37d222c31460.slice/crio-8951b2aa77bd8e715176a359a663d9bdf5bf4afdb5197f4ec2e17ddc000a8a33 WatchSource:0}: Error finding container 8951b2aa77bd8e715176a359a663d9bdf5bf4afdb5197f4ec2e17ddc000a8a33: Status 404 returned error can't find the container with id 8951b2aa77bd8e715176a359a663d9bdf5bf4afdb5197f4ec2e17ddc000a8a33 Jun 10 01:11:47.414230 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.414202 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:11:47.414282 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.414274 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:11:47.414349 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:47.414336 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:11:48.392962 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:48.392923 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" event={"ID":"381706bb-27e4-41bf-bf00-37d222c31460","Type":"ContainerStarted","Data":"29d84ebc7a29182e98bde8e607c793ebbcfcf3ea50b4c7de4d67b62f772dc6e1"} Jun 10 01:11:48.393451 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:48.392982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" event={"ID":"381706bb-27e4-41bf-bf00-37d222c31460","Type":"ContainerStarted","Data":"8951b2aa77bd8e715176a359a663d9bdf5bf4afdb5197f4ec2e17ddc000a8a33"} Jun 10 01:11:48.436273 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:48.436221 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" podStartSLOduration=2.436204331 podStartE2EDuration="2.436204331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:48.435940708 +0000 UTC m=+692.864822223" watchObservedRunningTime="2026-06-10 01:11:48.436204331 +0000 UTC m=+692.865085850" Jun 10 01:11:49.255139 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.255096 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:49.259923 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.259896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:49.399047 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.399011 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:49.400163 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.400137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:11:49.880567 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.880532 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:11:49.884217 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.884198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:49.886655 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.886630 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 01:11:49.893178 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.893156 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:11:49.924372 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.924338 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:11:49.991749 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.991708 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrxc\" (UniqueName: \"kubernetes.io/projected/af9744d1-c6f6-4a48-ab7e-a1ab76174233-kube-api-access-sgrxc\") pod \"limitador-limitador-54d6d988d5-x9zlh\" (UID: \"af9744d1-c6f6-4a48-ab7e-a1ab76174233\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:49.991947 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:49.991773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af9744d1-c6f6-4a48-ab7e-a1ab76174233-config-file\") pod \"limitador-limitador-54d6d988d5-x9zlh\" (UID: \"af9744d1-c6f6-4a48-ab7e-a1ab76174233\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:50.092903 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.092862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrxc\" (UniqueName: \"kubernetes.io/projected/af9744d1-c6f6-4a48-ab7e-a1ab76174233-kube-api-access-sgrxc\") pod \"limitador-limitador-54d6d988d5-x9zlh\" (UID: \"af9744d1-c6f6-4a48-ab7e-a1ab76174233\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:50.093115 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.092950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af9744d1-c6f6-4a48-ab7e-a1ab76174233-config-file\") pod \"limitador-limitador-54d6d988d5-x9zlh\" (UID: \"af9744d1-c6f6-4a48-ab7e-a1ab76174233\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:50.093703 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.093680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af9744d1-c6f6-4a48-ab7e-a1ab76174233-config-file\") pod \"limitador-limitador-54d6d988d5-x9zlh\" (UID: \"af9744d1-c6f6-4a48-ab7e-a1ab76174233\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:50.100994 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.100967 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrxc\" (UniqueName: \"kubernetes.io/projected/af9744d1-c6f6-4a48-ab7e-a1ab76174233-kube-api-access-sgrxc\") pod \"limitador-limitador-54d6d988d5-x9zlh\" (UID: \"af9744d1-c6f6-4a48-ab7e-a1ab76174233\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:50.196368 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.196335 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:50.359910 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.359878 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:11:50.361917 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:11:50.361888 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9744d1_c6f6_4a48_ab7e_a1ab76174233.slice/crio-d17705080ca55a559e22dd3b9a75603ef202c460526a58207f06da8627e7dff9 WatchSource:0}: Error finding container d17705080ca55a559e22dd3b9a75603ef202c460526a58207f06da8627e7dff9: Status 404 returned error can't find the container with id d17705080ca55a559e22dd3b9a75603ef202c460526a58207f06da8627e7dff9 Jun 10 01:11:50.406235 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:50.406196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" event={"ID":"af9744d1-c6f6-4a48-ab7e-a1ab76174233","Type":"ContainerStarted","Data":"d17705080ca55a559e22dd3b9a75603ef202c460526a58207f06da8627e7dff9"} Jun 10 01:11:54.434795 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:54.434751 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" event={"ID":"af9744d1-c6f6-4a48-ab7e-a1ab76174233","Type":"ContainerStarted","Data":"46c46c5b84496598716dc09fbde858d69327f7eaf7eb29fd9326bde0840401a6"} Jun 10 01:11:54.435172 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:54.434889 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:11:54.451645 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:11:54.451587 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" podStartSLOduration=2.149516731 podStartE2EDuration="5.451571948s" totalImagesPullingTime="3.302055217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:54.449705472 +0000 UTC m=+698.878586989" watchObservedRunningTime="2026-06-10 01:11:54.451571948 +0000 UTC m=+698.880453465" Jun 10 01:12:05.441976 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:05.441943 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-x9zlh" Jun 10 01:12:25.109602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.109561 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw"] Jun 10 01:12:25.118792 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.118764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.120704 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.120677 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw"] Jun 10 01:12:25.121350 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.121324 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 01:12:25.121499 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.121378 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 01:12:25.122146 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.122126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z785z\"" Jun 10 01:12:25.240527 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.240488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.240731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.240564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.240731 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.240608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sjbg\" (UniqueName: \"kubernetes.io/projected/04e12679-f891-47ca-903c-781a30837601-kube-api-access-9sjbg\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.341550 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.341505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.341775 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.341584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.341775 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.341641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sjbg\" (UniqueName: \"kubernetes.io/projected/04e12679-f891-47ca-903c-781a30837601-kube-api-access-9sjbg\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.341958 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.341896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.341958 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.341926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.349949 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.349923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sjbg\" (UniqueName: \"kubernetes.io/projected/04e12679-f891-47ca-903c-781a30837601-kube-api-access-9sjbg\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.429227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.429181 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:25.574178 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.574148 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw"] Jun 10 01:12:25.575025 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:12:25.574997 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e12679_f891_47ca_903c_781a30837601.slice/crio-e7d82ae1addafc7a3b69fc5ce34d7b5f1d8b1b8a1c3737169437db58a4347407 WatchSource:0}: Error finding container e7d82ae1addafc7a3b69fc5ce34d7b5f1d8b1b8a1c3737169437db58a4347407: Status 404 returned error can't find the container with id e7d82ae1addafc7a3b69fc5ce34d7b5f1d8b1b8a1c3737169437db58a4347407 Jun 10 01:12:25.621611 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:25.621566 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" event={"ID":"04e12679-f891-47ca-903c-781a30837601","Type":"ContainerStarted","Data":"e7d82ae1addafc7a3b69fc5ce34d7b5f1d8b1b8a1c3737169437db58a4347407"} Jun 10 01:12:26.628750 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:26.628653 2559 generic.go:356] "Generic (PLEG): container finished" podID="04e12679-f891-47ca-903c-781a30837601" containerID="971a628ab657b0545d4e67c1edbe61506a807e708bc76e97b4136117026d3058" exitCode=0 Jun 10 01:12:26.629115 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:26.628743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" event={"ID":"04e12679-f891-47ca-903c-781a30837601","Type":"ContainerDied","Data":"971a628ab657b0545d4e67c1edbe61506a807e708bc76e97b4136117026d3058"} Jun 10 01:12:27.636987 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:27.636892 2559 generic.go:356] "Generic (PLEG): container finished" podID="04e12679-f891-47ca-903c-781a30837601" containerID="80ce679c0e36600e90a9836b4b6a702b59a00c44c69e82a657b5dbee68e0a358" exitCode=0 Jun 10 01:12:27.637494 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:27.636982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" event={"ID":"04e12679-f891-47ca-903c-781a30837601","Type":"ContainerDied","Data":"80ce679c0e36600e90a9836b4b6a702b59a00c44c69e82a657b5dbee68e0a358"} Jun 10 01:12:28.644823 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:28.644781 2559 generic.go:356] "Generic (PLEG): container finished" podID="04e12679-f891-47ca-903c-781a30837601" containerID="70ba4322841b7c6d93c5684e5d2805a83951d190bcf36f48a4a1970daace9c86" exitCode=0 Jun 10 01:12:28.645245 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:28.644841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" event={"ID":"04e12679-f891-47ca-903c-781a30837601","Type":"ContainerDied","Data":"70ba4322841b7c6d93c5684e5d2805a83951d190bcf36f48a4a1970daace9c86"} Jun 10 01:12:29.797105 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.797078 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:29.887108 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.887075 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-bundle\") pod \"04e12679-f891-47ca-903c-781a30837601\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " Jun 10 01:12:29.887360 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.887123 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sjbg\" (UniqueName: \"kubernetes.io/projected/04e12679-f891-47ca-903c-781a30837601-kube-api-access-9sjbg\") pod \"04e12679-f891-47ca-903c-781a30837601\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " Jun 10 01:12:29.887360 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.887213 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-util\") pod \"04e12679-f891-47ca-903c-781a30837601\" (UID: \"04e12679-f891-47ca-903c-781a30837601\") " Jun 10 01:12:29.887728 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.887699 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-bundle" (OuterVolumeSpecName: "bundle") pod "04e12679-f891-47ca-903c-781a30837601" (UID: "04e12679-f891-47ca-903c-781a30837601"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:29.889358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.889329 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e12679-f891-47ca-903c-781a30837601-kube-api-access-9sjbg" (OuterVolumeSpecName: "kube-api-access-9sjbg") pod "04e12679-f891-47ca-903c-781a30837601" (UID: "04e12679-f891-47ca-903c-781a30837601"). InnerVolumeSpecName "kube-api-access-9sjbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:12:29.896167 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.896137 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-util" (OuterVolumeSpecName: "util") pod "04e12679-f891-47ca-903c-781a30837601" (UID: "04e12679-f891-47ca-903c-781a30837601"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:12:29.988662 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.988617 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-util\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:12:29.988662 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.988651 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04e12679-f891-47ca-903c-781a30837601-bundle\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:12:29.988662 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:29.988660 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sjbg\" (UniqueName: \"kubernetes.io/projected/04e12679-f891-47ca-903c-781a30837601-kube-api-access-9sjbg\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:12:30.659028 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:30.658992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" event={"ID":"04e12679-f891-47ca-903c-781a30837601","Type":"ContainerDied","Data":"e7d82ae1addafc7a3b69fc5ce34d7b5f1d8b1b8a1c3737169437db58a4347407"} Jun 10 01:12:30.659209 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:30.659040 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487qgvw" Jun 10 01:12:30.659209 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:12:30.659069 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7d82ae1addafc7a3b69fc5ce34d7b5f1d8b1b8a1c3737169437db58a4347407" Jun 10 01:14:00.733978 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:00.733944 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:14:09.253891 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:09.253852 2559 generic.go:356] "Generic (PLEG): container finished" podID="381706bb-27e4-41bf-bf00-37d222c31460" containerID="29d84ebc7a29182e98bde8e607c793ebbcfcf3ea50b4c7de4d67b62f772dc6e1" exitCode=0 Jun 10 01:14:09.254386 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:09.253925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" event={"ID":"381706bb-27e4-41bf-bf00-37d222c31460","Type":"ContainerDied","Data":"29d84ebc7a29182e98bde8e607c793ebbcfcf3ea50b4c7de4d67b62f772dc6e1"} Jun 10 01:14:09.254386 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:09.254368 2559 scope.go:117] "RemoveContainer" containerID="29d84ebc7a29182e98bde8e607c793ebbcfcf3ea50b4c7de4d67b62f772dc6e1" Jun 10 01:14:09.255447 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:09.255423 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:14:09.255508 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:09.255490 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:14:09.255545 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:09.255519 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:14:10.262526 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:10.262494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" event={"ID":"381706bb-27e4-41bf-bf00-37d222c31460","Type":"ContainerStarted","Data":"3e0dfff93fe4071f1e9fe535a65bce6e72dd4c43d0bd1b7fec36a2f0cf0505ac"} Jun 10 01:14:11.255182 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:11.255144 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:14:11.255413 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:11.255392 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-9hhzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jun 10 01:14:11.259313 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:11.255833 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" podUID="381706bb-27e4-41bf-bf00-37d222c31460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jun 10 01:14:12.255451 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:12.255410 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-9hhzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jun 10 01:14:12.255858 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:12.255478 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" podUID="381706bb-27e4-41bf-bf00-37d222c31460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jun 10 01:14:13.255190 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:13.255147 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-9hhzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jun 10 01:14:13.255416 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:13.255214 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" podUID="381706bb-27e4-41bf-bf00-37d222c31460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jun 10 01:14:14.254918 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:14.254883 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-9hhzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jun 10 01:14:14.255377 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:14.254938 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" podUID="381706bb-27e4-41bf-bf00-37d222c31460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jun 10 01:14:15.259557 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:15.259526 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:14:15.259990 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:15.259855 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:14:15.260605 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:14:15.260584 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-9hhzv" Jun 10 01:15:00.141717 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.141671 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684235-zcc4z"] Jun 10 01:15:00.142277 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142254 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="pull" Jun 10 01:15:00.142404 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142281 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="pull" Jun 10 01:15:00.142404 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142331 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="util" Jun 10 01:15:00.142404 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142340 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="util" Jun 10 01:15:00.142404 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142364 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="extract" Jun 10 01:15:00.142404 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142373 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="extract" Jun 10 01:15:00.142653 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.142491 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e12679-f891-47ca-903c-781a30837601" containerName="extract" Jun 10 01:15:00.145728 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.145705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:00.149065 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.149040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ss7nm\"" Jun 10 01:15:00.151862 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.151834 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684235-zcc4z"] Jun 10 01:15:00.182280 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.182240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k4zq\" (UniqueName: \"kubernetes.io/projected/f802e82e-3da3-4804-9726-64f21c888af6-kube-api-access-7k4zq\") pod \"maas-api-key-cleanup-29684235-zcc4z\" (UID: \"f802e82e-3da3-4804-9726-64f21c888af6\") " pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:00.283334 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.283257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k4zq\" (UniqueName: \"kubernetes.io/projected/f802e82e-3da3-4804-9726-64f21c888af6-kube-api-access-7k4zq\") pod \"maas-api-key-cleanup-29684235-zcc4z\" (UID: \"f802e82e-3da3-4804-9726-64f21c888af6\") " pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:00.293345 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.293315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k4zq\" (UniqueName: \"kubernetes.io/projected/f802e82e-3da3-4804-9726-64f21c888af6-kube-api-access-7k4zq\") pod \"maas-api-key-cleanup-29684235-zcc4z\" (UID: \"f802e82e-3da3-4804-9726-64f21c888af6\") " pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:00.474704 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.474661 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:00.615059 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:00.615034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684235-zcc4z"] Jun 10 01:15:00.616499 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:15:00.616475 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf802e82e_3da3_4804_9726_64f21c888af6.slice/crio-5e88910d4bc9f41438eb018714f7dac63920992ee5dbb48dfc518db958f5c832 WatchSource:0}: Error finding container 5e88910d4bc9f41438eb018714f7dac63920992ee5dbb48dfc518db958f5c832: Status 404 returned error can't find the container with id 5e88910d4bc9f41438eb018714f7dac63920992ee5dbb48dfc518db958f5c832 Jun 10 01:15:01.403079 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.403046 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf"] Jun 10 01:15:01.407776 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.407754 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.410402 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.410376 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 01:15:01.411252 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.411225 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 01:15:01.411252 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.411247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5ql7f\"" Jun 10 01:15:01.411516 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.411501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 01:15:01.416825 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.416799 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf"] Jun 10 01:15:01.497066 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.497021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.497227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.497149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.497227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.497185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.497227 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.497218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8vh\" (UniqueName: \"kubernetes.io/projected/3629de7f-4fae-4d49-8e03-e6fd61746d0f-kube-api-access-hc8vh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.497375 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.497253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3629de7f-4fae-4d49-8e03-e6fd61746d0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.497375 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.497336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.581580 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.581540 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" event={"ID":"f802e82e-3da3-4804-9726-64f21c888af6","Type":"ContainerStarted","Data":"5e88910d4bc9f41438eb018714f7dac63920992ee5dbb48dfc518db958f5c832"} Jun 10 01:15:01.598834 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.598806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.598969 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.598842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.598969 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.598871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8vh\" (UniqueName: \"kubernetes.io/projected/3629de7f-4fae-4d49-8e03-e6fd61746d0f-kube-api-access-hc8vh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.598969 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.598917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3629de7f-4fae-4d49-8e03-e6fd61746d0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.598969 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.598948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.599152 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.599010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.599357 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.599280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.599485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.599399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.599485 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.599435 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.601778 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.601753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3629de7f-4fae-4d49-8e03-e6fd61746d0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.601973 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.601943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3629de7f-4fae-4d49-8e03-e6fd61746d0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.613182 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.613146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8vh\" (UniqueName: \"kubernetes.io/projected/3629de7f-4fae-4d49-8e03-e6fd61746d0f-kube-api-access-hc8vh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf\" (UID: \"3629de7f-4fae-4d49-8e03-e6fd61746d0f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.721267 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.721233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:01.880617 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.880582 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf"] Jun 10 01:15:01.881610 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:15:01.881576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3629de7f_4fae_4d49_8e03_e6fd61746d0f.slice/crio-85a4b7e11faae829ac8ec7b01bd8fca1e13ce6147b2d53aefc500d8116676cc7 WatchSource:0}: Error finding container 85a4b7e11faae829ac8ec7b01bd8fca1e13ce6147b2d53aefc500d8116676cc7: Status 404 returned error can't find the container with id 85a4b7e11faae829ac8ec7b01bd8fca1e13ce6147b2d53aefc500d8116676cc7 Jun 10 01:15:01.901094 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:01.901066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:15:02.588720 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:02.588686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" event={"ID":"3629de7f-4fae-4d49-8e03-e6fd61746d0f","Type":"ContainerStarted","Data":"85a4b7e11faae829ac8ec7b01bd8fca1e13ce6147b2d53aefc500d8116676cc7"} Jun 10 01:15:04.605681 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:04.605628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" event={"ID":"f802e82e-3da3-4804-9726-64f21c888af6","Type":"ContainerStarted","Data":"a72be87c438c13457468e516b951f20a5d92edb8155e38d80b6c41fec585ee4e"} Jun 10 01:15:04.620950 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:04.620890 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" podStartSLOduration=1.829387417 podStartE2EDuration="4.620871791s" totalImagesPullingTime="2.791484374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:04.619538392 +0000 UTC m=+889.048419911" watchObservedRunningTime="2026-06-10 01:15:04.620871791 +0000 UTC m=+889.049753309" Jun 10 01:15:05.614424 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:05.614385 2559 generic.go:356] "Generic (PLEG): container finished" podID="f802e82e-3da3-4804-9726-64f21c888af6" containerID="a72be87c438c13457468e516b951f20a5d92edb8155e38d80b6c41fec585ee4e" exitCode=0 Jun 10 01:15:05.614852 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:05.614476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" event={"ID":"f802e82e-3da3-4804-9726-64f21c888af6","Type":"ContainerDied","Data":"a72be87c438c13457468e516b951f20a5d92edb8155e38d80b6c41fec585ee4e"} Jun 10 01:15:06.622319 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:06.622267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" event={"ID":"3629de7f-4fae-4d49-8e03-e6fd61746d0f","Type":"ContainerStarted","Data":"8840baa13ade38937750c722eaa1c5dfb674f5262afb21e5e4a24081507546cc"} Jun 10 01:15:06.761353 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:06.761327 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:06.852882 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:06.852849 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k4zq\" (UniqueName: \"kubernetes.io/projected/f802e82e-3da3-4804-9726-64f21c888af6-kube-api-access-7k4zq\") pod \"f802e82e-3da3-4804-9726-64f21c888af6\" (UID: \"f802e82e-3da3-4804-9726-64f21c888af6\") " Jun 10 01:15:06.855438 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:06.855403 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f802e82e-3da3-4804-9726-64f21c888af6-kube-api-access-7k4zq" (OuterVolumeSpecName: "kube-api-access-7k4zq") pod "f802e82e-3da3-4804-9726-64f21c888af6" (UID: "f802e82e-3da3-4804-9726-64f21c888af6"). InnerVolumeSpecName "kube-api-access-7k4zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:15:06.953904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:06.953847 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k4zq\" (UniqueName: \"kubernetes.io/projected/f802e82e-3da3-4804-9726-64f21c888af6-kube-api-access-7k4zq\") on node \"ip-10-0-139-200.ec2.internal\" DevicePath \"\"" Jun 10 01:15:07.630447 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:07.630412 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" Jun 10 01:15:07.630859 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:07.630446 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-zcc4z" event={"ID":"f802e82e-3da3-4804-9726-64f21c888af6","Type":"ContainerDied","Data":"5e88910d4bc9f41438eb018714f7dac63920992ee5dbb48dfc518db958f5c832"} Jun 10 01:15:07.630859 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:07.630500 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e88910d4bc9f41438eb018714f7dac63920992ee5dbb48dfc518db958f5c832" Jun 10 01:15:08.290776 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:08.290735 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:15:08.638068 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:08.638034 2559 generic.go:356] "Generic (PLEG): container finished" podID="3629de7f-4fae-4d49-8e03-e6fd61746d0f" containerID="8840baa13ade38937750c722eaa1c5dfb674f5262afb21e5e4a24081507546cc" exitCode=0 Jun 10 01:15:08.638497 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:08.638091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" event={"ID":"3629de7f-4fae-4d49-8e03-e6fd61746d0f","Type":"ContainerDied","Data":"8840baa13ade38937750c722eaa1c5dfb674f5262afb21e5e4a24081507546cc"} Jun 10 01:15:10.653283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:10.653247 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" event={"ID":"3629de7f-4fae-4d49-8e03-e6fd61746d0f","Type":"ContainerStarted","Data":"ad226d4fd38aa787325030bdc9662f4701eaafc8143226bf449e4b3a5f7b7878"} Jun 10 01:15:10.671763 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:10.670906 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" podStartSLOduration=2.411426358 podStartE2EDuration="9.670889753s" totalImagesPullingTime="5.687262965s" totalInitContainerRuntime="1.57220043s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:10.670174111 +0000 UTC m=+895.099055640" watchObservedRunningTime="2026-06-10 01:15:10.670889753 +0000 UTC m=+895.099771313" Jun 10 01:15:11.721606 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:11.721551 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:11.722060 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:11.721636 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:11.734317 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:11.734271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:12.677972 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:12.677937 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf" Jun 10 01:15:21.380405 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:21.380367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:15:30.687016 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.686980 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm"] Jun 10 01:15:30.687531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.687461 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f802e82e-3da3-4804-9726-64f21c888af6" containerName="cleanup" Jun 10 01:15:30.687531 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.687476 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f802e82e-3da3-4804-9726-64f21c888af6" containerName="cleanup" Jun 10 01:15:30.687609 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.687557 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f802e82e-3da3-4804-9726-64f21c888af6" containerName="cleanup" Jun 10 01:15:30.712636 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.712605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm"] Jun 10 01:15:30.712790 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.712722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.715222 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.715198 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 01:15:30.794434 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.794397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.794657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.794494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.794657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.794519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.794657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.794544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjzn\" (UniqueName: \"kubernetes.io/projected/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-kube-api-access-qpjzn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.794657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.794573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.794657 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.794606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.895569 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.895764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.895764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.895764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjzn\" (UniqueName: \"kubernetes.io/projected/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-kube-api-access-qpjzn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.895764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.895764 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.896027 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.895965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.896078 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.896049 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.896149 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.896128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.897995 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.897965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.898142 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.898125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:30.903153 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:30.903130 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjzn\" (UniqueName: \"kubernetes.io/projected/d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096-kube-api-access-qpjzn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm\" (UID: \"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:31.023223 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:31.023124 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" Jun 10 01:15:31.161829 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:31.161802 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm"] Jun 10 01:15:31.162783 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:15:31.162755 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ff6ece_d3ee_4f59_9c67_ab1fd9a19096.slice/crio-879791a48314e83a58c4dea2c8690774362dfdda45a64f954734c7a7a704aeff WatchSource:0}: Error finding container 879791a48314e83a58c4dea2c8690774362dfdda45a64f954734c7a7a704aeff: Status 404 returned error can't find the container with id 879791a48314e83a58c4dea2c8690774362dfdda45a64f954734c7a7a704aeff Jun 10 01:15:31.586840 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:31.586803 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:15:31.785889 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:31.785852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" event={"ID":"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096","Type":"ContainerStarted","Data":"4116f61dc379b7d4031f84f37a8c43f3b767be08d7d5b90ca957db0e121cb4da"} Jun 10 01:15:31.786283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:31.785905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm" event={"ID":"d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096","Type":"ContainerStarted","Data":"879791a48314e83a58c4dea2c8690774362dfdda45a64f954734c7a7a704aeff"} Jun 10 01:15:53.002380 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:15:53.002342 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:16:06.676486 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.676443 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw"] Jun 10 01:16:06.681235 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.681214 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.683307 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.683267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 01:16:06.688645 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.688621 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw"] Jun 10 01:16:06.836434 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.836398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.836613 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.836449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.836613 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.836500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.836613 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.836593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnfd\" (UniqueName: \"kubernetes.io/projected/9178d169-daf6-43d7-9be2-db3bc2b7d28c-kube-api-access-lfnfd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.836773 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.836650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.836773 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.836693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9178d169-daf6-43d7-9be2-db3bc2b7d28c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938050 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.937957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9178d169-daf6-43d7-9be2-db3bc2b7d28c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938050 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938249 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938391 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnfd\" (UniqueName: \"kubernetes.io/projected/9178d169-daf6-43d7-9be2-db3bc2b7d28c-kube-api-access-lfnfd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938391 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938503 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938562 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.938678 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.938655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.940344 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.940325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9178d169-daf6-43d7-9be2-db3bc2b7d28c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.940547 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.940530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9178d169-daf6-43d7-9be2-db3bc2b7d28c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.945650 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.945625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnfd\" (UniqueName: \"kubernetes.io/projected/9178d169-daf6-43d7-9be2-db3bc2b7d28c-kube-api-access-lfnfd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-5xcrw\" (UID: \"9178d169-daf6-43d7-9be2-db3bc2b7d28c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:06.992828 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:06.992791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:07.136810 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:07.136785 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw"] Jun 10 01:16:07.138713 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:16:07.138679 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9178d169_daf6_43d7_9be2_db3bc2b7d28c.slice/crio-b470c987f3e806461b6ed6792740ee97f036744af364d234810539a5ce2bfb7f WatchSource:0}: Error finding container b470c987f3e806461b6ed6792740ee97f036744af364d234810539a5ce2bfb7f: Status 404 returned error can't find the container with id b470c987f3e806461b6ed6792740ee97f036744af364d234810539a5ce2bfb7f Jun 10 01:16:07.784784 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:07.784745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:16:08.015946 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:08.015899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" event={"ID":"9178d169-daf6-43d7-9be2-db3bc2b7d28c","Type":"ContainerStarted","Data":"179dc797c4f00e8b41f21e145e303369298f10251a9592d0a4bf6208ed1db855"} Jun 10 01:16:08.015946 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:08.015951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" event={"ID":"9178d169-daf6-43d7-9be2-db3bc2b7d28c","Type":"ContainerStarted","Data":"b470c987f3e806461b6ed6792740ee97f036744af364d234810539a5ce2bfb7f"} Jun 10 01:16:10.030406 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:10.030371 2559 generic.go:356] "Generic (PLEG): container finished" podID="9178d169-daf6-43d7-9be2-db3bc2b7d28c" containerID="179dc797c4f00e8b41f21e145e303369298f10251a9592d0a4bf6208ed1db855" exitCode=0 Jun 10 01:16:10.030823 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:10.030445 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" event={"ID":"9178d169-daf6-43d7-9be2-db3bc2b7d28c","Type":"ContainerDied","Data":"179dc797c4f00e8b41f21e145e303369298f10251a9592d0a4bf6208ed1db855"} Jun 10 01:16:10.031050 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:10.031034 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:16:11.038524 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:11.038484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" event={"ID":"9178d169-daf6-43d7-9be2-db3bc2b7d28c","Type":"ContainerStarted","Data":"c967af3ef1ba5748935485112d48f439d060382e956d6bd6274bfaa1f6166cbb"} Jun 10 01:16:11.057609 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:11.057555 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" podStartSLOduration=2.567044765 podStartE2EDuration="5.05753952s" totalImagesPullingTime="196.232209ms" totalInitContainerRuntime="2.294262546s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:16:11.05630655 +0000 UTC m=+955.485188077" watchObservedRunningTime="2026-06-10 01:16:11.05753952 +0000 UTC m=+955.486421039" Jun 10 01:16:16.993202 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:16.993167 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:16.993725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:16.993218 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:17.005906 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:17.005880 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:16:17.086336 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:16:17.086303 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-5xcrw" Jun 10 01:17:38.579826 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:17:38.579786 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:17:47.375276 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:17:47.375239 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:17:57.486181 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:17:57.486142 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:18:07.087268 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:18:07.087227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:18:16.887287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:18:16.887246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:18:26.885465 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:18:26.885417 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:18:58.788234 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:18:58.788189 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:19:02.382189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:19:02.382141 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:19:38.995470 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:19:38.995391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:19:55.289739 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:19:55.289700 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:20:32.896901 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:20:32.896855 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:20:49.680071 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:20:49.680033 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:21:04.187675 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:21:04.187637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:21:20.178010 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:21:20.177972 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:21:41.382282 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:21:41.382246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:21:45.792347 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:21:45.792307 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:22:21.382094 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:22:21.382053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:22:29.587467 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:22:29.587428 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:22:46.477534 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:22:46.477494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:22:55.085618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:22:55.085575 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:23:12.488397 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:23:12.488356 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:23:20.485782 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:23:20.485743 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:23:53.393977 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:23:53.393935 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:02.092847 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:02.092811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:11.074806 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:11.074766 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:18.583192 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:18.583144 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:27.079882 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:27.079848 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:35.694465 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:35.694426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:39.384885 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:39.384846 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:24:52.380308 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:24:52.380265 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:25:04.279102 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:25:04.279056 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:25:31.877994 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:25:31.877948 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:25:34.484122 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:25:34.484041 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:25:51.889722 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:25:51.889685 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:25:58.785207 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:25:58.785159 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:26:17.683811 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:26:17.683778 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:26:22.721140 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:26:22.721104 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:26:26.182495 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:26:26.182455 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:26:36.378224 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:26:36.378189 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:26:43.977813 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:26:43.977778 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:26:52.987406 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:26:52.987358 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:27:02.079287 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:27:02.079252 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:27:11.784457 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:27:11.784420 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:27:18.885716 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:27:18.885666 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:27:27.087953 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:27:27.087913 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:27:35.585793 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:27:35.585755 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:30:02.786317 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:30:02.786252 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:30:07.387205 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:30:07.387172 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:30:33.486178 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:30:33.486137 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:30:37.979042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:30:37.979000 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:30:45.285540 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:30:45.285502 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:30:55.787451 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:30:55.787409 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:31:04.487804 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:31:04.487771 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:31:15.583518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:31:15.583481 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:31:26.085648 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:31:26.085610 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:31:35.083904 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:31:35.083812 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:31:44.388835 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:31:44.388790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:31:55.703801 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:31:55.703762 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:32:05.487920 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:32:05.487821 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:32:10.386988 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:32:10.386951 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:33:39.983610 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:33:39.983565 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x9zlh"] Jun 10 01:34:09.736430 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:09.736400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6c9bfb4667-pwphh_5de3dba1-68bc-45fc-857a-71572e633382/nginx/0.log" Jun 10 01:34:10.250539 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:10.250504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684235-zcc4z_f802e82e-3da3-4804-9726-64f21c888af6/cleanup/0.log" Jun 10 01:34:11.056527 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:11.056494 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-rgtnp_0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7/copy-manifests/0.log" Jun 10 01:34:11.075860 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:11.075824 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-rgtnp_0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7/manager/0.log" Jun 10 01:34:11.919317 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:11.919265 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j_95aa7a2f-d9c8-4b9b-a600-094dacdabd21/util/0.log" Jun 10 01:34:11.925371 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:11.925348 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j_95aa7a2f-d9c8-4b9b-a600-094dacdabd21/pull/0.log" Jun 10 01:34:11.930799 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:11.930780 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j_95aa7a2f-d9c8-4b9b-a600-094dacdabd21/extract/0.log" Jun 10 01:34:12.033688 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.033657 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx_a7e1e853-c813-4925-8f38-f64e140a3885/util/0.log" Jun 10 01:34:12.040036 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.039996 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx_a7e1e853-c813-4925-8f38-f64e140a3885/pull/0.log" Jun 10 01:34:12.046189 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.046158 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx_a7e1e853-c813-4925-8f38-f64e140a3885/extract/0.log" Jun 10 01:34:12.152245 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.152215 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j_aea4c58b-e9bc-4cd4-94dd-ae49160ea49e/util/0.log" Jun 10 01:34:12.158567 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.158509 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j_aea4c58b-e9bc-4cd4-94dd-ae49160ea49e/pull/0.log" Jun 10 01:34:12.164252 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.164224 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j_aea4c58b-e9bc-4cd4-94dd-ae49160ea49e/extract/0.log" Jun 10 01:34:12.271419 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.271391 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk_65290a14-f279-44ab-b2e0-2ff799fdec85/util/0.log" Jun 10 01:34:12.277601 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.277571 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk_65290a14-f279-44ab-b2e0-2ff799fdec85/pull/0.log" Jun 10 01:34:12.283600 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.283580 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk_65290a14-f279-44ab-b2e0-2ff799fdec85/extract/0.log" Jun 10 01:34:12.532115 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.532030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wn6r4_b2543c74-bb93-42b3-8b78-884db12fbd39/manager/0.log" Jun 10 01:34:12.745553 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.745523 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6xcc7_05c3750f-23e5-43f1-af23-255f968b69c8/kuadrant-console-plugin/0.log" Jun 10 01:34:12.859567 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:12.859477 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-txvwd_43c1beef-4f7e-4248-8660-0f68b6752fca/registry-server/0.log" Jun 10 01:34:13.106800 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:13.106770 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-x9zlh_af9744d1-c6f6-4a48-ab7e-a1ab76174233/limitador/0.log" Jun 10 01:34:13.566283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:13.566243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcnfzt5_5f36dbe5-c05c-472d-8944-6bb58f2a8a24/istio-proxy/0.log" Jun 10 01:34:14.017076 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:14.017040 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/1.log" Jun 10 01:34:14.683934 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:14.683897 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf_3629de7f-4fae-4d49-8e03-e6fd61746d0f/main/0.log" Jun 10 01:34:14.690782 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:14.690749 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2f5gf_3629de7f-4fae-4d49-8e03-e6fd61746d0f/storage-initializer/0.log" Jun 10 01:34:15.031218 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:15.031135 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvp7sm_d5ff6ece-d3ee-4f59-9c67-ab1fd9a19096/storage-initializer/0.log" Jun 10 01:34:15.266745 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:15.266709 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-5xcrw_9178d169-daf6-43d7-9be2-db3bc2b7d28c/storage-initializer/0.log" Jun 10 01:34:15.274717 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:15.274691 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-5xcrw_9178d169-daf6-43d7-9be2-db3bc2b7d28c/main/0.log" Jun 10 01:34:19.018789 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.018749 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qwhkl/must-gather-sq6tg"] Jun 10 01:34:19.022489 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.022468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.024787 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.024764 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwhkl\"/\"openshift-service-ca.crt\"" Jun 10 01:34:19.025484 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.025463 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwhkl\"/\"kube-root-ca.crt\"" Jun 10 01:34:19.025618 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.025481 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qwhkl\"/\"default-dockercfg-jkj8p\"" Jun 10 01:34:19.039339 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.039311 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwhkl/must-gather-sq6tg"] Jun 10 01:34:19.156200 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.156161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1edcb327-64ce-4460-b25d-bfd31d2bcdce-must-gather-output\") pod \"must-gather-sq6tg\" (UID: \"1edcb327-64ce-4460-b25d-bfd31d2bcdce\") " pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.156427 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.156285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stvwd\" (UniqueName: \"kubernetes.io/projected/1edcb327-64ce-4460-b25d-bfd31d2bcdce-kube-api-access-stvwd\") pod \"must-gather-sq6tg\" (UID: \"1edcb327-64ce-4460-b25d-bfd31d2bcdce\") " pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.257944 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.257901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1edcb327-64ce-4460-b25d-bfd31d2bcdce-must-gather-output\") pod \"must-gather-sq6tg\" (UID: \"1edcb327-64ce-4460-b25d-bfd31d2bcdce\") " pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.258120 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.258037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stvwd\" (UniqueName: \"kubernetes.io/projected/1edcb327-64ce-4460-b25d-bfd31d2bcdce-kube-api-access-stvwd\") pod \"must-gather-sq6tg\" (UID: \"1edcb327-64ce-4460-b25d-bfd31d2bcdce\") " pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.258313 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.258268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1edcb327-64ce-4460-b25d-bfd31d2bcdce-must-gather-output\") pod \"must-gather-sq6tg\" (UID: \"1edcb327-64ce-4460-b25d-bfd31d2bcdce\") " pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.265385 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.265356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stvwd\" (UniqueName: \"kubernetes.io/projected/1edcb327-64ce-4460-b25d-bfd31d2bcdce-kube-api-access-stvwd\") pod \"must-gather-sq6tg\" (UID: \"1edcb327-64ce-4460-b25d-bfd31d2bcdce\") " pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.332599 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.332500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwhkl/must-gather-sq6tg" Jun 10 01:34:19.473194 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.473165 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwhkl/must-gather-sq6tg"] Jun 10 01:34:19.474367 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:34:19.474335 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1edcb327_64ce_4460_b25d_bfd31d2bcdce.slice/crio-c546cd2b37f6607e9162772b64e36ca7d00f3fc9ee306164ef2696f9642198c2 WatchSource:0}: Error finding container c546cd2b37f6607e9162772b64e36ca7d00f3fc9ee306164ef2696f9642198c2: Status 404 returned error can't find the container with id c546cd2b37f6607e9162772b64e36ca7d00f3fc9ee306164ef2696f9642198c2 Jun 10 01:34:19.476344 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.476326 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:34:19.600813 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:19.600722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/must-gather-sq6tg" event={"ID":"1edcb327-64ce-4460-b25d-bfd31d2bcdce","Type":"ContainerStarted","Data":"c546cd2b37f6607e9162772b64e36ca7d00f3fc9ee306164ef2696f9642198c2"} Jun 10 01:34:20.610602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:20.610502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/must-gather-sq6tg" event={"ID":"1edcb327-64ce-4460-b25d-bfd31d2bcdce","Type":"ContainerStarted","Data":"833aebed2412dec80d69ac96c625f6b0a726c05006819457a65e03eb0436b52e"} Jun 10 01:34:20.610602 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:20.610547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/must-gather-sq6tg" event={"ID":"1edcb327-64ce-4460-b25d-bfd31d2bcdce","Type":"ContainerStarted","Data":"c17ac27957f5a87a7e8634ac7ec1d82fd633ea94a74a245520a992d6c2e34d72"} Jun 10 01:34:20.627917 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:20.627854 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qwhkl/must-gather-sq6tg" podStartSLOduration=0.786818509 podStartE2EDuration="1.627835588s" totalImagesPullingTime="841.017079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:34:20.625040541 +0000 UTC m=+2045.053922060" watchObservedRunningTime="2026-06-10 01:34:20.627835588 +0000 UTC m=+2045.056717107" Jun 10 01:34:22.127931 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:22.127881 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-njr9p_bdb6eea5-2e68-4de9-89a6-01adba311202/global-pull-secret-syncer/0.log" Jun 10 01:34:22.240474 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:22.240443 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rmnhn_c6f5436e-e089-4a70-9f14-42d9d210e0ff/konnectivity-agent/0.log" Jun 10 01:34:22.341055 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:22.340991 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-200.ec2.internal_feee623398e5bee5c16774f65308d931/haproxy/0.log" Jun 10 01:34:26.997283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:26.997232 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j_95aa7a2f-d9c8-4b9b-a600-094dacdabd21/extract/0.log" Jun 10 01:34:27.018969 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.018937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j_95aa7a2f-d9c8-4b9b-a600-094dacdabd21/util/0.log" Jun 10 01:34:27.043229 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.043174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hvh4j_95aa7a2f-d9c8-4b9b-a600-094dacdabd21/pull/0.log" Jun 10 01:34:27.069007 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.068973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx_a7e1e853-c813-4925-8f38-f64e140a3885/extract/0.log" Jun 10 01:34:27.091238 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.091073 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx_a7e1e853-c813-4925-8f38-f64e140a3885/util/0.log" Jun 10 01:34:27.116786 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.116757 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rhwx_a7e1e853-c813-4925-8f38-f64e140a3885/pull/0.log" Jun 10 01:34:27.146497 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.146462 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j_aea4c58b-e9bc-4cd4-94dd-ae49160ea49e/extract/0.log" Jun 10 01:34:27.168098 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.167979 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j_aea4c58b-e9bc-4cd4-94dd-ae49160ea49e/util/0.log" Jun 10 01:34:27.189771 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.189731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734r72j_aea4c58b-e9bc-4cd4-94dd-ae49160ea49e/pull/0.log" Jun 10 01:34:27.229389 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.229361 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk_65290a14-f279-44ab-b2e0-2ff799fdec85/extract/0.log" Jun 10 01:34:27.252452 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.252351 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk_65290a14-f279-44ab-b2e0-2ff799fdec85/util/0.log" Jun 10 01:34:27.280536 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.280508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s6lvk_65290a14-f279-44ab-b2e0-2ff799fdec85/pull/0.log" Jun 10 01:34:27.461577 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.461538 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wn6r4_b2543c74-bb93-42b3-8b78-884db12fbd39/manager/0.log" Jun 10 01:34:27.511283 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.511204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6xcc7_05c3750f-23e5-43f1-af23-255f968b69c8/kuadrant-console-plugin/0.log" Jun 10 01:34:27.545781 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.545736 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-txvwd_43c1beef-4f7e-4248-8660-0f68b6752fca/registry-server/0.log" Jun 10 01:34:27.614915 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:27.614881 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-x9zlh_af9744d1-c6f6-4a48-ab7e-a1ab76174233/limitador/0.log" Jun 10 01:34:29.323586 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.323501 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/alertmanager/0.log" Jun 10 01:34:29.345353 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.345317 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/config-reloader/0.log" Jun 10 01:34:29.378987 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.378937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/kube-rbac-proxy-web/0.log" Jun 10 01:34:29.402014 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.401978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/kube-rbac-proxy/0.log" Jun 10 01:34:29.429866 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.429813 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/kube-rbac-proxy-metric/0.log" Jun 10 01:34:29.452065 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.452032 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/prom-label-proxy/0.log" Jun 10 01:34:29.478358 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.478325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9cf13f2f-ccb7-4ddf-88d0-952c863162c2/init-config-reloader/0.log" Jun 10 01:34:29.624741 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.624638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-744cfd5df7-k7hd8_333deffa-ff11-4271-8a08-a99293395962/metrics-server/0.log" Jun 10 01:34:29.652812 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.652781 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kv4rr_c4d5f505-d01f-4ab0-8661-6042103fe289/monitoring-plugin/0.log" Jun 10 01:34:29.685688 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.685651 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht4j8_fbb49ece-903b-479e-934f-81e8b2d0aa70/node-exporter/0.log" Jun 10 01:34:29.710512 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.710477 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht4j8_fbb49ece-903b-479e-934f-81e8b2d0aa70/kube-rbac-proxy/0.log" Jun 10 01:34:29.731742 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.731710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ht4j8_fbb49ece-903b-479e-934f-81e8b2d0aa70/init-textfile/0.log" Jun 10 01:34:29.931263 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.931233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vz2tb_044a63c6-4695-4678-9033-7c6eab6cb7be/kube-rbac-proxy-main/0.log" Jun 10 01:34:29.972367 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.972338 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vz2tb_044a63c6-4695-4678-9033-7c6eab6cb7be/kube-rbac-proxy-self/0.log" Jun 10 01:34:29.997413 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:29.997383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vz2tb_044a63c6-4695-4678-9033-7c6eab6cb7be/openshift-state-metrics/0.log" Jun 10 01:34:30.274756 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:30.274720 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-t6r6h_2857c0fa-9b8f-42e0-863a-d8cbcd003505/prometheus-operator-admission-webhook/0.log" Jun 10 01:34:30.305174 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:30.305143 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b7d568b6-frw7f_dc547ca5-5463-4f76-bb51-bdf2365514f0/telemeter-client/0.log" Jun 10 01:34:30.330175 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:30.330140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b7d568b6-frw7f_dc547ca5-5463-4f76-bb51-bdf2365514f0/reload/0.log" Jun 10 01:34:30.357668 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:30.357637 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b7d568b6-frw7f_dc547ca5-5463-4f76-bb51-bdf2365514f0/kube-rbac-proxy/0.log" Jun 10 01:34:33.171006 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:33.170972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-788f5ccdd7-sg7zh_68351c1d-d66b-4a22-aa77-4985d8f95ac6/console/0.log" Jun 10 01:34:33.210805 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:33.210770 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hzzbn_ec801d56-280a-409a-8861-d999f87e9875/download-server/0.log" Jun 10 01:34:33.937483 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:33.937443 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw"] Jun 10 01:34:33.946834 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:33.946801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:33.947270 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:33.947246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw"] Jun 10 01:34:33.950887 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:33.949363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-xspsz_9b8f031b-9eb5-45ae-a372-f5bc0bb8dfd2/volume-data-source-validator/0.log" Jun 10 01:34:34.141118 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.141070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-proc\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.141331 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.141189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fv5m\" (UniqueName: \"kubernetes.io/projected/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-kube-api-access-4fv5m\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.141331 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.141233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-podres\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.141331 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.141323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-lib-modules\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.141518 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.141372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-sys\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-lib-modules\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-sys\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-proc\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fv5m\" (UniqueName: \"kubernetes.io/projected/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-kube-api-access-4fv5m\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-podres\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-podres\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-lib-modules\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242897 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-sys\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.243583 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.242936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-proc\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.251060 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.251017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fv5m\" (UniqueName: \"kubernetes.io/projected/66b9f34b-2fd3-45a6-8fe6-77cfaddff263-kube-api-access-4fv5m\") pod \"perf-node-gather-daemonset-hvmpw\" (UID: \"66b9f34b-2fd3-45a6-8fe6-77cfaddff263\") " pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.265072 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.265036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.461194 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.461053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw"] Jun 10 01:34:34.462973 ip-10-0-139-200 kubenswrapper[2559]: W0610 01:34:34.462937 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66b9f34b_2fd3_45a6_8fe6_77cfaddff263.slice/crio-35d2c62e2ff738b6a83365265ca17674c4538a4e4ba23312e8f9ad077a872a82 WatchSource:0}: Error finding container 35d2c62e2ff738b6a83365265ca17674c4538a4e4ba23312e8f9ad077a872a82: Status 404 returned error can't find the container with id 35d2c62e2ff738b6a83365265ca17674c4538a4e4ba23312e8f9ad077a872a82 Jun 10 01:34:34.742707 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.742664 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" event={"ID":"66b9f34b-2fd3-45a6-8fe6-77cfaddff263","Type":"ContainerStarted","Data":"9a4e67863c52054995c9cabaadd4837448ffcfb2adc89abbf1da0dac9786bd8e"} Jun 10 01:34:34.742881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.742732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" event={"ID":"66b9f34b-2fd3-45a6-8fe6-77cfaddff263","Type":"ContainerStarted","Data":"35d2c62e2ff738b6a83365265ca17674c4538a4e4ba23312e8f9ad077a872a82"} Jun 10 01:34:34.742881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.742779 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:34.758073 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:34.757968 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" podStartSLOduration=1.75794758 podStartE2EDuration="1.75794758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:34:34.756803906 +0000 UTC m=+2059.185685428" watchObservedRunningTime="2026-06-10 01:34:34.75794758 +0000 UTC m=+2059.186829099" Jun 10 01:34:35.201001 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:35.200965 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtqw4_d3853474-e016-40cd-a700-d65cc29d3a7f/dns/0.log" Jun 10 01:34:35.266008 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:35.265972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtqw4_d3853474-e016-40cd-a700-d65cc29d3a7f/kube-rbac-proxy/0.log" Jun 10 01:34:35.386012 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:35.385977 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2z75_da58b347-1782-4582-a001-cf6a105aaad2/dns-node-resolver/0.log" Jun 10 01:34:36.006471 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:36.006433 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85c9797f77-xzt64_bb51f020-fafe-479b-bfa7-8b6ef221db62/registry/0.log" Jun 10 01:34:36.018205 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:36.018167 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85c9797f77-xzt64_bb51f020-fafe-479b-bfa7-8b6ef221db62/registry/1.log" Jun 10 01:34:36.082961 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:36.082929 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sn29x_81e36ec1-3c1e-4d37-bfe5-6552fa4cbb00/node-ca/0.log" Jun 10 01:34:36.995814 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:36.995777 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcnfzt5_5f36dbe5-c05c-472d-8944-6bb58f2a8a24/istio-proxy/0.log" Jun 10 01:34:37.127613 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:37.127576 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/0.log" Jun 10 01:34:37.173333 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:37.173283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/1.log" Jun 10 01:34:37.906420 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:37.906384 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tsx8_deeaf967-c086-4420-8604-b16bca2c7936/serve-healthcheck-canary/0.log" Jun 10 01:34:38.443616 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:38.443576 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-k5sjt_56ee282c-0a32-4e92-853e-56294527d1d2/insights-operator/0.log" Jun 10 01:34:38.448371 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:38.448338 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-k5sjt_56ee282c-0a32-4e92-853e-56294527d1d2/insights-operator/1.log" Jun 10 01:34:38.541309 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:38.541252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf94m_0fd7393c-9c45-425d-8627-42b164c70e05/kube-rbac-proxy/0.log" Jun 10 01:34:38.560970 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:38.560942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf94m_0fd7393c-9c45-425d-8627-42b164c70e05/exporter/0.log" Jun 10 01:34:38.582363 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:38.582333 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf94m_0fd7393c-9c45-425d-8627-42b164c70e05/extractor/0.log" Jun 10 01:34:40.761354 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:40.761289 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qwhkl/perf-node-gather-daemonset-hvmpw" Jun 10 01:34:40.803133 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:40.803099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6c9bfb4667-pwphh_5de3dba1-68bc-45fc-857a-71572e633382/nginx/0.log" Jun 10 01:34:40.931725 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:40.931694 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684235-zcc4z_f802e82e-3da3-4804-9726-64f21c888af6/cleanup/0.log" Jun 10 01:34:41.297424 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:41.297385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-rgtnp_0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7/manager/0.log" Jun 10 01:34:41.313660 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:41.313633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-858fd5d86-rgtnp_0edd46dd-d1dd-43bf-aaaa-3769a2aaa9b7/copy-manifests/0.log" Jun 10 01:34:42.957589 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:42.957552 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dcf7bd6dd-qhjj4_1d9cac9a-9ef4-40dd-8234-65aecf41c715/manager/0.log" Jun 10 01:34:43.019691 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:43.019617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dpz5b_f5ade506-87cd-4282-9858-aaaf5cf6bdc3/openshift-lws-operator/0.log" Jun 10 01:34:47.706226 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:47.706183 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcnfzt5_5f36dbe5-c05c-472d-8944-6bb58f2a8a24/istio-proxy/0.log" Jun 10 01:34:47.808620 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:47.808583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/0.log" Jun 10 01:34:47.844197 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:47.844166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/1.log" Jun 10 01:34:48.831513 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:48.831472 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wq5md_10b9d554-7435-4079-a806-b6f8fee6eaf3/kube-storage-version-migrator-operator/1.log" Jun 10 01:34:48.833563 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:48.833534 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wq5md_10b9d554-7435-4079-a806-b6f8fee6eaf3/kube-storage-version-migrator-operator/0.log" Jun 10 01:34:49.077237 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:49.077200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcnfzt5_5f36dbe5-c05c-472d-8944-6bb58f2a8a24/istio-proxy/0.log" Jun 10 01:34:49.181724 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:49.181686 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/0.log" Jun 10 01:34:49.222881 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:49.222833 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/1.log" Jun 10 01:34:50.199622 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.199590 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/kube-multus-additional-cni-plugins/0.log" Jun 10 01:34:50.219910 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.219881 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/egress-router-binary-copy/0.log" Jun 10 01:34:50.239777 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.239745 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/cni-plugins/0.log" Jun 10 01:34:50.258778 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.258746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/bond-cni-plugin/0.log" Jun 10 01:34:50.282042 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.282013 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/routeoverride-cni/0.log" Jun 10 01:34:50.301343 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.301312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/whereabouts-cni-bincopy/0.log" Jun 10 01:34:50.321026 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.320998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bc5rj_2f65f3f4-b582-4015-9edb-0b55dfe5ae8b/whereabouts-cni/0.log" Jun 10 01:34:50.509610 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.509525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pxvpn_09292145-9b2f-40cc-ac41-93cec49ff39e/kube-multus/0.log" Jun 10 01:34:50.583103 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.583065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbxv2_3a374507-c6cd-4a5a-a096-b249f92c46d6/network-metrics-daemon/0.log" Jun 10 01:34:50.600222 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.600195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbxv2_3a374507-c6cd-4a5a-a096-b249f92c46d6/kube-rbac-proxy/0.log" Jun 10 01:34:50.863088 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.863005 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcnfzt5_5f36dbe5-c05c-472d-8944-6bb58f2a8a24/istio-proxy/0.log" Jun 10 01:34:50.955379 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.955340 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/0.log" Jun 10 01:34:50.990430 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:50.990392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-9hhzv_381706bb-27e4-41bf-bf00-37d222c31460/istio-proxy/1.log" Jun 10 01:34:51.666166 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.666078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/ovn-controller/0.log" Jun 10 01:34:51.682480 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.682449 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/ovn-acl-logging/0.log" Jun 10 01:34:51.710474 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.710445 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/kube-rbac-proxy-node/0.log" Jun 10 01:34:51.734097 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.734065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 01:34:51.750705 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.750662 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/northd/0.log" Jun 10 01:34:51.771346 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.771311 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/nbdb/0.log" Jun 10 01:34:51.791424 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.791392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/sbdb/0.log" Jun 10 01:34:51.856549 ip-10-0-139-200 kubenswrapper[2559]: I0610 01:34:51.856491 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2s9xf_a31f0f5f-a912-4acb-9760-21e9e1a9ef66/ovnkube-controller/0.log"